Abstract
The relevance of the study stems from the growing need to introduce artificial intelligence into the educational process, particularly in teaching non-Latin languages, such as Japanese. The combination of optical character recognition and AI-based analysis opens up new opportunities to improve the efficiency of writing assessment, the quality of feedback, and the individualisation of learning. This study aimed to investigate the use of ChatGPT to improve the effectiveness of Japanese language teaching through the automated checking of student essays. Methodologically, educators used the OCR function of ChatGPT to digitise handwritten student essays, enabling analysis of grammar, vocabulary, sentence structure, and kanji. A mixed-methods approach was adopted, combining quantitative error analysis with qualitative insights from instructors. The study revealed that ChatGPT effectively detected eight major error categories, with the most common being insufficient kanji usage, overuse of basic sentence structures, and a limited vocabulary range. The tool’s ability to generate instant error summaries and targeted feedback significantly reduced the time educators spent on marking, ensuring consistent and individualised support for learners. However, the study also identified limitations, including occasional inaccuracies in OCR processing, especially for stylised or unclear handwriting. Despite these challenges, the findings suggested that ChatGPT can serve as a valuable complementary tool to traditional teaching methods, enhancing feedback quality, supporting differentiated instruction, and promoting learner autonomy. The findings offer practical guidance for language educators, curriculum designers, and edtech developers seeking to integrate AI into the teaching and assessment of less commonly taught languages, such as Japanese
Keywords
generative AI; language proficiency evaluation; AI in education; automated feedback; Japanese language pedagogy
References
- Aydın Yıldız, T. (2024). Exploring the impact of ChatGPT on improving 21st-century skills for future English teachers during lesson planning. Computers in the Schools, 1-24. doi: 10.1080/07380569.2024.2429534.
- Baidoo-Anu, D., & Owusu Ansah, L. (2023). Education in the era of generative artificial intelligence (AI): Understanding the potential benefits of ChatGPT in promoting teaching and learning. Journal of AI, 7(1), 52-62. doi: 10.61969/ jai.1337500.
- Chaudhry, I.S., Sarwary, S.A.M., El Refae, G.A., & Chabchoub, H. (2023). Time to revisit existing student’s performance evaluation approach in higher education sector in a new era of ChatGPT – a case study. Cogent Education, 10(1), article number 2210461. doi: 10.1080/2331186X.2023.2210461.
- Dwivedi, Y.K., et al. (2021). Artificial Intelligence (AI): Multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy. International Journal of Information Management, 57, article number 101994. doi: 10.1016/j.ijinfomgt.2019.08.002.
- Huang, W. (2020). Machine learning approach of Japanese composition scoring and writing aided system’s design. arXiv Preprint, 225-230. doi: 10.48550/arXiv.2008.11488.
- Ilić, J., Ivanović, M., & Klašnja-Milićević, A. (2024). The impact of ChatGPT on student learning experience in higher STEM education: A systematic literature review. In 2024 21st International conference on information technology based higher education and training (ITHET) (pp. 1-9). Paris: IEEE. doi: 10.1109/ITHET61869.2024.10837649.
- Ishioka, T., & Kameda, M. (2004). Automated Japanese essay scoring system: Jess. In Proceedings of the 21st international conference on computational linguistics and 44th annual meeting of the association for computational linguistics (pp. 4-8). Zaragoza: IEEE. doi: 10.1109/DEXA.2004.1333440.
- Jing, Y. (2020). Research on the application of artificial intelligence natural language processing technology in Japanese teaching. Journal of Physics: Conference Series, 1682, article number 012081. doi: 10.1088/1742-6596/1682/1/012081.
- Kamoun, F., El Ayeb, W., Jabri, I., Sifi, S., & Iqbal, F. (2024). Exploring students’ and faculty’s knowledge, attitudes, and perceptions towards ChatGPT: A cross-sectional empirical study. Journal of Information Technology Education: Research, 23, article number 4. doi: 10.28945/5239.
- Kotsis, K.T. (2024). Correcting students’ misconceptions in physics using experiments designed by ChatGPT. European Journal of Contemporary Education and E-Learning, 2(2), 83-100. doi: 10.59324/ejceel.2024.2(2).07.
- Li, J., Jangamreddy, N.K., Hisamoto, R., Bhansali, R., Dyda, A., Zaphir, L., & Glencross, M. (2024). AI-assisted marking: Functionality and limitations of ChatGPT in written assessment evaluation. Australasian Journal of Educational Technology, 40(5), 56-72. doi: 10.14742/ajet.9463.
- Li, M. (2024). Leveraging ChatGPT for second language writing feedback and assessment. International Journal of Computer-Assisted Language Learning and Teaching, 14(2), 1-11. doi: 10.4018/IJCALLT.360382.
- Ministry of Education. (2023). Retrieved from https://www.moe.gov.sg.
- Mohan, G.B., Kumar, R.P., Krishh, P.V., Keerthinathan, A., Lavanya, G., Meghana, M.K.U., Sulthana, S., & Doss, S. (2024). An analysis of large language models: Their impact and potential applications. Knowledge and Information Systems, 66, 5047-5070. doi: 10.1007/s10115-024-02120-8.
- Pesce, M.A., & Fernández Blanco, D. (2024). Perceptions of pre-service teachers on the use of ChatGPT during their training and the future implications for their future role in high schools: A research in progress. Research Square, 1-28. doi: 10.21203/rs.3.rs-4542918/v1.
- Pham, M.T., & Cao, T.X.T. (2025). The practice of ChatGPT in English teaching and learning in Vietnam: A systematic review. International Journal of TESOL & Education, 5(1), 50-70. doi: 10.54855/ijte.25513.
- Smart Nation and Digital Government Office. (2023). Retrieved from https://file.go.gov.sg/nais2023.pdf.
- Susnjak, T., & McIntosh, T.R. (2024). ChatGPT: The end of online exam integrity?. Education Sciences, 14(6), article number 656. doi: 10.3390/educsci14060656.
- Taele, P., Koh, J.I., & Hammond, T. (2020). Kanji workbook: A writing-based intelligent tutoring system for learning proper Japanese kanji writing technique with instructor-emulated assessment. In Proceedings of the AAAI conference on Artificial Intelligence (vol. 34(08), pp. 13382-13389). Washington: AAAI Press. doi: 10.1609/aaai.v34i08.7053
- Tsai, C. (2016). Recognizing handwritten Japanese characters using deep convolutional neural networks. Retrieved from https://cs231n.stanford.edu/reports/2016/pdfs/262_Report.pdf.
- Woodruff, K., Hutson, J., & Arnone, K. (2023). Perceptions and barriers to adopting artificial intelligence in K-12 education: A survey of educators in fifty states. In Reimagining education: The role of e-learning, creativity, and technology in the post-pandemic era. InTechOpen. doi: 10.5772/intechopen.1002741.
- Zawacki-Richter, O., Marín, V.I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education – where are the educators?. International Journal of Educational Technology in Higher Education, 16(1), article number 39. doi: 10.1186/s41239-019-0171-0.