AI-Assisted Web-Based Corrective Feedback To Improve Senior High School Students’ Listening Comprehension
Abstract
Listening receives limited class time at the senior high school level, and large classes rarely allow teachers to give personal written feedback on students’ open-ended answers. Web-based listening tools and AI scoring systems both exist, but the two are seldom integrated so that learners receive immediate corrective feedback on free-text listening responses. This study addressed that gap by developing and testing a web-based learning system assisted by artificial intelligence (AI), and it examined both the feasibility and the effectiveness of the product. The Research and Development method was applied through the Integrative Learning Design Framework across three phases, namely exploration, enactment, and evaluation. The product is a website named Ear Up! that delivers CEFR-graded audio lessons, collects essay answers, and uses an OpenAI GPT-4o model to return automated corrective feedback and next-lesson recommendations. The system was trialed with 28 tenth-grade students. Expert and user evaluation produced a mean feasibility score of 4.67 out of 5, in the very feasible band. Under a one-group pretest-posttest design, listening for details improved at a medium level (N-gain = 0.67) and listening for inference at a low level (N-gain = 0.25), while classical mastery rose from 29.41% to 82.35% and from 32.35% to 67.65%. The findings indicate that automated corrective feedback can extend listening practice beyond limited class time, yet higher-order inference still depends on teacher mediation. AI-assisted corrective feedback is therefore best positioned as a teacher-supervised supplement in future language learning.
References
Al-Nafisah, K. I. (2019). Issues and strategies in improving listening comprehension in a classroom. International Journal of Linguistics, 11(3), 93. https://doi.org/10.5296/ijl.v11i3.14614
Alzamil, J. (2021). Listening skills: Important but difficult to learn. Arab World English Journal, 12(3), 366–374. https://doi.org/10.24093/awej/vol12no3.25
Amalia, D., Ariani, D., & Chaeruman, U. A. (2024). Pengembangan learning object “interaktivitas pembelajaran daring” berdasarkan the first principles of instruction untuk mata kuliah designing e-learning. Jurnal Pembelajaran Inovatif, 7(1), 36–43. https://doi.org/10.21009/JPI.071.04
Bannan-Ritland, B. (2003). The role of design in research: The integrative learning design framework. Educational Researcher, 32(1), 21–24. https://doi.org/10.3102/0013189X032001021
Bayrak, D. F., Moanes, D. M., & Altun, D. A. (2020). Development of online course satisfaction scale. Turkish Online Journal of Distance Education, 21(4), 110–123. https://doi.org/10.17718/tojde.803378
Castro, M. D. B., & Tumibay, G. M. (2021). A literature review: Efficacy of online learning courses for higher education institutions using meta-analysis. Education and Information Technologies, 26(2), 1367–1385. https://doi.org/10.1007/s10639-019-10027-z
Cavalcanti, A. P., Barbosa, A., Carvalho, R., Freitas, F., Tsai, Y.-S., Gašević, D., & Mello, R. F. (2021). Automatic feedback in online learning environments: A systematic literature review. Computers and Education: Artificial Intelligence, 2, 100027. https://doi.org/10.1016/j.caeai.2021.100027
Chen, L., Chen, P., & Lin, Z. (2020). Artificial intelligence in education: A review. IEEE Access, 8, 75264–75278. https://doi.org/10.1109/ACCESS.2020.2988510
Chen, X., Xie, H., Zou, D., & Hwang, G.-J. (2020). Application and theory gaps during the rise of artificial intelligence in education. Computers and Education: Artificial Intelligence, 1, 100002. https://doi.org/10.1016/j.caeai.2020.100002
Dalu, Z. C. A., Satrio, A., Aprastin, T. N. B., & Maulidah, S. (2023). Platform microlearning object berbantuan Open AI (artificial intelligence) sebagai upaya membangun lingkungan pembelajaran mandiri bagi mahasiswa pelaksana MBKM. EPISTEMA, 4(2), 154–165. https://doi.org/10.21831/ep.v4i2.66893
Dawson, P., Henderson, M., Mahoney, P., Phillips, M., Ryan, T., Boud, D., & Molloy, E. (2019). What makes for effective feedback: Staff and student perspectives. Assessment & Evaluation in Higher Education, 44(1), 25–36. https://doi.org/10.1080/02602938.2018.1467877
del Gobbo, E., Guarino, A., Cafarelli, B., Grilli, L., & Limone, P. (2023). Automatic evaluation of open-ended questions for online learning: A systematic mapping. Studies in Educational Evaluation, 77, 101258. https://doi.org/10.1016/j.stueduc.2023.101258
Fan, N. (2023). Exploring the effects of automated written corrective feedback on EFL students’ writing quality: A mixed-methods study. SAGE Open, 13(2). https://doi.org/10.1177/21582440231181296
Farrell, O. (2020). A balancing act: A window into online student engagement experiences. International Journal of Educational Technology in Higher Education, 17(1). https://doi.org/10.1186/s41239-020-00199-x
Fitria, T. N. (2023). Artificial intelligence (AI) technology in OpenAI ChatGPT application: A review of ChatGPT in writing English essay. ELT Forum: Journal of English Language Teaching, 12(1), 44–58. https://doi.org/10.15294/elt.v12i1.64069
French, F., Levi, D., Maczo, C., Simonaityte, A., Triantafyllidis, S., & Varda, G. (2023). Creative use of OpenAI in education: Case studies from game development. Multimodal Technologies and Interaction, 7(8), 81. https://doi.org/10.3390/mti7080081
Gilakjani, A. P., & Sabouri, N. B. (2016a). Learners’ listening comprehension difficulties in English language learning: A literature review. English Language Teaching, 9(6), 123. https://doi.org/10.5539/elt.v9n6p123
Gilakjani, A. P., & Sabouri, N. B. (2016b). The significance of listening comprehension in English language teaching. Theory and Practice in Language Studies, 6(8), 1670. https://doi.org/10.17507/tpls.0608.22
Goh, C. C. M., & Vandergrift, L. (2022). Teaching and learning second language listening: Metacognition in action (2nd ed.). Routledge.
González-Calatayud, V., Prendes-Espinosa, P., & Roig-Vila, R. (2021). Artificial intelligence for student assessment: A systematic review. Applied Sciences, 11(12), 5467. https://doi.org/10.3390/app11125467
Haggag, M. H., Latif, M. A., & Helal, D. M. (2018). A learning analytics approach for student performance assessment. International Journal of Computer Science and Information Technology, 10(4), 79–94. https://doi.org/10.5121/ijcsit.2018.10407
Hake, R. R. (1998). Interactive-engagement versus traditional methods: A six-thousand-student survey of mechanics test data for introductory physics courses. American Journal of Physics, 66(1), 64–74. https://doi.org/10.1119/1.18809
Hidayat, D. N., Lee, J. Y., Mason, J., & Khaerudin, T. (2022). Digital technology supporting English learning among Indonesian university students. Research and Practice in Technology Enhanced Learning, 17(1). https://doi.org/10.1186/s41039-022-00198-8
Hu, J., & Hu, X. (2020). The effectiveness of autonomous listening study and pedagogical implications in the module of artificial intelligence. Journal of Physics: Conference Series, 1684(1), 012037. https://doi.org/10.1088/1742-6596/1684/1/012037
Hussein, M. A., Hassan, H., & Nassef, M. (2019). Automated language essay scoring systems: A literature review. PeerJ Computer Science, 5, e208. https://doi.org/10.7717/peerj-cs.208
Jia, F., Sun, D., Ma, Q., & Looi, C.-K. (2022). Developing an AI-based learning system for L2 learners’ authentic and ubiquitous learning in English language. Sustainability, 14(23), 15527. https://doi.org/10.3390/su142315527
Lakhal, S., Khechine, H., & Mukamurera, J. (2021). Explaining persistence in online courses in higher education: A difference-in-differences analysis. International Journal of Educational Technology in Higher Education, 18(1), 1–32. https://doi.org/10.1186/s41239-021-00251-4
Li, J., Huang, J., Wu, W., & Whipple, P. B. (2024). Evaluating the role of ChatGPT in enhancing EFL writing assessments in classroom settings: A preliminary investigation. Humanities and Social Sciences Communications, 11(1), 1268. https://doi.org/10.1057/s41599-024-03755-2
Makruf, I., Rifa’i, A. A., & Triana, Y. (2022). Moodle-based online learning management in higher education. International Journal of Instruction, 15(1), 135–152. https://doi.org/10.29333/iji.2022.1518a
Modaressi, G., & Jalilzadeh, K. (2020). A comparative study of two ways of presentation of listening assessment: Moving towards internet-based assessment. Language Teaching and Educational Research, 3(2), 176–194. https://doi.org/10.35207/later.742121
Neo, M., Lee, C. P., Tan, H. Y.-J., Neo, T. K., Tan, Y. X., Mahendru, N., & Ismat, Z. (2022). Enhancing students’ online learning experiences with artificial intelligence (AI): The MERLIN project. International Journal of Technology, 13(5), 1023–1034. https://doi.org/10.14716/ijtech.v13i5.5843
Nicol, D. J., & Macfarlane-Dick, D. (2006). Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Studies in Higher Education, 31(2), 199–218. https://doi.org/10.1080/03075070600572090
Nurohmawati, M., & Arini, R. (2023). Designing web-based English listening tasks for university students. Journal of Education and Teaching Learning (JETL), 5(3), 51–62. https://doi.org/10.51178/jetl.v5i3.1529
Ouyang, F., Wu, M., Zheng, L., Zhang, L., & Jiao, P. (2023). Integration of artificial intelligence performance prediction and learning analytics to improve student learning in online engineering course. International Journal of Educational Technology in Higher Education, 20(1), 4. https://doi.org/10.1186/s41239-022-00372-4
Pei, T., & Suwanthep, J. (2019). Effects of web-based metacognitive listening on Chinese university EFL learners’ listening comprehension and metacognitive awareness. Indonesian Journal of Applied Linguistics, 9(2), 480–492. https://doi.org/10.17509/ijal.v9i2.20246
Pham, M., Singh, K., & Jahnke, I. (2023). Socio-technical-pedagogical usability of online courses for older adult learners. Interactive Learning Environments, 31(5), 2855–2871. https://doi.org/10.1080/10494820.2021.1912784
Pikhart, M. (2020). Intelligent information processing for language education: The use of artificial intelligence in language learning apps. Procedia Computer Science, 176, 1412–1419. https://doi.org/10.1016/j.procs.2020.09.151
Polakova, P., & Ivenz, P. (2024). The impact of ChatGPT feedback on the development of EFL students’ writing skills. Cogent Education, 11(1), 2410101. https://doi.org/10.1080/2331186X.2024.2410101
Rahimi, M., Fathi, J., & Zou, D. (2024). Exploring the impact of automated written corrective feedback on the academic writing skills of EFL learners: An activity theory perspective. Education and Information Technologies, 30(3), 2691–2735. https://doi.org/10.1007/s10639-024-12896-5
Rahman, M. N., Chowdhury, S., & Mazgutova, D. (2023). Rethinking teaching listening skills: A case study. Language Teaching Research Quarterly, 33, 176–190. https://doi.org/10.32038/ltrq.2023.33.10
Richards, J. C. (2015). The changing face of language learning: Learning beyond the classroom. RELC Journal, 46(1), 5–22. https://doi.org/10.1177/0033688214561621
Sánchez, C. J. P., Calle-Alonso, F., & Vega-Rodríguez, M. A. (2022). Learning analytics to predict students’ performance: A case study of a neurodidactics-based collaborative learning platform. Education and Information Technologies, 27(9), 12913–12938. https://doi.org/10.1007/s10639-022-11128-y
Saragih, A., Mursid, R., & Sriadhi, S. (2024). Blended-based integrative learning design framework learning model: Improving numerical ability and competency in evaluation of student learning results. In Proceedings of the 5th International Conference on Innovation in Education, Science, and Culture (ICIESC 2023). EAI. https://doi.org/10.4108/eai.24-10-2023.2342074
Shadiev, R., & Feng, Y. (2023). Using automated corrective feedback tools in language learning: A review study. Interactive Learning Environments. Advance online publication. https://doi.org/10.1080/10494820.2022.2153145
Sumakul, D. T. Y. G., & Hamied, F. A. (2023). Amotivation in AI injected EFL classrooms: Implications for teachers. Indonesian Journal of Applied Linguistics, 13(1), 26–34. https://doi.org/10.17509/ijal.v13i1.58254
Süzen, N., Gorban, A. N., Levesley, J., & Mirkes, E. M. (2020). Automatic short answer grading and feedback using text mining methods. Procedia Computer Science, 169, 726–743. https://doi.org/10.1016/j.procs.2020.02.171
Urrutia, F., & Araya, R. (2023). Automatically detecting incoherent written math answers of fourth-graders. Systems, 11(7), 353. https://doi.org/10.3390/systems11070353
van der Kleij, F. M. (2019). Comparison of teacher and student perceptions of formative assessment feedback practices and association with individual student characteristics. Teaching and Teacher Education, 85, 175–189. https://doi.org/10.1016/j.tate.2019.06.010
Vo, N. N. Y., Vu, Q. T., Vu, N. H., Vu, T. A., Mach, B. D., & Xu, G. (2022). Domain-specific NLP system to support learning path and curriculum design at tech universities. Computers and Education: Artificial Intelligence, 3, 100042. https://doi.org/10.1016/j.caeai.2021.100042
Wilson, F. R., Pan, W., & Schumsky, D. A. (2012). Recalculation of the critical values for Lawshe’s content validity ratio. Measurement and Evaluation in Counseling and Development, 45(3), 197–210. https://doi.org/10.1177/0748175612440286
Wilson, J. J. (2008). How to teach listening. Pearson Education.
Wong, J., Baars, M., Davis, D., Van der Zee, T., Houben, G.-J., & Paas, F. (2019). Supporting self-regulated learning in online learning environments and MOOCs: A systematic review. International Journal of Human-Computer Interaction, 35(4–5), 356–373. https://doi.org/10.1080/10447318.2018.1543084
Yu, J., & Jee, Y. (2021). Analysis of online classes in physical education during the COVID-19 pandemic. Education Sciences, 11(1), 3. https://doi.org/10.3390/educsci11010003
Yunus, W. N. M. W. M. (2020). Written corrective feedback in English compositions: Teachers’ practices and students’ expectations. English Language Teaching Educational Journal, 3(2), 95. https://doi.org/10.12928/eltej.v3i2.2255
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education – where are the educators? International Journal of Educational Technology in Higher Education, 16(1), 1–27. https://doi.org/10.1186/s41239-019-0171-0
Zhai, X., Chu, X., Chai, C. S., Jong, M. S. Y., Istenic, A., Spector, M., Liu, J. B., Yuan, J., & Li, Y. (2021). A review of artificial intelligence (AI) in education from 2010 to 2020. Complexity, 2021, 8812542. https://doi.org/10.1155/2021/8812542
Copyright (c) 2026 IJGIE (International Journal of Graduate of Islamic Education)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
.png)
