Smart learning in programming: a systematic literature review

Authors

  • Edison Amador Miguez Gordillo Universidad Nacional de Chimborazo, Facultad de Ciencias de la Educación, Humanas y Tecnologías, Riobamba, Chimborazo, Ecuador ORCID iD https://orcid.org/0009-0007-3676-2989
  • Patricio Ricardo Humanante Ramos Universidad Nacional de Chimborazo, Facultad de Ciencias de la Educación, Humanas y Tecnologías, Riobamba, Chimborazo, Ecuador ORCID iD https://orcid.org/0000-0003-2632-2051

DOI:

https://doi.org/10.33936/isrtic.v10i1.8443

Keywords:

smart learning, programming, adaptive learning

Abstract

Smart learning in programming education has experienced sustained growth due to the incorporation of artificial intelligence, adaptive systems, and generative tools aimed to personalizing learning. The objective of this study was to analyze the advances, approaches, tools, and challenges associated with the application of intelligent technologies in programming education contexts. To this end, a systematic literature review (SLR) was conducted based on the methodology proposed by Kitchenham, structured into planning, development, and documentation phases. Information was retrieved from the Scopus and IEEE Xplore databases, applying inclusion and exclusion criteria, as well as methodological quality assessment, to select scientific studies published between 2022 and 2026.The results show a predominance of Intelligent Tutoring System (ITS), models based on large language models (LLMs), adaptive platforms, and immersive gamified environments. These technologies enable immediate feedback, adaptation to student performance, and personalized support throughout the learning process. The studies report improvements in academic performance, conceptual understanding, problem solving, code debugging, motivation, and computational thinking as well. The main limitations identified are the excessive dependence on generative tools, the possibility of inaccurate responses, and the limited longitudinal evidence on their effects across different educational contexts. The integration of artificial intelligence and teacher mediation fosters more flexible and autonomous learning experiences centered on the individual needs of programming students.

Downloads

Download data is not yet available.

References

Adil Shah. (2025). Artificial Intelligence and Its Impact on Education and Digital Learning. International Journal of Research & Technology, 13(S4), 511–517. https://doi.org/10.64882/ijrt.v13.iS4.824

Alanazi, M., Li, A., Samra, H., & Soh, B. (2025). Examining the Influence of AI on Python Programming Education: An Empirical Study and Analysis of Student Acceptance Through TAM3. Computers, 14(10), 411. https://doi.org/10.3390/computers14100411

Alanazi, M., Soh, B., Samra, H., & Li, A. (2025). PyChatAI: Enhancing Python Programming Skills—An Empirical Study of a Smart Learning System. Computers, 14(5), 158. https://doi.org/10.3390/computers14050158

Amo-Filva, D. (2023). Editorial Consolidar aulas inteligentes para configurar espacios de aprendizaje Editorial Consolidating smart classrooms for shaping learning spaces. (2), 3767. https://doi.org/10.17345/ute.2023.3767

Aromataris, E., Lockwood, C., Porritt, K., Pilla, B., & Jordan, Z. (Eds.). (2024). JBI Manual for Evidence Synthesis. JBI. https://doi.org/10.46658/JBIMES-24-01

Atta, A., Esmat, M., Amasha, N., Elayat, E., & ElSaid, W. K. (2025). A Smart ChatGPT Mobile Application for Improving C# Programming Skills for Students in Educational Institutions. Qubahan Academic Journal, 5(2), 49–62. https://doi.org/10.48161/qaj.v5n2a1772

Biblioteca Universidad de Navarra. (2024). Revisiones sistemáticas: Ejemplos de criterios de inclusión y de exclusión. https://biblioguias.unav.edu/revisionessistematicas/criterios_de_inclusion_y_exclusion

Bolaño-García, M., & Duarte-Acosta, N. (2023). Una revisión sistemática del uso de la inteligencia artificial en la educación. Revista Colombiana de Cirugía. https://doi.org/10.30944/20117582.2365

Cao, C. (2023). Scaffolding CS1 Courses with a Large Language Model-Powered Intelligent Tutoring System. International Conference on Intelligent User Interfaces, Proceedings IUI, 229–232. https://doi.org/10.1145/3581754.3584111

Chrysafiadi, K., & Virvou, M. (2024). PerFuSIT: Personalized Fuzzy Logic Strategies for Intelligent Tutoring of Programming. Electronics, 13(23), 4827. https://doi.org/10.3390/electronics13234827

Chrysafiadi, K., Virvou, M., Tsihrintzis, G. A., & Hatzilygeroudis, I. (2023). Evaluating the user’s experience, adaptivity and learning outcomes of a fuzzy-based intelligent tutoring system for computer programming for academic students in Greece. Education and Information Technologies, 28(6), 6453–6483. https://doi.org/10.1007/s10639-022-11444-3

Fan, Z., Noller, Y., Dandekar, A., & Roychoudhury, A. (2024). Software Engineering Educational Experience in Building an Intelligent Tutoring System. http://arxiv.org/abs/2310.05472

Finnie-Ansley, J., Denny, P., Becker, B. A., Luxton-Reilly, A., & Prather, J. (2022). The Robots Are Coming: Exploring the Implications of OpenAI Codex on Introductory Programming. Proceedings of the 24th Australasian Computing Education Conference, 10–19. https://doi.org/10.1145/3511861.3511863

Franklin, D., Denny, P., Gonzalez-Maldonado, D. A., & Tran, M. (2025). Generative AI in Computer Science Education. Cambridge University Press. https://doi.org/10.1017/9781009581738

Garzón, J., Patiño, E., & Marulanda, C. (2025). Systematic Review of Artificial Intelligence in Education: Trends, Benefits, and Challenges. Multimodal Technologies and Interaction, 9(8), 84. https://doi.org/10.3390/mti9080084

Gianni, A. M., Nikolakis, N., & Antoniadis, N. (2025). An LLM based learning framework for adaptive feedback mechanisms in gamified XR. Computers & Education: X Reality, 7, 100116. https://doi.org/10.1016/j.cexr.2025.100116

Hariyanto, Kristianingsih, F. X. D., & Maharani, R. (2025). Artificial intelligence in adaptive education: a systematic review of techniques for personalized learning. Discover Education, 4(1), 458. https://doi.org/10.1007/s44217-025-00908-6

Hartley, K., Hayak, M., & Ko, U. H. (2024). Artificial Intelligence Supporting Independent Student Learning: An Evaluative Case Study of ChatGPT and Learning to Code. Education Sciences, 14(2), 120. https://doi.org/10.3390/educsci14020120

Hongthong, T., Chondamrongkul, N., & Temdee, P. (2025). Personalized Recommendation Framework Using Large Language Model and Chain-of-thought Prompting: A Case Study of a Computer Programming Course. Journal of Mobile Multimedia. https://doi.org/10.13052/jmm1550-4646.2165

Huang, S., Sun, Y., & Yu, X. (2025). SP-TeachLLM: An LLM-Driven Framework for Personalized and Adaptive Programming Education. Information, 16(12), 1045. https://doi.org/10.3390/info16121045

Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., … Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274

Katona, J., & Gyonyoru, K. I. K. (2025). AI-based Adaptive Programming Education for Socially Disadvantaged Students: Bridging the Digital Divide. TechTrends, 69(5), 925–942. https://doi.org/10.1007/s11528-025-01088-8

Kitchenham, B. & C. Stuart. (2007a). Guidelines for performing Systematic Literature Reviews in Software Engineering. https://www.researchgate.net/publication/302924724_Guidelines_for_performing_Systematic_Literature_Reviews_in_Software_Engineering

Kitchenham, B. & C. Stuart. (2007b). Guidelines for performing Systematic Literature Reviews in Software Engineering. https://www.researchgate.net/publication/302924724_Guidelines_for_performing_Systematic_Literature_Reviews_in_Software_Engineering

Köhler, J., Hidalgo, L., & Jara, J. L. (2023). Predicting Students’ Outcome in an Introductory Programming Course: Leveraging the Student Background. Applied Sciences, 13(21), 11994. https://doi.org/10.3390/app132111994

Lai, C.-H., & Lin, C.-Y. (2025a). Analysis of Learning Behaviors and Outcomes for Students with Different Knowledge Levels: A Case Study of Intelligent Tutoring System for Coding and Learning (ITS-CAL). Applied Sciences, 15(4), 1922. https://doi.org/10.3390/app15041922

Lai, C.-H., & Lin, C.-Y. (2025b). Analysis of Learning Behaviors and Outcomes for Students with Different Knowledge Levels: A Case Study of Intelligent Tutoring System for Coding and Learning (ITS-CAL). Applied Sciences, 15(4), 1922. https://doi.org/10.3390/app15041922

Latif, E., Liu, V., & Zhai, X. (2026). A systematic review of intelligent and robot tutoring systems: evolution, pedagogical design, and AI-driven classification. Smart Learning Environments, 13(1), 1. https://doi.org/10.1186/s40561-025-00427-9

Létourneau, A., Deslandes Martineau, M., Charland, P., Karran, J. A., Boasen, J., & Léger, P. M. (2025). A systematic review of AI-driven intelligent tutoring systems (ITS) in K-12 education. Npj Science of Learning, 10(1), 29. https://doi.org/10.1038/s41539-025-00320-7

Li, H.-J., Huang, Q.-R., Wen, L.-P., Chen, W., & Xu, Z.-Z. (2025). Generative Artificial Intelligence Supported Programming Learning: Learning Effectiveness and Core Competence. SAGE Open, 15(3). https://doi.org/10.1177/21582440251377986

Lin, K.-Y., Li, M.-H., Lo, F., Huang, H.-C., Matsuno, K., & Watanabe, R. (2025). Adaptive learning with human factors and Artificial Intelligence: associations with training effectiveness in programming education. International Journal of Industrial Ergonomics, 110, 103834. https://doi.org/10.1016/j.ergon.2025.103834

Łodzikowski, K., Foltz, P. W., & Behrens, J. T. (2023). Generative AI and Its Educational Implications. https://doi.org/https://doi.org/10.48550/arXiv.2401.08659

López-Vasco, F. E., Angulo-Álvarez, M. R. y Sosa-Zúñiga, D. I. (2025). Formación docente en IA Generativa: impacto ético y retos en educación superior. Alteridad, 20(2), 166-177. https://doi.org/10.17163/alt.v20n2.2025.01p-ISSN:1390-325X / e-ISSN:1390-8642http://alteridad.ups.edu.ec

Marougkas, A., Troussas, C., Krouska, A., & Sgouropoulou, C. (2025). An adaptive virtual reality game for programming education using fuzzy cognitive maps and pedagogical models. Smart Learning Environments, 12(1), 62. https://doi.org/10.1186/s40561-025-00392-3

Martínez Lobo, A. del P., & Martínez Romero, B. (2022). Bases de datos académicas-científicas, su uso para el desarrollo de la investigación y producción de las IES en el sector aeronáutico en Colombia. Ciencia y Poder Aéreo, 17(2). https://doi.org/10.18667/cienciaypoderaereo.736

Miguez Gordillo, M. Á. (2025). La inteligencia artificial como recurso didáctico en el proceso de enseñanza y aprendizaje. Revista Multidisciplinar Epistemología de Las Ciencias, 2(2), 181–196. https://doi.org/10.71112/vqb1zx28

Mittelhessen, T. H., Reid, S. A., Kammer, F., Kunz, J., Pellekoorne, T., Siepermann, M., & Wölfer, J. (2023). ItsSQL: Intelligent Tutoring System for SQL ItsSQL: Intelligent Tutoring System for SQL Working Paper. https://doi.org/10.48550/arXiv.2311.10730

Mustafa, M. Y., Tlili, A., Lampropoulos, G., Huang, R., Jandrić, P., Zhao, J., Salha, S., Xu, L., Panda, S., Kinshuk, López-Pernas, S., & Saqr, M. (2024a). A systematic review of literature reviews on artificial intelligence in education (AIED): a roadmap to a future research agenda. Smart Learning Environments, 11(1), 59. https://doi.org/10.1186/s40561-024-00350-5

Mustafa, M. Y., Tlili, A., Lampropoulos, G., Huang, R., Jandrić, P., Zhao, J., Salha, S., Xu, L., Panda, S., Kinshuk, López-Pernas, S., & Saqr, M. (2024b). A systematic review of literature reviews on artificial intelligence in education (AIED): a roadmap to a future research agenda. Smart Learning Environments, 11(1), 59. https://doi.org/10.1186/s40561-024-00350-5

Nathaniel, J., Oyelere, S. S., Suhonen, J., & Tedre, M. (2025). Investigating the impact of generative AI integration on the sustenance of higher-order thinking skills and understanding of programming logic. Computers and Education: Artificial Intelligence, 9, 100460. https://doi.org/10.1016/j.caeai.2025.100460

Ortega-Morla, J., Leis, A., Mallo, A., Morán-Fernández, L., Guerreiro, S., Paz-López, A., Pérez-Sánchez, B., Sánchez-Maroño, N., Rodríguez-Arias, A., Fontenla-Romero, O., & Bellas, F. (2025). ProgTutor: A Robotic-Based Framework to Support Teaching and Learning of Programming Fundamentals. IEEE Transactions on Learning Technologies, 1–15. https://doi.org/10.1109/TLT.2025.3598041

Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., ... Alonso-Fernández, S. (2021). Declaración PRISMA 2020: Una guía actualizada para la publicación de revisiones sistemáticas. Revista Española de Cardiología, 74(9), 790–799. https://doi.org/10.1016/j.recesp.2021.06.016

Pereira, A. F., & Ferreira Mello, R. (2025). A Systematic Literature Review on Large Language Models Applications in Computer Programming Teaching Evaluation Process. IEEE Access, 13, 113449–113460. https://doi.org/10.1109/ACCESS.2025.3584060

Phung, T., Pădurean, V.-A., Cambronero, J., Gulwani, S., Kohn, T., Majumdar, R., Singla, A., & Soares, G. (2023). Generative AI for Programming Education: Benchmarking ChatGPT, GPT-4, and Human Tutors. http://arxiv.org/abs/2306.17156

Sajja, R., Sermet, Y., & Demir, I. (2025). End-to-End Deployment of the Educational AI Hub for Personalized Learning and Engagement: A Case Study on Environmental Science Education. IEEE Access, 13, 55169–55186. https://doi.org/10.1109/ACCESS.2025.3554222

Tlili, A. (2024). ¿Puede ayudar la inteligencia artificial (IA) en la educación en ciencias de la computación? Un enfoque metaanalítico. Revista Española de Pedagogía, 82(289), 469–490. https://doi.org/10.22550/2174-0909.4172

Topham, L., Atherton, P., Reynolds, T., Hussain, Y., Hussain, A., Kolivand, H., & Khan, W. (2026). Artificial Intelligence in Educational Technology: A Systematic Review of Datasets and Applications. ACM Computing Surveys, 58(3), 1–28. https://doi.org/10.1145/3768312

Troussas, C., Krouska, A., Mylonas, P., Sgouropoulou, C., & Voyiatzis, I. (2025). Fuzzy Memory Networks and Contextual Schemas: Enhancing ChatGPT Responses in a Personalized Educational System. Computers, 14(3), 89. https://doi.org/10.3390/computers14030089

Villegas-Ch, W., Buenano-Fernandez, D., Navarro, A. M., & Mera-Navarrete, A. (2025). Adaptive intelligent tutoring systems for STEM education: analysis of the learning impact and effectiveness of personalized feedback. Smart Learning Environments, 12(1), 41. https://doi.org/10.1186/s40561-025-00389-y

Wang, S., Wang, F., Zhu, Z., Wang, J., Tran, T., & Du, Z. (2024). Artificial intelligence in education: A systematic literature review. Expert Systems with Applications, 252, 124167. https://doi.org/10.1016/j.eswa.2024.124167

Wu, Z., & Wan, S. (2025). A Knowledge-Driven Approach to AI-Based Personalized Test Paper Creation in Programming Education. International Journal of Knowledge Management, 21(1), 1–21. https://doi.org/10.4018/IJKM.369825

Yang, A. C. M., Lin, J.-Y., Lin, C.-Y., & Ogata, H. (2024). Enhancing python learning with PyTutor: Efficacy of a ChatGPT-Based intelligent tutoring system in programming education. Computers and Education: Artificial Intelligence, 7, 100309. https://doi.org/10.1016/j.caeai.2024.100309

Yang, J., Shi, G., Zhu, W., & Sun, Y. (2025). Intelligent technologies in smart education: a comprehensive review of transformative pillars and their impact on teaching and learning methods. Humanities and Social Sciences Communications, 12(1), 1239. https://doi.org/10.1057/s41599-025-05444-0

Ye, X., Zhang, W., Zhou, Y., Li, X., & Zhou, Q. (2025). Improving students’ programming performance: an integrated mind mapping and generative AI chatbot learning approach. Humanities and Social Sciences Communications, 12(1), 558. https://doi.org/10.1057/s41599-025-04846-4

Zastudil, C., Rogalska, M., Kapp, C., Vaughn, J., & MacNeil, S. (2023). Generative AI in Computing Education: Perspectives of Students and Instructors. http://arxiv.org/abs/2308.04309

Zawacki-Richter, O., Müskens, W., & Marín, V. I. (2022). Quality Assurance of Open Educational Resources. In Handbook of Open, Distance and Digital Education (pp. 1–19). Springer Singapore. https://doi.org/10.1007/978-981-19-0351-9_43-1

Zizoune, A., Dakki, M., Zizoune, A., Hajhouj, S. E. El, Salaheddine, K., & Ziti, S. (2025). Smart Education and Intelligent Learning Systems (pp. 29–36). https://doi.org/10.1007/978-3-031-74470-9_4

Published

2026-06-04

Issue

Section

Regular Papers