Design and Evaluation of AI-Enhanced Multimedia Learning Systems: Usability, Accessibility, and Engagement in Broadband-Based Online Education
Article Sidebar
Artificial Intelligence,
Engagement,
Multimedia Learning,
Usability
Main Article Content
Ikna Awaliyani
Dita Septasari
Nur Aminudin
Septika Ariyanti
Abstract
Background: Artificial intelligence (AI) has increasingly been integrated into multimedia learning environments to support personalization, accessibility, and learner engagement in broadband-based online education. However, many existing systems still evaluate these dimensions separately, which limits their overall effectiveness and scalability.
Aims: This study aims to design and empirically evaluate an AI-enhanced multimedia learning system using a unified evaluation framework that integrates system performance, usability, accessibility, and learner engagement within broadband-based higher education contexts.
Methods: An explanatory sequential mixed-methods design was employed, involving quantitative analysis with 150 students and qualitative exploration with 12 participants. Data were collected through system performance logs, System Usability Scale (SUS) assessments, WCAG 2.1–based accessibility evaluations, and learner engagement metrics.
Results: The findings indicate that AI-driven adaptivity improves system responsiveness, achieves high usability, supports digital accessibility, and enhances learner engagement in broadband-based learning environments. The results demonstrate the effectiveness of the system across technical, experiential, and behavioral dimensions.
Conclusion: The key contribution of this study lies in proposing and validating an integrated evaluation framework that holistically captures the performance and user experience of AI-enhanced multimedia learning systems, an area that has been underexplored in prior research. These findings provide important theoretical and practical implications for the design of inclusive, adaptive, and user-centered online learning platforms.
Downloads
Article Details
Copyright (c) 2026 Ikna Awaliyani, Dita Septasari, Nur Aminudin, Septika Ariyanti
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
References
Akram, Z. (2025). AI for Inclusive Education: Comparative Insights and a Framework for Neurodiverse Learning. International Journal of Creative Multimedia, 6(2), 266–286. https://doi.org/10.33093/ijcm.2025.6.2.15
Alqahtani, A. Y., & Rajkhan, A. A. (2020). E-Learning Critical Success Factors during the COVID-19 Pandemic: A Comprehensive Analysis of E-Learning Managerial Perspectives. In Education Sciences (Vol. 10, Issue 9, p. 216). https://doi.org/10.3390/educsci10090216
Beaunoyer, E., Dupéré, S., & Guitton, M. J. (2020). COVID-19 and digital inequalities: Reciprocal impacts and mitigation strategies. Computers in Human Behavior, 111, 106424. https://doi.org/10.1016/j.chb.2020.106424
Bond, M., Khosravi, H., Laat, M. de, Bergdahl, N., Negrea, V., Oxley, E., Pham, P., Chong, S. W., & Siemens, G. (2024). A meta systematic review of artificial intelligence in higher education: a call for increased ethics, collaboration, and rigour. International Journal of Educational Technology in Higher Education, 21(1). https://doi.org/10.1186/s41239-023-00436-z
Chen, K., & Tian, G. (2023). A Study of the Use of Multimedia in AI Industry in Terms of its Impact on In-Service Education and Work Attitude as Well as Work Performance. International Journal of Emerging Technologies in Learning (IJET), 18(19), 103–113. https://doi.org/10.3991/ijet.v18i19.43921
Cinquin, P.-A., Guitton, P., & Sauzeon, H. (2021). Toward truly accessible MOOCs for persons with cognitive impairments: a field study. Human-Computer Interaction, 38, 352–373. https://doi.org/10.1080/07370024.2021.2008250
Daoudi, I. (2022). Learning analytics for enhancing the usability of serious games in formal education: A systematic literature review and research agenda. Education and Information Technologies, 27(8), 11237–11266. https://doi.org/10.1007/s10639-022-11087-4
Fernández-Morante, C., Cebreiro-López, B., Rodríguez-Malmierca, M.-J., & Casal-Otero, L. (2022). Adaptive Learning Supported by Learning Analytics for Student Teachers’ Personalized Training during in-School Practices. In Sustainability (Vol. 14, Issue 1, p. 124). https://doi.org/10.3390/su14010124
Gašević, D., Kovanović, V., & Joksimović, S. (2017). Piecing the learning analytics puzzle: a consolidated model of a field of research and practice. Learning: Research and Practice, 3(1), 63–78. https://doi.org/10.1080/23735082.2017.1286142
Gherheș, V., Stoian, C. E., Fărcașiu, M. A., & Stanici, M. (2021). E-Learning vs. Face-To-Face Learning: Analyzing Students’ Preferences and Behaviors. In Sustainability (Vol. 13, Issue 8, p. 4381). https://doi.org/10.3390/su13084381
Gupta, R. K., & Gadikar, A. (2024). Evaluating and Enhancing User Interaction in AI-Driven Educational Tools : A Comparative Study of Machine Learning Algorithms and Design Principles. Computer Science, Engineering and Technology, 2(September), 20–30. https://doi.org/10.46632/cset/2/3/3
Holmes, W., Porayska-Pomsta, K., Holstein, K., Sutherland, E., Baker, T., Shum, S. B., Santos, O. C., Rodrigo, M. T., Cukurova, M., Bittencourt, I. I., & Koedinger, K. R. (2022). Ethics of AI in Education: Towards a Community-Wide Framework. International Journal of Artificial Intelligence in Education, 32(3), 504–526. https://doi.org/10.1007/s40593-021-00239-1
Humble, N., & Mozelius, P. (2022). The threat, hype, and promise of artificial intelligence in education. Discover Artificial Intelligence, 2(1). https://doi.org/10.1007/s44163-022-00039-z
Ifenthaler, D., & Yau, J. Y.-K. (2020). Utilising learning analytics to support study success in higher education: a systematic review. Educational Technology Research and Development, 68(4), 1961–1990. https://doi.org/10.1007/s11423-020-09788-z
Imran, M., Almusharraf, N., Abdellatif, M. S., & Abbasova, M. Y. (2024). Artificial Intelligence in Higher Education: Enhancing Learning Systems and Transforming Educational Paradigms. International Journal of Interactive Mobile Technologies (IJIM), 18(18 SE-Papers), 34–48. https://doi.org/10.3991/ijim.v18i18.49143
Jin, S.-H., Im, K., Yoo, M., Roll, I., & Seo, K. (2023). Supporting students’ self-regulated learning in online learning using artificial intelligence applications. International Journal of Educational Technology in Higher Education, 20(1). https://doi.org/10.1186/s41239-023-00406-5
Joseph, O. B., & Uzondu, N. C. (2024). Integrating AI and Machine Learning in STEM education: Challenges and opportunities. Computer Science & IT Research Journal, 5(8), 1732–1750. https://doi.org/10.51594/csitrj.v5i8.1379
Knezek, G., Christensen, R., Smits, A., Tondeur, J., & Voogt, J. (2023). Strategies for developing digital competencies in teachers: Towards a multidimensional Synthesis of Qualitative Data (SQD) survey instrument. Computers & Education, 193, 104674. https://doi.org/10.1016/j.compedu.2022.104674
Lim, L., Bannert, M., van der Graaf, J., Singh, S., Fan, Y., Surendrannair, S., Rakovic, M., Molenaar, I., Moore, J., & Gašević, D. (2023). Effects of real-time analytics-based personalized scaffolds on students’ self-regulated learning. Computers in Human Behavior, 139, 107547. https://doi.org/10.1016/j.chb.2022.107547
Limpinan, P., Yindeemak, A., Pasmala, R., Nammanee, M., & Jantakoon, T. (2025). A Bibliometric Analysis of Artificial Intelligence for Multimedia in Education by Dimensions AI. Higher Education Studies, 15(2), 1–22. https://doi.org/10.5539/hes.v15n2p1
Luan, H., Géczy, P., Lai, H., Gobert, J. D., Yang, S. J. H., Ogata, H., Baltes, J., Guerra, R. da S., Li, P., & Tsai, C. (2020). Challenges and Future Directions of Big Data and Artificial Intelligence in Education. Frontiers in Psychology, 11. https://doi.org/10.3389/fpsyg.2020.580820
Luckin, R., & Cukurova, M. (2019). Designing educational technologies in the age of AI: A learning sciences-driven approach. British Journal of Educational Technology, 50(6), 2824–2838. https://doi.org/10.1111/bjet.12861
Mahafdah, R., Bouallegue, S., & Bouallègue, R. (2024). Enhancing e-learning through AI: advanced techniques for optimizing student performance. PeerJ Computer Science, 10. https://doi.org/10.7717/peerj-cs.2576
Mayer, R. E. (2014). Cognitive Theory of Multimedia Learning. In R. E. Mayer (Ed.), The Cambridge Handbook of Multimedia Learning (2nd ed., pp. 43–71). Cambridge University Press. https://doi.org/10.1017/CBO9781139547369.005
Mayer, R. E. (2017). Using multimedia for e-learning. Journal of Computer Assisted Learning, 33(5), 403–423. https://doi.org/10.1111/jcal.12197
Mayer, R. E., & Fiorella, L. (2021). Principles for Managing Essential Processing in Multimedia Learning: Segmenting, Pre-training, and Modality Principles*. In R. E. Mayer & L. Fiorella (Eds.), The Cambridge Handbook of Multimedia Learning (3rd ed., pp. 243–260). Cambridge University Press. https://doi.org/10.1017/9781108894333.025
Msambwa, M. M., Wen, Z., & Daniel, K. (2025). The Impact of AI on the Personal and Collaborative Learning Environments in Higher Education. European Journal of Education, 60(1), e12909. https://doi.org/10.1111/ejed.12909
Nguyen, A., Ngo, H. N., Hong, Y., Dang, B., & Nguyen, B. T. (2022). Ethical principles for artificial intelligence in education. Education and Information Technologies, 28(4), 4221–4241. https://doi.org/10.1007/s10639-022-11316-w
Nouraey, P., & Al‐Badi, A. H. (2023). Challenges and Problems of e-Learning: A Conceptual Framework. The Electronic Journal of E-Learning, 21(3), 188–199. https://doi.org/10.34190/ejel.21.3.2677
Owoc, M. L., Sawicka, A., & Weichbroth, P. (2021). Artificial Intelligence Technologies in Education: Benefits, Challenges and Strategies of Implementation. In IFIP advances in information and communication technology (pp. 37–58). Springer Science+Business Media. https://doi.org/10.1007/978-3-030-85001-2_4
Peng, J., & Li, Y. (2025). Frontiers of Artificial Intelligence for Personalized Learning in Higher Education: A Systematic Review of Leading Articles. In Applied Sciences (Vol. 15, Issue 18, p. 10096). https://doi.org/10.3390/app151810096
Putra, R. P., & Ramadhani, S. (2025). Comprehensive bibliometric analysis of artificial intelligence and E- Learning research trends ( 2014 – 2024 ). Edelweiss Applied Science and Technology, 9(5), 1788–1803. https://doi.org/10.55214/25768484.v9i5.7288
Ramadan, M. J., & Habeeb, I. Q. (2023). A systematic review in recent trends of e-learning usability evaluation techniques. AIP Conference Proceedings, 2591(1), 40032. https://doi.org/10.1063/5.0121800
Talib, E. A. H., Santosa, P. I., & Wibirama, S. (2023). Evaluation of Learning Management Systems Based on Usability and User Experience: A Systematic Literature Review. 2023 International Seminar on Intelligent Technology and Its Applications (ISITIA), 691–696. https://doi.org/10.1109/ISITIA59021.2023.10221015
Tang, K. H. D. (2024). Implications of Artificial Intelligence for Teaching and Learning. Acta Pedagogia Asiana, 3(2), 65–79. https://doi.org/10.53623/apga.v3i2.404
Wang, S., Wang, F., Zhu, Z., Wang, J., Tran, T., & Du, Z. (2024). Artificial intelligence in education: A systematic literature review. Expert Systems with Applications, 252, 124167. https://doi.org/10.1016/j.eswa.2024.124167
Wilson, A., Watson, C., Thompson, T. L., Drew, V., & Doyle, S. (2017). Learning analytics: challenges and limitations. Teaching in Higher Education, 22(8), 991–1007. https://doi.org/10.1080/13562517.2017.1332026
Xin, Z., Bebell, D., & Cleveland, G. (2024). Examining the Relationship between Broadband Access, Parent Technology Beliefs, and Student Academic Outcomes. In Education Sciences (Vol. 14, Issue 10, p. 1057). https://doi.org/10.3390/educsci14101057
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education – where are the educators? International Journal of Educational Technology in Higher Education, 16(1), 39. https://doi.org/10.1186/s41239-019-0171-0