Usability Analysis of Learning Device Monitoring Systems: Evaluation of User Experience for the Effectiveness of Educational Digitalization
Keywords:
Usability, Monitoring System, Learning Tools, Educational Digitalization, User Experience
Abstract
This study aims to analyze the usability level of the learning tool monitoring system developed to support the digitalization of learning administration management in the educational environment. Usability is a crucial aspect in the successful implementation of the system, because it is directly related to the convenience, comfort, and effectiveness of use by teachers, supervisors, and education staff. This study uses a descriptive quantitative approach with evaluation instruments that refer to six usability characteristics, namely appropriateness recognizability, learnability, operability, user error protection, user interface aesthetics, and accessibility. Data was collected through the distribution of questionnaires to the respondents of the users of the system, and analyzed using descriptive statistics. The results of the analysis show that the system has an average usability value of 4.50 or 90.04%, which is classified as very good. The characteristics with the highest scores were accessibility (90.64%) and user interface aesthetics (90.42%), while the lowest scores were appropriateness recognizability (89.57%). These findings indicate that the system has met most of the users' expectations, especially in terms of the interface appearance, ease of access, and learning process of using the system. However, the aspects of function recognition and navigation still need to be slightly improved to be more optimal.
References
Alenezi, M., & Akour, M. (2023). Digital Transformation Blueprint in Higher Education: A Case Study of PSU. Sustainability, 15(10), 8204. https://doi.org/10.3390/su15108204
Alsyouf, A., Lutfi, A., Alsubahi, N., Alhazmi, F. N., Al‐Mugheed, K., Anshasi, R. J., Alharbi, N. I., & Albugami, M. A. (2023). The Use of a Technology Acceptance Model (TAM) to Predict Patients’ Usage of a Personal Health Record System: The Role of Security, Privacy, and Usability. International Journal of Environmental Research and Public Health, 20(2), 1347. https://doi.org/10.3390/ijerph20021347
Daramola, O., Oladipupo, O., Afolabi, I. T., & Olopade, A. (2017). Heuristic Evaluation of an Institutional E-learning System: A Nigerian Case. International Journal of Emerging Technologies in Learning (iJET), 12(3), 26. https://doi.org/10.3991/ijet.v12i03.6083
Ekuase-Anwansedo, A., Craig, S. F., & Noguera, J. (2021). How to Survive a Learning Management System (LMS) Implementation? A Stakeholder Analysis Approach. arXiv. https://doi.org/10.48550/ARXIV.2102.10521
Habrusiev, V., Tereshchuk, H. V., Tsidylo, I. M., Martyniuk, S., & Kulyanda, O. (2021). Monitoring the quality of e-learning implementation in educational institutions. SHS Web of Conferences, 107, 10003. https://doi.org/10.1051/shsconf/202110710003
Hernowo, A., Candraningrat, C., & Wardhanie, A. P. (2022). THE PERCEIVED USEFULNESS ANALYSIS AND USER SATISFACTION IN THE DEVELOPMENT OF LEARNING MANAGEMENT SYSTEM DESIGN. JEM17 Jurnal Ekonomi Manajemen, 7(2), 129. https://doi.org/10.30996/jem17.v7i2.7536
Issa, S. A. M. (2021). A proposed electronic tool for managing educational procedures, following-up teachers’ performance in the classroom, and measuring their attitudes. International Journal of ADVANCED AND APPLIED SCIENCES, 9(1), 55. https://doi.org/10.21833/ijaas.2022.01.008
Kešelj, A., Žubrinić, K., Miličević, M., & Kristić, M. (2025). Evaluation of Accessibility Parameters in Education Software That Supports Three-Dimensional Interactions. Applied Sciences, 15(10), 5258. https://doi.org/10.3390/app15105258
Kumar, P. S. (2023). Transformative Role of ICT in 21st Century Learning: Enhancing Educational Effectiveness and Equitability. International Journal for Research in Applied Science and Engineering Technology, 11(12), 91. https://doi.org/10.22214/ijraset.2023.57028
Limniou, M. (2021). The Effect of Digital Device Usage on Student Academic Performance: A Case Study. Education Sciences, 11(3), 121. https://doi.org/10.3390/educsci11030121
Marthasari, G. I., & Hayatin, N. (2021). Quantitative analysis in a heuristic evaluation of web-based encyclopedia for children. TELKOMNIKA (Telecommunication Computing Electronics and Control), 19(5), 1573. https://doi.org/10.12928/telkomnika.v19i5.20408
Menant, L., Gilibert, D., & Sauvezon, C. (2021). The Application of Acceptance Models to Human Resource Information Systems: A Literature Review [Review of The Application of Acceptance Models to Human Resource Information Systems: A Literature Review]. Frontiers in Psychology, 12. Frontiers Media. https://doi.org/10.3389/fpsyg.2021.659421
Mohd, N., & Murad, M. A. A. (2022). The Usability of Training Management System for Teachers’ Professional Development: A Preliminary Study. Malaysian Journal of Social Sciences and Humanities (MJSSH), 7(5). https://doi.org/10.47405/mjssh.v7i5.1503
Pensabe-Rodriguez, A., Domínguez, E. L., Hernández-Velázquez, Y., Domínguez-Isidro, S., & Calleja, J. de la. (2020). Context-aware mobile learning system: Usability assessment based on a field study. Telematics and Informatics, 48, 101346. https://doi.org/10.1016/j.tele.2020.101346
Pratiwi, S. N. (2023). Learning Management Based on Information and Communication Technology in Improving Student Learning Outcomes. Randwick International of Social Science Journal, 4(2), 464. https://doi.org/10.47175/rissj.v4i2.686
Santos, A. B. G., Balba, N. P., & Rebong, C. B. (2021). Attendance Monitoring System of Schools in the Philippines with an Inclusion of Optimization Query Algorithm. International Journal of Innovative Technology and Exploring Engineering, 10(8), 142. https://doi.org/10.35940/ijitee.h9149.0610821
Subiyantari, A. R., Setiawan, A. H., & Sumarni, S. (2021). The Application of Jigsaw Cooperative Learning Model through Lesson Study in the Grade X of State Vocational High School/SMK in Sukoharjo. Science Engineering Education and Development Studies (SEEDS) Conference Series, 4(1). https://doi.org/10.20961/seeds.v4i1.18076
Teng, Y., & Wang, X. (2021). The effect of two educational technology tools on student engagement in Chinese EFL courses. International Journal of Educational Technology in Higher Education, 18(1). https://doi.org/10.1186/s41239-021-00263-0
Walther, K., Fränkel, S., Hennemann, T., & Hövel, D. C. (2022). Challenges and opportunities of using a cooperative digital educational plan. Evaluation of the implementation. European Journal of Open Distance and E-Learning, 24(1), 73. https://doi.org/10.2478/eurodl-2022-0006
Zou, Y. L., Kuek, F., Feng, W. Z., & Cheng, X. (2025). Digital learning in the 21st century: trends, challenges, and innovations in technology integration. Frontiers in Education, 10. https://doi.org/10.3389/feduc.2025.1562391
Alsyouf, A., Lutfi, A., Alsubahi, N., Alhazmi, F. N., Al‐Mugheed, K., Anshasi, R. J., Alharbi, N. I., & Albugami, M. A. (2023). The Use of a Technology Acceptance Model (TAM) to Predict Patients’ Usage of a Personal Health Record System: The Role of Security, Privacy, and Usability. International Journal of Environmental Research and Public Health, 20(2), 1347. https://doi.org/10.3390/ijerph20021347
Daramola, O., Oladipupo, O., Afolabi, I. T., & Olopade, A. (2017). Heuristic Evaluation of an Institutional E-learning System: A Nigerian Case. International Journal of Emerging Technologies in Learning (iJET), 12(3), 26. https://doi.org/10.3991/ijet.v12i03.6083
Ekuase-Anwansedo, A., Craig, S. F., & Noguera, J. (2021). How to Survive a Learning Management System (LMS) Implementation? A Stakeholder Analysis Approach. arXiv. https://doi.org/10.48550/ARXIV.2102.10521
Habrusiev, V., Tereshchuk, H. V., Tsidylo, I. M., Martyniuk, S., & Kulyanda, O. (2021). Monitoring the quality of e-learning implementation in educational institutions. SHS Web of Conferences, 107, 10003. https://doi.org/10.1051/shsconf/202110710003
Hernowo, A., Candraningrat, C., & Wardhanie, A. P. (2022). THE PERCEIVED USEFULNESS ANALYSIS AND USER SATISFACTION IN THE DEVELOPMENT OF LEARNING MANAGEMENT SYSTEM DESIGN. JEM17 Jurnal Ekonomi Manajemen, 7(2), 129. https://doi.org/10.30996/jem17.v7i2.7536
Issa, S. A. M. (2021). A proposed electronic tool for managing educational procedures, following-up teachers’ performance in the classroom, and measuring their attitudes. International Journal of ADVANCED AND APPLIED SCIENCES, 9(1), 55. https://doi.org/10.21833/ijaas.2022.01.008
Kešelj, A., Žubrinić, K., Miličević, M., & Kristić, M. (2025). Evaluation of Accessibility Parameters in Education Software That Supports Three-Dimensional Interactions. Applied Sciences, 15(10), 5258. https://doi.org/10.3390/app15105258
Kumar, P. S. (2023). Transformative Role of ICT in 21st Century Learning: Enhancing Educational Effectiveness and Equitability. International Journal for Research in Applied Science and Engineering Technology, 11(12), 91. https://doi.org/10.22214/ijraset.2023.57028
Limniou, M. (2021). The Effect of Digital Device Usage on Student Academic Performance: A Case Study. Education Sciences, 11(3), 121. https://doi.org/10.3390/educsci11030121
Marthasari, G. I., & Hayatin, N. (2021). Quantitative analysis in a heuristic evaluation of web-based encyclopedia for children. TELKOMNIKA (Telecommunication Computing Electronics and Control), 19(5), 1573. https://doi.org/10.12928/telkomnika.v19i5.20408
Menant, L., Gilibert, D., & Sauvezon, C. (2021). The Application of Acceptance Models to Human Resource Information Systems: A Literature Review [Review of The Application of Acceptance Models to Human Resource Information Systems: A Literature Review]. Frontiers in Psychology, 12. Frontiers Media. https://doi.org/10.3389/fpsyg.2021.659421
Mohd, N., & Murad, M. A. A. (2022). The Usability of Training Management System for Teachers’ Professional Development: A Preliminary Study. Malaysian Journal of Social Sciences and Humanities (MJSSH), 7(5). https://doi.org/10.47405/mjssh.v7i5.1503
Pensabe-Rodriguez, A., Domínguez, E. L., Hernández-Velázquez, Y., Domínguez-Isidro, S., & Calleja, J. de la. (2020). Context-aware mobile learning system: Usability assessment based on a field study. Telematics and Informatics, 48, 101346. https://doi.org/10.1016/j.tele.2020.101346
Pratiwi, S. N. (2023). Learning Management Based on Information and Communication Technology in Improving Student Learning Outcomes. Randwick International of Social Science Journal, 4(2), 464. https://doi.org/10.47175/rissj.v4i2.686
Santos, A. B. G., Balba, N. P., & Rebong, C. B. (2021). Attendance Monitoring System of Schools in the Philippines with an Inclusion of Optimization Query Algorithm. International Journal of Innovative Technology and Exploring Engineering, 10(8), 142. https://doi.org/10.35940/ijitee.h9149.0610821
Subiyantari, A. R., Setiawan, A. H., & Sumarni, S. (2021). The Application of Jigsaw Cooperative Learning Model through Lesson Study in the Grade X of State Vocational High School/SMK in Sukoharjo. Science Engineering Education and Development Studies (SEEDS) Conference Series, 4(1). https://doi.org/10.20961/seeds.v4i1.18076
Teng, Y., & Wang, X. (2021). The effect of two educational technology tools on student engagement in Chinese EFL courses. International Journal of Educational Technology in Higher Education, 18(1). https://doi.org/10.1186/s41239-021-00263-0
Walther, K., Fränkel, S., Hennemann, T., & Hövel, D. C. (2022). Challenges and opportunities of using a cooperative digital educational plan. Evaluation of the implementation. European Journal of Open Distance and E-Learning, 24(1), 73. https://doi.org/10.2478/eurodl-2022-0006
Zou, Y. L., Kuek, F., Feng, W. Z., & Cheng, X. (2025). Digital learning in the 21st century: trends, challenges, and innovations in technology integration. Frontiers in Education, 10. https://doi.org/10.3389/feduc.2025.1562391
Published
2025-06-04
How to Cite
Nurdin, M., Yahya, M., & Nur, H. (2025). Usability Analysis of Learning Device Monitoring Systems: Evaluation of User Experience for the Effectiveness of Educational Digitalization . International Journal of Technology and Education Research, 3(02), 410-421. https://doi.org/10.63922/ijeter.v3i02.1887
.png)
Contact Person +6282139474255
Email : ijeterjournal@gmail.com
