Adaptive Literacy Assessment in Education

A Systematic Review of Computerised Testing Models

Authors

DOI:

https://doi.org/10.71291/ax99xt70

Keywords:

Computerised Adaptive Testing, Adaptive Literacy Assessment, Item Response Theory, Literacy Education, Artificial Intelligence, Educational Assessment

Abstract

This systematic review synthesises current evidence on adaptive testing models used in literacy assessment within educational frameworks. The review was motivated by the limitations of traditional fixed-form literacy assessments, which often fail to accommodate differences in learner ability levels and may yield inefficient, less accurate measurement outcomes. The study examined how Computerised Adaptive Testing (CAT) and related adaptive assessment technologies improve the precision, efficiency, personalisation, and scalability of literacy evaluation through psychometric frameworks such as Item Response Theory (IRT) and Artificial Intelligence (AI)-supported adaptive systems. A comprehensive literature search was conducted across five electronic databases: Google Scholar, ERIC, PsycINFO, JSTOR, and PubMed. The search yielded 120 studies, which were screened using predefined inclusion and exclusion criteria in accordance with the PRISMA guidelines. After title, abstract, and full-text screening, 10 eligible studies published between 2018 and 2025 were selected for analysis. Findings revealed that adaptive literacy assessment models significantly reduce testing time while improving measurement accuracy and learner engagement. The reviewed studies also highlighted the importance of robust item calibration, algorithm design, AI integration, and psychometric validity in enhancing adaptive assessment systems. Furthermore, evidence from both developed and developing countries demonstrated the feasibility of implementing adaptive literacy tools across diverse educational settings. Despite these advantages, challenges remain in infrastructure, ethical AI use, item bank development, and user experience. The review concludes that adaptive testing models have substantial potential to transform literacy assessment by supporting fairer, learner-centred, and data-driven evaluation practices. 

Author Biographies

  • Sukurat Olamide Oyedokun, University of Pretoria

    Ms. Oyedokun Sukurat Olamide

    PhD Student in Assessment & Quality Assurance (AQA)

    Bsc.(Ed) Economics Education (UNILORIN), MEd Educational  Research  Measurement and Evaluation (UNILORIN) 

    Department of Science, Mathematics and Technology Education (SMTE) 

    Natural Sciences Building, Room 4-3, Groenkloof Campus, University of Pretoria, South Africa

    Pronouns: she/her

  • Celeste Combrinck, University of Pretoria

    Prof Celeste Combrinck 
    Associate Professor in Assessment & Quality Assurance (AQA)

    BA Psych (RAU), BA Hons Psych (UJ), MA Research Psych (UP), PhD Psychology (UP)

    Department of Science, Mathematics and Technology Education (SMTE) 

    Natural Sciences Building, Room 4-3, Groenkloof Campus, University of Pretoria, South Africa

    Office: +27 12 420 5680

    Email response time: During work hours approximately 3 working days

    Pronouns: she/her

     

References

Adeoye, M. A., Prastikawati, E. F., & Riwayatiningsih, R. (2025). Beyond traditional testing: exploring the efficacy of adaptive assessments in shaping future learners. Journal of Nonformal Education, 11(1), 153–169. https://doi.org/10.15294/jone.v11i1.19934 DOI: https://doi.org/10.15294/jone.v11i1.19934

Ayanwale, M. A., & Ndlovu, M. (2022). Transition from computer-based testing of national benchmark tests to adaptive testing: Robust application of fourth industrial revolution tools. Cypriot Journal of Educational Sciences, 17(9), 3327–3343. https://doi.org/10.18844/cjes.v17i9.7124 DOI: https://doi.org/10.18844/cjes.v17i9.7124

Ayanwale, M. A., & Ndlovu, M. (2024). The feasibility of computerized adaptive testing of the national benchmark test: A simulation study. Journal of Pedagogical Research, 8(2), 95–112. https://doi.org/10.33902/JPR.202425210 DOI: https://doi.org/10.33902/JPR.202425210

Bulut, O. (2024). From Adaptive Testing to Personalized Adaptive Testing. Machine Learning, Natural Language Processing, and Psychometrics, 177. https://bit.ly/3UgiK2Y DOI: https://doi.org/10.1108/979-8-88730-606-320251010

Chauke, M., & Tabane, R. (2024). Educators’ adaptive assessment procedures in teaching English First Additional Language in Grade 6 inclusive classrooms in South Africa. South African Journal of Education, 44(3), 1–10. https://doi.org/10.15700/saje.v44n3a2461 DOI: https://doi.org/10.15700/saje.v44n3a2461

Dunaway, A. L. (2025). Teacher Perceived Impact of Teacher Interventions and Metacognition When Addressing Test Anxiety in Middle School Students: A Qualitative Case Study. Brenau University.https://search.proquest.com/openview/d17b3a4056d8804d48de959d9a328d1f/1?pq-origsite=gscholar&cbl=18750&diss=y

Gökçe, S., & Glas, C. A. W. (2018). Can TIMSS mathematics assessments be implemented as a computerized adaptive test. Journal of Measurement and Evaluation in Education and Psychology, 9(4), 422–436.https://dergipark.org.tr/en/download/article-file/610048 DOI: https://doi.org/10.21031/epod.487351

Huang, C., Tang, Z., Hu, S., Jiang, R., Zheng, X., Ge, D., … Wang, Z. (2025). Orlm: A customizable framework in training large models for automated optimization modeling. Operations Research, 73(6), 2986–3009.https://arxiv.org/pdf/2405.17743? DOI: https://doi.org/10.1287/opre.2024.1233

Jia, M., & Liu, J. (2026). Cognitive Diagnosis Computerized Adaptive Testing (CD-CAT) for Adolescent Internet Gaming Disorder: A Conceptual Assessment Framework. Behavioral Sciences, 16(4), 558. https://doi.org/10.3390/bs16040558.https://files.eric.ed.gov/fulltext/EJ1147523.pdf DOI: https://doi.org/10.3390/bs16040558

Kalender, I., & Berberoglu, G. (2017). Can Computerized Adaptive Testing Work in Students’ Admission to Higher Education Programs in Turkey?. Educational Sciences: Theory and Practice, 17(2), 573–596. https://files.eric.ed.gov/fulltext/EJ1147523.pdf

Liu, Z., Zhuang, Y., Liu, Q., Li, J., Zhang, Y., Huang, Z., … Wang, S. (2024). Computerized adaptive testing via collaborative ranking. Advances in Neural Information Processing Systems, 37, 95488–95514. https://doi.org/10.52202/079017-3026 DOI: https://doi.org/10.52202/079017-3026

Ma, W. A., Richie-Halford, A., Burkhardt, A. K., Kanopka, K., Chou, C., Domingue, B. W., & Yeatman, J. D. (2025). ROAR-CAT: Rapid Online Assessment of Reading ability with Computerized Adaptive Testing. Behavior Research Methods, 57(1), 1–17. https://link.springer.com/article/10.3758/s13428-024-02578-y DOI: https://doi.org/10.3758/s13428-024-02578-y

Minn, S., & Nkambou, R. (2025). Enhanced Interpretable Knowledge Tracing for Students’ Performance Prediction with Human-understandable Feature Space. International Conference on Artificial Intelligence in Education, 423–430. Springer. https://arxiv.org/pdf/2509.18231 DOI: https://doi.org/10.1007/978-3-031-98462-4_53

Mohammadi, M. (2024). Language teachers’ assessment literacy in AI-aided adaptive learning environments. Journal of Research in Applied Linguistics, 15(2), 73–88.https://doi.org/10.22055/rals.2024.46120.3235

Navarro, J. J., & Mourgues-Codern, C. V. (2018). Dynamic assessment and computerized adaptive tests in reading processes. Journal of Cognitive Education & Psychology, 17(1), 70. http://dx.doi.org/10.1891/1945-8959.17.1.70 DOI: https://doi.org/10.1891/1945-8959.17.1.70

Ntumi, S., Bulala, T., & Agbovor, D. (2025). Advanced Multidimensional Item Response Theory Modeling for High-Stakes Scores, Cross-Disciplinary Competency Assessments in Sub-Saharan Africa: A Psychometric Approach to Equity, Adaptivity, and Policy Integration.https://assets-eu.researchsquare.com/files/rs-6916695/v1/9529276d-7c82-40b4-a11d-6b1c93afe0b1.pdf DOI: https://doi.org/10.21203/rs.3.rs-6916695/v1

Oladele, J. I., Ndlovu, M., & Spangenberg, E. D. (2022a). Simulated computer adaptive testing method choices for ability estimation with empirical evidence. International Journal of Evaluation and Research in Education (IJERE), (3), 1392-1399. https://doi.org/10.11591/ijere.v11i3.21986 DOI: https://doi.org/10.11591/ijere.v11i3.21986

Oladele, J. I., Ndlovu, M., & Ayanwale, M. A. (2022b). Computer Adaptive-Based Learning and Assessment for Enhancing STEM Education in Africa: A Fourth Industrial Revolution Possibility. In B. Chirinda, K. Luneta, & A. Uworwabayeho (Eds.), Mathematics Education in Africa: The Fourth Industrial Revolution (pp. 131-144). Springer International Publishing. https://doi.org/10.1007/978-3-031-13927-7_8 DOI: https://doi.org/10.1007/978-3-031-13927-7_8

Padang, U. N. (2025). The Indonesian Journal of Computer Science (Conceptual Review). 13(6), 9056–9074. https://doi.org/https://doi.org/10.33022/ijcs.v13i6.4465 DOI: https://doi.org/10.33022/ijcs.v13i6.4465

Rice, N., Pêgo, J. M., Collares, C. F., Kisielewska, J., & Gale, T. (2022). The development and implementation of a computer adaptive progress test across European countries. Computers and Education: Artificial Intelligence, 3, 100083.https://doi.org/10.21203/rs.3.rs-6916695/v1 DOI: https://doi.org/10.1016/j.caeai.2022.100083

Wokoma, T.-O. A., & Opara, I. M. (2018). Prediction and Evaluation of Quality in Self-Designed Computerized Adaptive Test on ICT for Usability to Assessss2 Students in Rivers State, Nigeria.DOI: 10.9790/0837-2308103745 s

Yumus, M., Stuhr, C., Meindl, M., Leuschner, H., & Jungmann, T. (2025). EuleApp©: a computerized adaptive assessment tool for early literacy skills. Frontiers in Psychology, 16, 1522740.file:///C:/Users/ILIAS/Downloads/fpsyg-16-1522740%20(2).pdf DOI: https://doi.org/10.3389/fpsyg.2025.1522740

Downloads

Published

2025-12-25

Issue

Section

Computer Adaptive Testing Research

How to Cite

Oyedokun, S. O., & Combrinck, C. (2025). Adaptive Literacy Assessment in Education: A Systematic Review of Computerised Testing Models. Journal of Computer Adaptive Testing in Africa, 4, 74-92. https://doi.org/10.71291/ax99xt70