Computerized Dynamic Assessment and Its Effects on Second Language Production: A Meta-Analytic Perspective
pdf
html

Keywords

computerized dynamic assessment; second language production; L2 writing; L2 speaking; meta-analysis

How to Cite

Shi, H., & Ma, X. (2026). Computerized Dynamic Assessment and Its Effects on Second Language Production: A Meta-Analytic Perspective. International Journal of Language Learning and Teaching Research, 1(1). https://doi.org/10.65553/IJLLTR.260105

Abstract

A substantial body of research in the field of second language acquisition has demonstrated that computerized dynamic assessment (C-DA) has positive effects on learners’ second language (L2) proficiency. However, a comprehensive research synthesis concerning the overall effects of C-DA on L2 production remains limited. To address this gap, the present study employs meta-analytic methods and incorporates data from L2 studies with 889 participants to quantify its effects on L2 production. The main findings are as follows: (1) C-DA enhances learners’ writing and speaking abilities, with a particularly significant positive effect on oral production; (2) C-DA has more pronounced effects on the fluency and accuracy of both written and oral output; and (3) although intervention duration, learners’ L2 proficiency, and educational level do not significantly moderate the overall effects, all subgroups show certain positive intervention effects, with more pronounced effects observed for short-term interventions, intermediate-to-upper-intermediate learners, and university learners. Drawing on the synthesis of empirical research results, this study intends to enrich the understanding of C-DA and L2 acquisition, eventually offering implications for L2 writing and speaking instruction.

pdf
html

References

Babamoradi, P., Nasiri, M., & Mohammadi, E. (2018). Learners’ attitudes toward using dynamic assessment in teaching and assessing IELTS Writing Task 1. International Journal of Language Testing, 8(1), 1–11.

Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010). A basic introduction to fixed-effect and random-effects models for meta-analysis. Research Synthesis Methods, 1(2), 97–111. https://doi.org/10.1002/jrsm.12

Cai, J. (2012). The application of meta-analysis in second language research. Foreign Language Teaching and Research, 44(1), 105–115, 159–160.

Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum Associates.

Council of Europe. (2020). Common European framework of reference for languages: Learning, teaching, assessment – Companion volume. https://rm.coe.int/common-european-framework-of-reference-for-languages-learning-teaching/16809ea0d4

Ebadi, S. & S. Vakili. (2019). Exploring EFL learners’ developmental errors in academic writing through face-to-face and computer-mediated dynamic assessment. Computer Assisted Language Learning, 35(4). https://doi.org/10.1080/09588221.2019.1698616

Estrada-Araoz, E.G., Sayed, B.T., Niyazova, G.G., & Lami, D. (2023). Comparing the effects of computerized formative assessment vs. computerized dynamic assessment on developing EFL learners’ reading motivation, reading self-concept, autonomy, and self-regulation. Language Testing in Asia, 13, 39. https://doi.org/10.1186/s40468-023-00253-1

Feng, S., & Zou, J. (2026). Group homogeneity enhances dynamic assessment efficacy in L2 English genitive learning: Preliminary evidence from integrating computerized and group DA. Language Testing in Asia, 16, Article 27. https://doi.org/10.1186/s40468-026-00447-3

Feuerstein, R., Rand, Y., & Rynders, J. E. (1988). Don’t accept me as I am: Helping “retarded” people to excel. Plenum Press.

Geng, X., Meng, Y. R., & Du, W. B. (2022). Jisuanji dongtai pinggu de eryu fazhan shanbian he yanjiu kuangjia [Research on computerized L2 dynamic assessment: Development and framework]. Xiandai Waiyu [Modern Foreign Languages], 45(1), 126–136.

Ghahderijani, B. H., Namaziandost, E., Tavakoli, M., Kumar, T., & Magizov, R. (2021). The comparative effect of group dynamic assessment (GDA) and computerized dynamic assessment (C-DA) on Iranian upper-intermediate EFL learners’ speaking complexity, accuracy, and fluency (CAF). Language Testing in Asia, 11, Article 25. https://doi.org/10.1186/s40468-021-00144-3

Guthke, J., & Beckmann, J. F. (2000). The learning test concept and its applications in practice. In C. S. Lidz & J. G. Elliott (Eds.), Dynamic assessment: Prevailing models and applications (pp. 17–69). Elsevier Science.

Imsa-ard, P., & Barrot, J. S. (2026). Combining multimodal technology-mediated and peer feedback: Effects on second language (L2) learners’ complexity, accuracy, and fluency (CAF) in writing. Computer Assisted Language Learning, 39(4), 1023–1061. https://doi.org/10.1080/09588221.2024.2443770

Jiang, Z. (2026). Scaffolding early-stage simultaneous interpreting learning using computerized dynamic assessment. Language Learning & Technology, 30(1), 1–25. https://doi.org/10.64152/10125/73701

Lantolf, J. P., & Poehner, M. E. (2004). Dynamic assessment of L2 development: Bringing the past into the future. Journal of Applied Linguistics, 1(1), 49–72. https://doi.org/10.1558/japl.1.1.49.55872

Li, Y. (2015). A comparative study of feedback modes in English writing based on dynamic assessment theory. Foreign Language World, (3), 59–67.

Li, Y., Li, Q., Huang, Y., et al. (2020). Embedding information technology in dynamic assessment in the college English speaking classroom. The Chinese Journal of ICT in Education, (12), 93–96.

Li, O., & Mizumoto, A. (2026). Measuring autonomous and efficacious GenAI use and GenAI reliance in EFL learning: Initial scale development and validation. Applied Language Sciences, 2(1). https://doi.org/10.65553/ALS.260110

Lu, Q., Chen, M., Yang, L., Li, S., & Chen, Y. (2026). The effectiveness of computerized dynamic assessment in improving L2 performance: A three-level meta-analysis. ReCALL. Advance online publication. https://doi.org/10.1017/S0958344026100561

Lu, X., & Pan, L. (2026). Tailoring written feedback to fit: The role of cognitive learning styles in improving EFL writing with feedback. Applied Language Sciences, 2(1). https://doi.org/10.65553/ALS.260112

Mardian, F., & Nafissi, Z. (2022). Synchronous computer-mediated corrective feedback and EFL learners’ grammatical knowledge development: A sociocultural perspective. Iranian Journal of Language Teaching Research, 10(2), 115–136.

Meng, Y., Fu, H., & Wang, C. (2024). The effectiveness of computerized listening dynamic assessment: Attribute-based mediation model. Language Learning & Technology, 28(1), 1–28. https://doi.org/10.64152/10125/73580

Nicholas, A., Blake, J., Perkins, J., & Mozgovoy, M. (2026). Evaluating the effectiveness of a computerised dynamic assessment of L2 English email requests. Computer Assisted Language Learning, 39(1–2), 303–335. https://doi.org/10.1080/09588221.2024.2374775

Norris, J. M., & Ortega, L. (2009). Towards an organic approach to investigating CAF in instructed SLA: The case of complexity. Applied Linguistics, 30(4), 555–578. https://doi.org/10.1093/applin/amp044

Paas, F., Renkl, A., & Sweller, J. (2003). Cognitive load theory and instructional design: Recent developments. Educational Psychologist, 38(1), 1–4. https://doi.org/10.1207/S15326985EP3801_1

Pileh Roud, L. F., & Hidri, S. (2021). Toward a sociocultural approach to computerized dynamic assessment of the TOEFL iBT listening comprehension test. Education and Information Technologies, 26(4), 4943–4968. https://doi.org/10.1007/s10639-021-10498-z

Plonsky, L., & Oswald, F. L. (2015). Meta-analyzing second language research. In L. Plonsky (Ed.), Advancing quantitative methods in second language research (pp. 106–128). Routledge. https://doi.org/10.4324/9781315870908-6

Poehner, M. E., & Lantolf, J. P. (2013). Bringing the ZPD into the equation: Capturing L2 development during computerized dynamic assessment (C-DA). Language Teaching Research, 17(3), 323–342. https://doi.org/10.1177/1362168813482935

Qian, X., Meng, Y., & Yue, Z. (2023). Effects of dynamic-assessment-informed blended instruction on the development of academic English paraphrasing ability. Foreign Language Education, 44(2), 63–68. https://doi.org/10.16362/j.cnki.cn61-1023/h.2023.02.014

Qin, T., & van Compernolle, R. A. (2021). Computerized dynamic assessment of implicature comprehension in L2 Chinese. Language Learning & Technology, 25(2), 55–74. https://doi.org/10.64152/10125/73433

Ren, K. (2019). Effects of using Juku Pigai in senior high school English writing instruction [Master’s thesis, Tianjin University].

Shen, J., Hou, Z., & Min, S. (2026). Exploring the use of chatbots in EFL argumentative writing: From the perspective of dynamic assessment. International Journal of Applied Linguistics, 36(1), 725–736. https://doi.org/10.1111/ijal.12809

Shen, Y., Zhang, L. J., & Zhou, L. (2019). A meta-analysis of empirical research on the effects of L2 listening strategy instruction. Foreign Languages in China, 16(6), 57–66. https://doi.org/10.13564/j.cnki.issn.1672-9382.2019.06.009

Shen, Y., & Zhang, L. J. (2020). Recent advances in meta-analysis in second language research in China and abroad, 2010–2019. Foreign Language World, (3), 70–79.

Shen, Y., Zhang, L. J., & Sun, Q. (2025). The effects of task complexity on L2 written production: A meta-analysis. Modern Foreign Languages, 48(1), 77–89. https://doi.org/10.20071/j.cnki.xdwy.20241030.006

Sherkuziyeva, N., Gabidullina, F. I., Ahmed Abdel-Al Ibrahim, K., & Bayat, S. (2023). The comparative effect of computerized dynamic assessment and rater-mediated assessment on EFL learners’ oral proficiency, writing performance, and test anxiety. Language Testing in Asia, 13, Article 15. https://doi.org/10.1186/s40468-023-00227-3

Sternberg, R. J., & Grigorenko, E. L. (2002). Dynamic testing: The nature and measurement of learning potential. Cambridge University Press.

Tai, Z., & Wang, S. (2022). A review and prospects of dynamic assessment research abroad. Journal of Tianjin Foreign Studies University, 29(1), 84–95, 113.

Teng, M. F. (2026). Metacognition in using GenAI for language teaching and learning. Emerging Educational Technologies, 1(1). https://doi.org/10.65553/EET.260101

Vakili, S., & Ebadi, S. (2022). Exploring EFL learners’ developmental errors in academic writing through face-to-face and computer-mediated dynamic assessment. Computer Assisted Language Learning, 35(3), 345–380. https://doi.org/10.1080/09588221.2019.1698616

Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes (M. Cole, V. John-Steiner, S. Scribner, & E. Souberman, Eds.). Harvard University Press.

Wang, Q., Gao, Y., & Wang, X. (2024). The relationships between burnout, job satisfaction, and emotion regulation among foreign language teachers: A meta-analytic review. Acta Psychologica, 250, Article 104545. https://doi.org/10.1016/j.actpsy.2024.104545

Wang, W. (2000). Implications of Vygotsky’s zone of proximal development theory for teaching reform in China. Psychological Exploration, (2), 17–20.

Xiao, Y. (2024). Effects of dynamic assessment on the English writing performance of English majors in a blended-learning context [Master’s thesis, Jiangxi Normal University].

Xu, X. (2022). Construction and empirical evaluation of a big-data-driven dynamic assessment model for college English writing. Journal of Jiangsu Vocational Institute of Commerce, (5), 80–83.

Xue, Q., & Pang, W. (2000). Advances in research on the writing process from the perspective of modern cognitive psychology. Psychological Science, (4), 458–461, 465.

Yang, Y., & Qian, D. D. (2020). Promoting L2 English learners’ reading proficiency through computerized dynamic assessment. Computer Assisted Language Learning, 33(5–6), 628–652. https://doi.org/10.1080/09588221.2019.1585882

Yu, H. (2020). Dynamic development of English oral fluency among Chinese learners: Interactions among complexity, accuracy, and fluency. Foreign Language World, (2), 81–89.

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Copyright (c) 2026 Han Shi, Xiaolei Ma (Author)

Views: 49Downloads: 34

Downloads

Download data is not yet available.
Creative Commons License All articles published in International Journal of Language Learning and Teaching Research are open access and distributed under the terms of the Creative Commons Attribution 4.0 International License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author(s) and source are properly credited. Copyright is retained by the author(s).