Keywords
How to Cite
Abstract
This study developed and examined initial validity evidence for a scale assessing autonomous and reliant use of generative artificial intelligence (GenAI) in English as a foreign language (EFL) learning. Participants were 416 students enrolled in required English courses at one Japanese university. The sample was randomly divided into an exploratory sample (n = 205) and an independent confirmatory sample (n = 211). Exploratory factor analysis of 10 initial items supported two factors: Autonomous and Efficacious GenAI Use (six items) and GenAI Reliance (three items). One of the ten items (REL4), which concerned worry about reliance, did not load meaningfully on either factor and was treated as an exploratory single item. The initial confirmatory factor analysis showed mixed fit. A post hoc model allowing a residual covariance between two autonomy items (AU1 and AU2) showed improved fit (robust CFI = .959, robust TLI = .940, robust RMSEA = .073, and SRMR = .060). Internal-consistency coefficients were .86 for Autonomous and Efficacious GenAI Use and .70 for GenAI Reliance, and the latent factor correlation was small and nonsignificant (r = .11, 95% CI [−.07, .30]). The heterotrait-monotrait ratio was .175, 95% CI [.132, .343]. These findings provide preliminary evidence that Autonomous and Efficacious GenAI Use and GenAI Reliance may represent distinct dimensions. Further validation with new, more diverse samples and external criteria is required.
References
Alamer, A., Sonbul, S., & El-Dakhs, D. A. S. (2025). Revisiting the validity of the vocabulary learning strategies questionnaire using the confirmatory composite analysis (CCA): Setting new directions for the field. International Journal of Applied Linguistics, 35(1), 193–217. https://doi.org/10.1111/ijal.12609
Alsumairi, A., & Madini, A. A. (2025). ChatGPT in EFL learning: Technology acceptance and learner autonomy among Saudi university students. International Journal of English Linguistics, 15(6), 73–85. https://doi.org/10.5539/ijel.v15n6p73
Anders, A. D., & Speltz, E. D. (2025). Developing generative AI literacies through self-regulated learning: A human-centered approach. Computers and Education: Artificial Intelligence, 9, Article 100482. https://doi.org/10.1016/j.caeai.2025.100482
Ayaz, M. A., Karataş, F., & Yüce, E. (2026). Development and validation of the AI-enhanced Self-Regulated Learning (AI-SRL) scale. RIED-Revista Iberoamericana de Educación a Distancia, 29(1), 185–216. https://doi.org/10.5944/ried.45452
Gerlich, M. (2025). AI tools in society: Impacts on cognitive offloading and the future of critical thinking. Societies, 15(1), Article 6. https://doi.org/10.3390/soc15010006
Goh, A. Y. H., Hartanto, A., & Majeed, N. M. (2025). Generative artificial intelligence dependency: Scale development, validation, and its motivational, behavioral, and psychological correlates. Computers in Human Behavior Reports, 20, Article 100845. https://doi.org/10.1016/j.chbr.2025.100845
Guan, L., Zhang, E. Y., & Gu, M. M. (2025). Examining generative AI–mediated informal digital learning of English practices with social cognitive theory: A mixed-methods study. ReCALL, 37(3), 315–331. https://doi.org/10.1017/S0958344024000259
Henseler, J., Ringle, C. M., & Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the Academy of Marketing Science, 43(1), 115–135. https://doi.org/10.1007/s11747-014-0403-8
Holec, H. (1981). Autonomy and foreign language learning. Pergamon Press.
Hong, S., & Shin, Y. K. (2025). Effects of three levels of AI integration on second language academic writing: Evaluating restricted, guided, and free use of ChatGPT. System, 134, Article 103820. https://doi.org/10.1016/j.system.2025.103820
Jose, B., Cherian, J., Verghis, A. M., Varghise, S. M., S, M., & Joseph, S. (2025). The cognitive paradox of AI in education: Between enhancement and erosion. Frontiers in Psychology, 16, Article 1550621. https://doi.org/10.3389/fpsyg.2025.1550621
Kartal, G., & Yeşilyurt, Y. E. (2024). A bibliometric analysis of artificial intelligence in L2 teaching and applied linguistics between 1995 and 2022. ReCALL, 36(3), 359–375. https://doi.org/10.1017/S0958344024000077
Khanh-Quynh, T. T., & Cong-Lem, N. (2026). The new writing partner? EFL students’ real-time use of GenAI tools in academic composing. Applied Language Sciences, 2, Article 260107. https://doi.org/10.65553/ALS.260107
Koç, F. Ş., & Savaş, P. (2025). The use of artificially intelligent chatbots in English language learning: A systematic meta-synthesis study of articles published between 2010 and 2024. ReCALL, 37(1), 4–21. https://doi.org/10.1017/S0958344024000168
Li, B., Lowell, V. L., Wang, C., & Li, X. (2024). A systematic review of the first year of publications on ChatGPT and language education: Examining research on ChatGPT’s use in language learning and teaching. Computers and Education: Artificial Intelligence, 7, Article 100266. https://doi.org/10.1016/j.caeai.2024.100266
Little, D. (1991). Learner autonomy 1: Definitions, issues and problems. Authentik.
Liu, X., Xiao, Y., & Li, D. (2025). Assessing strategic use of artificial intelligence in self-regulated learning: Instrument development and evidence from Chinese university students. International Journal of Educational Technology in Higher Education, 22(1), Article 69. https://doi.org/10.1186/s41239-025-00567-5
Liu, Y., Park, J., & McMinn, S. (2024). Using generative artificial intelligence/ChatGPT for academic communication: Students' perspectives. International Journal of Applied Linguistics, 34(3), 1437–1461. https://doi.org/10.1111/ijal.12574
Lyu, B., Lai, C., & Guo, K. (2025). Effectiveness of chatbots in improving language learning: A meta-analysis of comparative studies. International Journal of Applied Linguistics, 35(2), 834–851. https://doi.org/10.1111/ijal.12668
Ma, M. (2025). Exploring the acceptance of generative artificial intelligence for language learning among EFL postgraduate students: An extended TAM approach. International Journal of Applied Linguistics, 35(1), 91–108. https://doi.org/10.1111/ijal.12603
Maral, S., Naycı, N., Bilmez, H., Erdemir, E. İ., & Satici, S. A. (2026). Problematic ChatGPT Use Scale: AI-human collaboration or unraveling the dark side of ChatGPT. International Journal of Mental Health and Addiction, 24(3), 2369–2395. https://doi.org/10.1007/s11469-025-01509-y
Murase, F. (2015). Measuring language learner autonomy: Problems and possibilities. In C. J. Everhard & L. Murphy (Eds.), Assessment and autonomy in language learning (pp. 35–63). Palgrave Macmillan.
Nguyen, S. V., & Habók, A. (2021). Designing and validating the learner autonomy perception questionnaire. Heliyon, 7(4), Article e06831. https://doi.org/10.1016/j.heliyon.2021.e06831
Reinders, H., & White, C. (2016). 20 years of autonomy and technology: How far have we come and where to next? Language Learning & Technology, 20(2), 143–154. https://doi.org/10.64152/10125/44466
Takeuchi, O., & Mizumoto, A. (Eds.). (2023). Gaikokugo kyoiku kenkyu handobukku: Kenkyu shuho no yori yoi rikai no tame ni [Handbook of foreign language education research: For a better understanding of research methods] (Expanded ed.). Shohakusha.
Teng, F. (2019). Autonomy, agency, and identity in teaching and learning English as a foreign language. Springer.
Teng, M. F. (2025). Examining longitudinal development of writing motivation in the GenAI context: A self-determination theory perspective. Learning and Motivation, 91, 102157. Https://doi.org/10.1016/j.lmot.2025.102157
Teng, M. F. (2026). Metacognition in using GenAI for language teaching and learning. Emerging Educational Technologies, 1, 260101 https://doi.org/10.65553/EET.260101
Yan, D. (2024). Comparing individual vs. collaborative processing of ChatGPT-generated feedback: Effects on L2 writing task improvement and learning. Language Learning & Technology, 28(1), 1–19. https://doi.org/10.64152/10125/73597
Yang, L., & Li, R. (2024). ChatGPT for L2 learning: Current status and implications. System, 124, Article 103351. https://doi.org/10.1016/j.system.2024.103351
Zare, J., Al-Issa, A., & Ranjbaran Madiseh, F. (2025). Interacting with ChatGPT in essay writing: A study of L2 learners’ task motivation. ReCALL, 37(3), 385–402. https://doi.org/10.1017/S0958344025000035
Zou, M., Reinders, H., & Amjad, F. (2026). Understanding the potential role of GenAI-mediated informal digital learning of English (GenAI-IDLE) in the Global South: AI literacy, emotions, and willingness to communicate as outcomes. ReCALL, 38(1), 131–149. https://doi.org/10.1017/S0958344025100360
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright (c) 2026 Olga Li, Atsushi Mizumoto (Author)