Abstract
Vibe coding allows researchers and teachers to build software through natural language interaction with generative artificial intelligence. It could widen access to corpus analysis and support tools designed for specific learning contexts. However, easier software creation also transfers methodological choices into prompts, generates code and interface defaults. Crosthwaite and Özer (2026) have begun to specify how such development should be documented, most fully in vibecoding-as-method workflow. However, a documented process does not establish what a finished tool entitles its users to claim. This conceptual article examines that gap through a purposive interpretative synthesis of corpus linguistics, data-driven learning and current corpus-AI research. It argues that a functional tool provides insufficient evidence of a valid linguistic analysis or an effective learning activity and proposes three linked forms of validation: computational correctness, linguistic validity, and pedagogical validity. Each requires evidence appropriate to the claims being made. Each leaves a specific claim unsupported. The framework is illustrated through a published vibe-coded instrument, VetLingua, which shows where a carefully documented development process still leaves validation evidence to be gathered. The article also outlines a research agenda that compares complete workflows and tests independent learning beyond immediate task performance. Vibe coding could become a useful method in corpus research and education when institutions support transparent development, independent evaluation and continued maintenance.
References
Alqheedan, A., & Alzughaibi, S. (2026). The VIBE-HI framework: A conceptual model for evaluating vibe coding appropriateness, quality, and safety in health informatics. Frontiers in Artificial Intelligence, 9, Article 1882814. https://doi.org/10.3389/frai.2026.1882814
Anthony, L. (2025). Integrating AI technology into corpus-based language learning through ChatAI. Computer Assisted Language Learning. Advance online publication. https://doi.org/10.1080/09588221.2025.2589747
Baker, P., Gabrielatos, C., KhosraviNik, M., Krzyżanowski, M., McEnery, T., & Wodak, R. (2008). A useful methodological synergy? Combining critical discourse analysis and corpus linguistics to examine discourses of refugees and asylum seekers in the UK press. Discourse & Society, 19(3), 273–306. https://doi.org/10.1177/0957926508088962
Barrot, J. S. (2023). Using ChatGPT for second language writing: Pitfalls and potentials. Assessing Writing, 57, Article 100745. https://doi.org/10.1016/j.asw.2023.100745
Biber, D. (1993). Representativeness in corpus design. Literary and Linguistic Computing, 8(4), 243–257. https://doi.org/10.1093/llc/8.4.243
Biber, D., Conrad, S., & Cortes, V. (2004). If you look at …: Lexical bundles in university teaching and textbooks. Applied Linguistics, 25(3), 371–405. https://doi.org/10.1093/applin/25.3.371
Boulton, A. (2010). Data-driven learning: Taking the computer out of the equation. Language Learning, 60(3), 534–572. https://doi.org/10.1111/j.1467-9922.2010.00566.x
Boulton, A., & Cobb, T. (2017). Corpus use in language learning: A meta-analysis. Language Learning, 67(2), 348–393. https://doi.org/10.1111/lang.12224
Boulton, A., & Vyatkina, N. (2021). Thirty years of data-driven learning: Taking stock and charting new directions over time. Language Learning & Technology, 25(3), 66–89. https://doi.org/10.64152/10125/73450
Boulton, A., & Vyatkina, N. (2024). Expanding methodological approaches in DDL research. TESOL Quarterly, 58(3), 1193–1204. https://doi.org/10.1002/tesq.3269
Celik, I. (2023). Towards Intelligent-TPACK: An empirical study on teachers’ professional knowledge to ethically integrate artificial intelligence (AI)-based tools into education. Computers in Human Behavior, 138, Article 107468. https://doi.org/10.1016/j.chb.2022.107468
Chambers, A. (2019). Towards the corpus revolution? Bridging the research–practice gap. Language Teaching, 52(4), 460–475. https://doi.org/10.1017/S0261444819000089
Charles, M. (2024). Benefits and challenges of using do-it-yourself corpora for academic writing development. TESOL Quarterly, 58(3), 1205–1214. https://doi.org/10.1002/tesq.3276
Cheung, L., & Crosthwaite, P. (2025). CorpusChat: Integrating corpus linguistics and generative AI for academic writing development. Computer Assisted Language Learning. Advance online publication. https://doi.org/10.1080/09588221.2025.2506480
Crosthwaite, P. (2026). Is DDL dead yet? Not so fast! Revisiting earlier claims on the state of corpus linguistics, DDL, generative AI, and Language for Specific Purposes. Ibérica, 51, 5–19. https://doi.org/10.17398/2340-2784.51.5
Crosthwaite, P., & Baisa, V. (2023). Generative AI and the end of corpus-assisted data-driven learning? Not so fast! Applied Corpus Linguistics, 3(3), Article 100066. https://doi.org/10.1016/j.acorp.2023.100066
Crosthwaite, P., & Baisa, V. (2024). A user-friendly corpus tool for disciplinary data-driven learning: Introducing CorpusMate. International Journal of Corpus Linguistics, 29(4), 595–610. https://doi.org/10.1075/ijcl.23056.cro
Crosthwaite, P., & Özer, M. (2026). Vibecoding as method: A structured workflow for AI-assisted research instrument development in applied linguistics. Research Methods in Applied Linguistics, 5(3), Article 100356. https://doi.org/10.1016/j.rmal.2026.100356
Crosthwaite, P., Sun, S. A., & Jiang, F. K. (2026). Prompt sensitivity in AI writing: A methodological caution for corpus-based analysis of AI-generated language. The Modern Language Journal. Advance online publication. https://doi.org/10.1111/modl.70089
Curry, N., & McEnery, T. (2025). Corpus linguistics for language teaching and learning: A research agenda. Language Teaching, 58(2), 232–251. https://doi.org/10.1017/S0261444824000430
Dong, J., & Wang, H. (2025). Exploring the effectiveness of a DDL-GenAI teaching mode in students’ EFL writing classroom. Computer Assisted Language Learning. Advance online publication. https://doi.org/10.1080/09588221.2025.2577369
Elgendy, I. A., Dwivedi, Y. K., Al-Sharafi, M. A., Hosny, M., Helal, M. Y., Crick, T., & Al-Busaidi, A. S. (2026). Responsible vibe coding: Architecture, opportunities, and research agenda. Journal of Computer Information Systems. Advance online publication. https://doi.org/10.1080/08874417.2026.2621186
Frankenberg-Garcia, A. (2014). The use of corpus examples for language comprehension and production. ReCALL, 26(2), 128–146. https://doi.org/10.1017/S0958344014000093
Gries, S. T. (2008). Dispersions and adjusted frequencies in corpora. International Journal of Corpus Linguistics, 13(4), 403–437. https://doi.org/10.1075/ijcl.13.4.02gri
Han, Z. (2024). ChatGPT in and for second language acquisition: A call for systematic research. Studies in Second Language Acquisition, 46(2), 301–306. https://doi.org/10.1017/S0272263124000111
Handley, Z. (2024). Has artificial intelligence rendered language teaching obsolete? The Modern Language Journal, 108(2), 548–555. https://doi.org/10.1111/modl.12929
Kane, M. T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50(1), 1–73. https://doi.org/10.1111/jedm.12000
Karpathy, A. [@karpathy]. (2025, February 2). There’s a new kind of coding I call “vibe coding” [Post]. X. https://x.com/karpathy/status/1886192184808149383
Kern, R. (2021). Twenty-five years of digital literacies in CALL. Language Learning & Technology, 25(3), 132–150. https://doi.org/10.64152/10125/73453
Kern, R. (2024). Twenty-first century technologies and language education: Charting a path forward. The Modern Language Journal, 108(2), 515–533. https://doi.org/10.1111/modl.12924
Kilgarriff, A. (2005). Language is never, ever, ever, random. Corpus Linguistics and Linguistic Theory, 1(2), 263–276. https://doi.org/10.1515/cllt.2005.1.2.263
Kohnke, L., Moorhouse, B. L., & Zou, D. (2023). ChatGPT for language teaching and learning. RELC Journal, 54(2), 537–550. https://doi.org/10.1177/00336882231162868
Lu, X. (2010). Automatic analysis of syntactic complexity in second language writing. International Journal of Corpus Linguistics, 15(4), 474–496. https://doi.org/10.1075/ijcl.15.4.02lu
Lu, X. (2012). The relationship of lexical richness to the quality of ESL learners’ oral narratives. The Modern Language Journal, 96(2), 190–208. https://doi.org/10.1111/j.1540-4781.2011.01232.x
Ma, Q., Yan, J., Crosthwaite, P., & Lee, C.-K. J. (2026). TPACK for corpus technology: TESOL student teachers’ growth and self-efficacy in independent language learning and teaching. ReCALL, 38(1), 94–110. https://doi.org/10.1017/S0958344025100347
Ma, Q., Yuan, R. E., Cheung, L. M. E., & Yang, J. (2024). Teacher paths for developing corpus-based language pedagogy: A case study. Computer Assisted Language Learning, 37(3), 461–492. https://doi.org/10.1080/09588221.2022.2040537
Marsden, E., Morgan-Short, K., Thompson, S., & Abugaber, D. (2018). Replication in second language research: Narrative and systematic reviews and recommendations for the field. Language Learning, 68(2), 321–391. https://doi.org/10.1111/lang.12286
McEnery, T., & Hardie, A. (2012). Corpus linguistics: Method, theory and practice. Cambridge University Press.
Messeri, L., & Crockett, M. J. (2024). Artificial intelligence and illusions of understanding in scientific research. Nature, 627, 49–58. https://doi.org/10.1038/s41586-024-07146-0
Mizumoto, A. (2023). Data-driven learning meets generative AI: Introducing the framework of metacognitive resource use. Applied Corpus Linguistics, 3(3), Article 100074. https://doi.org/10.1016/j.acorp.2023.100074
Mizumoto, A., & Eguchi, M. (2023). Exploring the potential of using an AI language model for automated essay scoring. Research Methods in Applied Linguistics, 2(2), Article 100050. https://doi.org/10.1016/j.rmal.2023.100050
Ng, D. T. K., Leung, J. K. L., Chu, S. K. W., & Qiao, M. S. (2021). Conceptualizing AI literacy: An exploratory review. Computers and Education: Artificial Intelligence, 2, Article 100041. https://doi.org/10.1016/j.caeai.2021.100041
O’Keeffe, A. (2021). Data-driven learning – a call for a broader research gaze. Language Teaching, 54(2), 259–272. https://doi.org/10.1017/S0261444820000245
O’Sullivan, Í. (2007). Enhancing a process-oriented approach to literacy and language learning: The role of corpus consultation literacy. ReCALL, 19(3), 269–286. https://doi.org/10.1017/S095834400700033X
Ouyang, S., Zhang, J. M., Harman, M., & Wang, M. (2025). An empirical study of the non-determinism of ChatGPT in code generation. ACM Transactions on Software Engineering and Methodology, 34(2), 1–28. https://doi.org/10.1145/3697010
Pérez-Paredes, P. (2022). A systematic review of the uses and spread of corpora and data-driven learning in CALL research during 2011–2015. Computer Assisted Language Learning, 35(1–2), 36–61. https://doi.org/10.1080/09588221.2019.1667832
Pérez-Paredes, P. (2026). Corpus linguistics and AI in the reconfiguration of language learning ecologies. Language Teaching. Advance online publication. https://doi.org/10.1017/S0261444825101109
Pérez-Paredes, P., Curry, N., & Aguado Jiménez, P. (2025). Integrating critical corpus and AI literacies in applied linguistics: A mixed-methods study. Computer Assisted Language Learning. Advance online publication. https://doi.org/10.1080/09588221.2025.2569351
Pérez-Paredes, P., Sánchez-Tornel, M., & Alcaraz Calero, J. M. (2012). Learners’ search patterns during corpus-based focus-on-form activities: A study on hands-on concordancing. International Journal of Corpus Linguistics, 17(4), 482–515. https://doi.org/10.1075/ijcl.17.4.02par
Pérez-Paredes, P., Sánchez-Tornel, M., Alcaraz Calero, J. M., & Aguado Jiménez, P. (2011). Tracking learners’ actual uses of corpora: Guided vs non-guided corpus consultation. Computer Assisted Language Learning, 24(3), 233–253. https://doi.org/10.1080/09588221.2010.539978
Ren, Y., Wong, W. L., Barrot, J., & Zhang, L. J. (2026). Learning styles, engagement and anxiety in AI-mediated writing: A multimodal feedback study. International Journal of Applied Linguistics. Advance online publication. https://doi.org/10.1111/ijal.70120
Risko, E. F., & Gilbert, S. J. (2016). Cognitive offloading. Trends in Cognitive Sciences, 20(9), 676–688. https://doi.org/10.1016/j.tics.2016.07.002
Shumailov, I., Shumaylov, Z., Zhao, Y., Papernot, N., Anderson, R., & Gal, Y. (2024). AI models collapse when trained on recursively generated data. Nature, 631, 755–759. https://doi.org/10.1038/s41586-024-07566-y
Sinclair, J. (2005). Corpus and text: Basic principles. In M. Wynne (Ed.), Developing linguistic corpora: A guide to good practice (pp. 1–16). Oxbow Books.
Vaccaro, M., Almaatouq, A., & Malone, T. W. (2024). When combinations of humans and AI are useful: A systematic review and meta-analysis. Nature Human Behaviour, 8, 2293–2303. https://doi.org/10.1038/s41562-024-02024-1
Wang, Q., Deng, Y., & Liu, D. (2025). Corpus-driven and AI-assisted learning in teaching business academic writing: Examining their efficacies and the predicting/moderating effects of learner variables. Computer Assisted Language Learning. Advance online publication. https://doi.org/10.1080/09588221.2025.2589739
Wong, W. L., & Fong, S. (2025). A new era with artificial intelligence powered learner corpora for teaching and learning of English as a second language in primary school education. Applied Language Sciences, 1, Article 250105. https://doi.org/10.65553/ALS.250105
Wong, W. L., Abuhassna, H., Barrot, J., & Zhang, L. J. (2026). Trends in corpus linguistics and artificial intelligence language technology research: A bibliometric review. Asian-Pacific Journal of Second and Foreign Language Education, 11, Article 35. https://doi.org/10.1186/s40862-026-00412-w
Zhang, N., Wong, W. L., & Barrot, J. (2025). Primary teachers’ acceptance and sustained adoption of AI powered learner corpora for writing instruction through TAM and ECM perspectives. Scientific Reports, 15, Article 37399. https://doi.org/10.1038/s41598-025-21205-0

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright (c) 2026 Wei Lun Wong (Author)