Vibe Coding for Corpus-Based Language Research and Learning: From Working Tools to Warranted Claims
pdf
html

Keywords

vibe coding; generative artificial intelligence; corpus linguistics; data-driven learning; methodological validity; validation; research instruments

How to Cite

Wong, W. L. (2026). Vibe Coding for Corpus-Based Language Research and Learning: From Working Tools to Warranted Claims. Emerging Educational Technologies, 1(1). https://doi.org/10.65553/EET.260105

Abstract

Vibe coding allows researchers and teachers to build software through natural language interaction with generative artificial intelligence. It could widen access to corpus analysis and support tools designed for specific learning contexts. However, easier software creation also transfers methodological choices into prompts, generates code and interface defaults. Crosthwaite and Özer (2026) have begun to specify how such development should be documented, most fully in vibecoding-as-method workflow. However, a documented process does not establish what a finished tool entitles its users to claim. This conceptual article examines that gap through a purposive interpretative synthesis of corpus linguistics, data-driven learning and current corpus-AI research. It argues that a functional tool provides insufficient evidence of a valid linguistic analysis or an effective learning activity and proposes three linked forms of validation: computational correctness, linguistic validity, and pedagogical validity. Each requires evidence appropriate to the claims being made. Each leaves a specific claim unsupported. The framework is illustrated through a published vibe-coded instrument, VetLingua, which shows where a carefully documented development process still leaves validation evidence to be gathered. The article also outlines a research agenda that compares complete workflows and tests independent learning beyond immediate task performance. Vibe coding could become a useful method in corpus research and education when institutions support transparent development, independent evaluation and continued maintenance.

pdf
html

References

Alqheedan, A., & Alzughaibi, S. (2026). The VIBE-HI framework: A conceptual model for evaluating vibe coding appropriateness, quality, and safety in health informatics. Frontiers in Artificial Intelligence, 9, Article 1882814. https://doi.org/10.3389/frai.2026.1882814

Anthony, L. (2025). Integrating AI technology into corpus-based language learning through ChatAI. Computer Assisted Language Learning. Advance online publication. https://doi.org/10.1080/09588221.2025.2589747

Baker, P., Gabrielatos, C., KhosraviNik, M., Krzyżanowski, M., McEnery, T., & Wodak, R. (2008). A useful methodological synergy? Combining critical discourse analysis and corpus linguistics to examine discourses of refugees and asylum seekers in the UK press. Discourse & Society, 19(3), 273–306. https://doi.org/10.1177/0957926508088962

Barrot, J. S. (2023). Using ChatGPT for second language writing: Pitfalls and potentials. Assessing Writing, 57, Article 100745. https://doi.org/10.1016/j.asw.2023.100745

Biber, D. (1993). Representativeness in corpus design. Literary and Linguistic Computing, 8(4), 243–257. https://doi.org/10.1093/llc/8.4.243

Biber, D., Conrad, S., & Cortes, V. (2004). If you look at …: Lexical bundles in university teaching and textbooks. Applied Linguistics, 25(3), 371–405. https://doi.org/10.1093/applin/25.3.371

Boulton, A. (2010). Data-driven learning: Taking the computer out of the equation. Language Learning, 60(3), 534–572. https://doi.org/10.1111/j.1467-9922.2010.00566.x

Boulton, A., & Cobb, T. (2017). Corpus use in language learning: A meta-analysis. Language Learning, 67(2), 348–393. https://doi.org/10.1111/lang.12224

Boulton, A., & Vyatkina, N. (2021). Thirty years of data-driven learning: Taking stock and charting new directions over time. Language Learning & Technology, 25(3), 66–89. https://doi.org/10.64152/10125/73450

Boulton, A., & Vyatkina, N. (2024). Expanding methodological approaches in DDL research. TESOL Quarterly, 58(3), 1193–1204. https://doi.org/10.1002/tesq.3269

Celik, I. (2023). Towards Intelligent-TPACK: An empirical study on teachers’ professional knowledge to ethically integrate artificial intelligence (AI)-based tools into education. Computers in Human Behavior, 138, Article 107468. https://doi.org/10.1016/j.chb.2022.107468

Chambers, A. (2019). Towards the corpus revolution? Bridging the research–practice gap. Language Teaching, 52(4), 460–475. https://doi.org/10.1017/S0261444819000089

Charles, M. (2024). Benefits and challenges of using do-it-yourself corpora for academic writing development. TESOL Quarterly, 58(3), 1205–1214. https://doi.org/10.1002/tesq.3276

Cheung, L., & Crosthwaite, P. (2025). CorpusChat: Integrating corpus linguistics and generative AI for academic writing development. Computer Assisted Language Learning. Advance online publication. https://doi.org/10.1080/09588221.2025.2506480

Crosthwaite, P. (2026). Is DDL dead yet? Not so fast! Revisiting earlier claims on the state of corpus linguistics, DDL, generative AI, and Language for Specific Purposes. Ibérica, 51, 5–19. https://doi.org/10.17398/2340-2784.51.5

Crosthwaite, P., & Baisa, V. (2023). Generative AI and the end of corpus-assisted data-driven learning? Not so fast! Applied Corpus Linguistics, 3(3), Article 100066. https://doi.org/10.1016/j.acorp.2023.100066

Crosthwaite, P., & Baisa, V. (2024). A user-friendly corpus tool for disciplinary data-driven learning: Introducing CorpusMate. International Journal of Corpus Linguistics, 29(4), 595–610. https://doi.org/10.1075/ijcl.23056.cro

Crosthwaite, P., & Özer, M. (2026). Vibecoding as method: A structured workflow for AI-assisted research instrument development in applied linguistics. Research Methods in Applied Linguistics, 5(3), Article 100356. https://doi.org/10.1016/j.rmal.2026.100356

Crosthwaite, P., Sun, S. A., & Jiang, F. K. (2026). Prompt sensitivity in AI writing: A methodological caution for corpus-based analysis of AI-generated language. The Modern Language Journal. Advance online publication. https://doi.org/10.1111/modl.70089

Curry, N., & McEnery, T. (2025). Corpus linguistics for language teaching and learning: A research agenda. Language Teaching, 58(2), 232–251. https://doi.org/10.1017/S0261444824000430

Dong, J., & Wang, H. (2025). Exploring the effectiveness of a DDL-GenAI teaching mode in students’ EFL writing classroom. Computer Assisted Language Learning. Advance online publication. https://doi.org/10.1080/09588221.2025.2577369

Elgendy, I. A., Dwivedi, Y. K., Al-Sharafi, M. A., Hosny, M., Helal, M. Y., Crick, T., & Al-Busaidi, A. S. (2026). Responsible vibe coding: Architecture, opportunities, and research agenda. Journal of Computer Information Systems. Advance online publication. https://doi.org/10.1080/08874417.2026.2621186

Frankenberg-Garcia, A. (2014). The use of corpus examples for language comprehension and production. ReCALL, 26(2), 128–146. https://doi.org/10.1017/S0958344014000093

Gries, S. T. (2008). Dispersions and adjusted frequencies in corpora. International Journal of Corpus Linguistics, 13(4), 403–437. https://doi.org/10.1075/ijcl.13.4.02gri

Han, Z. (2024). ChatGPT in and for second language acquisition: A call for systematic research. Studies in Second Language Acquisition, 46(2), 301–306. https://doi.org/10.1017/S0272263124000111

Handley, Z. (2024). Has artificial intelligence rendered language teaching obsolete? The Modern Language Journal, 108(2), 548–555. https://doi.org/10.1111/modl.12929

Kane, M. T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50(1), 1–73. https://doi.org/10.1111/jedm.12000

Karpathy, A. [@karpathy]. (2025, February 2). There’s a new kind of coding I call “vibe coding” [Post]. X. https://x.com/karpathy/status/1886192184808149383

Kern, R. (2021). Twenty-five years of digital literacies in CALL. Language Learning & Technology, 25(3), 132–150. https://doi.org/10.64152/10125/73453

Kern, R. (2024). Twenty-first century technologies and language education: Charting a path forward. The Modern Language Journal, 108(2), 515–533. https://doi.org/10.1111/modl.12924

Kilgarriff, A. (2005). Language is never, ever, ever, random. Corpus Linguistics and Linguistic Theory, 1(2), 263–276. https://doi.org/10.1515/cllt.2005.1.2.263

Kohnke, L., Moorhouse, B. L., & Zou, D. (2023). ChatGPT for language teaching and learning. RELC Journal, 54(2), 537–550. https://doi.org/10.1177/00336882231162868

Lu, X. (2010). Automatic analysis of syntactic complexity in second language writing. International Journal of Corpus Linguistics, 15(4), 474–496. https://doi.org/10.1075/ijcl.15.4.02lu

Lu, X. (2012). The relationship of lexical richness to the quality of ESL learners’ oral narratives. The Modern Language Journal, 96(2), 190–208. https://doi.org/10.1111/j.1540-4781.2011.01232.x

Ma, Q., Yan, J., Crosthwaite, P., & Lee, C.-K. J. (2026). TPACK for corpus technology: TESOL student teachers’ growth and self-efficacy in independent language learning and teaching. ReCALL, 38(1), 94–110. https://doi.org/10.1017/S0958344025100347

Ma, Q., Yuan, R. E., Cheung, L. M. E., & Yang, J. (2024). Teacher paths for developing corpus-based language pedagogy: A case study. Computer Assisted Language Learning, 37(3), 461–492. https://doi.org/10.1080/09588221.2022.2040537

Marsden, E., Morgan-Short, K., Thompson, S., & Abugaber, D. (2018). Replication in second language research: Narrative and systematic reviews and recommendations for the field. Language Learning, 68(2), 321–391. https://doi.org/10.1111/lang.12286

McEnery, T., & Hardie, A. (2012). Corpus linguistics: Method, theory and practice. Cambridge University Press.

Messeri, L., & Crockett, M. J. (2024). Artificial intelligence and illusions of understanding in scientific research. Nature, 627, 49–58. https://doi.org/10.1038/s41586-024-07146-0

Mizumoto, A. (2023). Data-driven learning meets generative AI: Introducing the framework of metacognitive resource use. Applied Corpus Linguistics, 3(3), Article 100074. https://doi.org/10.1016/j.acorp.2023.100074

Mizumoto, A., & Eguchi, M. (2023). Exploring the potential of using an AI language model for automated essay scoring. Research Methods in Applied Linguistics, 2(2), Article 100050. https://doi.org/10.1016/j.rmal.2023.100050

Ng, D. T. K., Leung, J. K. L., Chu, S. K. W., & Qiao, M. S. (2021). Conceptualizing AI literacy: An exploratory review. Computers and Education: Artificial Intelligence, 2, Article 100041. https://doi.org/10.1016/j.caeai.2021.100041

O’Keeffe, A. (2021). Data-driven learning – a call for a broader research gaze. Language Teaching, 54(2), 259–272. https://doi.org/10.1017/S0261444820000245

O’Sullivan, Í. (2007). Enhancing a process-oriented approach to literacy and language learning: The role of corpus consultation literacy. ReCALL, 19(3), 269–286. https://doi.org/10.1017/S095834400700033X

Ouyang, S., Zhang, J. M., Harman, M., & Wang, M. (2025). An empirical study of the non-determinism of ChatGPT in code generation. ACM Transactions on Software Engineering and Methodology, 34(2), 1–28. https://doi.org/10.1145/3697010

Pérez-Paredes, P. (2022). A systematic review of the uses and spread of corpora and data-driven learning in CALL research during 2011–2015. Computer Assisted Language Learning, 35(1–2), 36–61. https://doi.org/10.1080/09588221.2019.1667832

Pérez-Paredes, P. (2026). Corpus linguistics and AI in the reconfiguration of language learning ecologies. Language Teaching. Advance online publication. https://doi.org/10.1017/S0261444825101109

Pérez-Paredes, P., Curry, N., & Aguado Jiménez, P. (2025). Integrating critical corpus and AI literacies in applied linguistics: A mixed-methods study. Computer Assisted Language Learning. Advance online publication. https://doi.org/10.1080/09588221.2025.2569351

Pérez-Paredes, P., Sánchez-Tornel, M., & Alcaraz Calero, J. M. (2012). Learners’ search patterns during corpus-based focus-on-form activities: A study on hands-on concordancing. International Journal of Corpus Linguistics, 17(4), 482–515. https://doi.org/10.1075/ijcl.17.4.02par

Pérez-Paredes, P., Sánchez-Tornel, M., Alcaraz Calero, J. M., & Aguado Jiménez, P. (2011). Tracking learners’ actual uses of corpora: Guided vs non-guided corpus consultation. Computer Assisted Language Learning, 24(3), 233–253. https://doi.org/10.1080/09588221.2010.539978

Ren, Y., Wong, W. L., Barrot, J., & Zhang, L. J. (2026). Learning styles, engagement and anxiety in AI-mediated writing: A multimodal feedback study. International Journal of Applied Linguistics. Advance online publication. https://doi.org/10.1111/ijal.70120

Risko, E. F., & Gilbert, S. J. (2016). Cognitive offloading. Trends in Cognitive Sciences, 20(9), 676–688. https://doi.org/10.1016/j.tics.2016.07.002

Shumailov, I., Shumaylov, Z., Zhao, Y., Papernot, N., Anderson, R., & Gal, Y. (2024). AI models collapse when trained on recursively generated data. Nature, 631, 755–759. https://doi.org/10.1038/s41586-024-07566-y

Sinclair, J. (2005). Corpus and text: Basic principles. In M. Wynne (Ed.), Developing linguistic corpora: A guide to good practice (pp. 1–16). Oxbow Books.

Vaccaro, M., Almaatouq, A., & Malone, T. W. (2024). When combinations of humans and AI are useful: A systematic review and meta-analysis. Nature Human Behaviour, 8, 2293–2303. https://doi.org/10.1038/s41562-024-02024-1

Wang, Q., Deng, Y., & Liu, D. (2025). Corpus-driven and AI-assisted learning in teaching business academic writing: Examining their efficacies and the predicting/moderating effects of learner variables. Computer Assisted Language Learning. Advance online publication. https://doi.org/10.1080/09588221.2025.2589739

Wong, W. L., & Fong, S. (2025). A new era with artificial intelligence powered learner corpora for teaching and learning of English as a second language in primary school education. Applied Language Sciences, 1, Article 250105. https://doi.org/10.65553/ALS.250105

Wong, W. L., Abuhassna, H., Barrot, J., & Zhang, L. J. (2026). Trends in corpus linguistics and artificial intelligence language technology research: A bibliometric review. Asian-Pacific Journal of Second and Foreign Language Education, 11, Article 35. https://doi.org/10.1186/s40862-026-00412-w

Zhang, N., Wong, W. L., & Barrot, J. (2025). Primary teachers’ acceptance and sustained adoption of AI powered learner corpora for writing instruction through TAM and ECM perspectives. Scientific Reports, 15, Article 37399. https://doi.org/10.1038/s41598-025-21205-0

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Copyright (c) 2026 Wei Lun Wong (Author)

Views: 27Downloads: 84

Downloads

Download data is not yet available.
Creative Commons License All articles published in Emerging Educational Technologies are open access and distributed under the terms of the Creative Commons Attribution 4.0 International License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author(s) and source are properly credited. Copyright is retained by the author(s).