INTELIGÊNCIA ARTIFICIAL GENERATIVA NA EDUCAÇÃO BÁSICA:  O CASO DO PROTÓTIPO CYBERSCHOLAR

Ana Karina Nascimento; Vania Castro; Raigul Zheldibayeva; Bill Cope

doi:10.32748/revec.v11i27.22720

Authors

Ana Karina Nascimento Federal University of Sergipe https://orcid.org/0000-0002-3014-0659
Vania Castro University of Illinois Urbana-Champaign https://orcid.org/0000-0002-4930-5345
Raigul Zheldibayeva Zhetysu University named after Ilyas Zhansugurov https://orcid.org/0000-0002-8757-0748
Bill Cope University of Illinois Urbana-Champaign https://orcid.org/0000-0003-2129-395X

DOI:

https://doi.org/10.32748/revec.v11i27.22720

Keywords:

Feedback generation, Writing, Prompt engineering, Human curation

Abstract

This study examines the implementation of CyberScholar, a generative artificial intelligence tool under development for providing feedback on student writing in basic education across different school subjects. Trials were conducted with grades 7, 8, 10, and 11, at four schools in the United States. Using “prompt engineering” and “fine-tuning” a Large Language Model (LLM) via Retrieval Augmented Generation (RAG), the study qualitatively analyzes the prototype’s potential to enhance students’ writing skills and support teachers’ work. It also addresses human curation’s role in shaping GenAI outputs and envisions its future in education.

Downloads

Download data is not yet available.

Author Biographies

Ana Karina Nascimento, Federal University of Sergipe

Ana Karina de Oliveira Nascimento holds a PhD in Literature from the University of São Paulo. She is a professor in the Department of Foreign Languages and the Graduate Program in Literature at the Federal University of Sergipe. She is a CNPq postdoctoral fellow abroad in Brazil.

Vania Castro, University of Illinois Urbana-Champaign

Vania Castro holds a PhD in Applied Linguistics from the Federal University of Minas Gerais. She is a professor in the Department of Education Policy, Organization, and Leadership at the University of Illinois Urbana-Champaign, United States of America.

Raigul Zheldibayeva, Zhetysu University named after Ilyas Zhansugurov

She holds a PhD in Education and Psychology from Zhetysu University, Kazakhstan. She is a professor in the Department of Pedagogy and Psychology at Zhetysu University, formerly I. Zhansugurov, in Kazakhstan.

Bill Cope, University of Illinois Urbana-Champaign

He holds a PhD in Education from Macquarie University, Australia. He is a professor in the Department of Education Policy, Organization, and Leadership at the University of Illinois Urbana-Champaign, United States of America.

References

AKGUN, Selin; GREENHOW, Christine. Artificial intelligence in education: addressing ethical challenges in K-12 settings. AI and Ethics, v. 2, p. 431–440, 2022. Disponível em: https://doi.org/10.1007/s43681-021-00096-7. Acesso em: 15 jan. 2025. DOI: https://doi.org/10.1007/s43681-021-00096-7

BAKER, Ryan S.; HAWN, Aaron. Algorithmic bias in education. International Journal of Artificial Intelligence in Education, v. 32, p. 1052–1092, 2022. Disponível em: https://doi.org/10.1007/s40593-021-00285-9. Acesso em: 02 set. 2024. DOI: https://doi.org/10.1007/s40593-021-00285-9

BASHAM, James D.; ISRAEL, Maya; GRADEN, Janet; POTH, Rita; WINSTON, Markay. A comprehensive approach to RTI: Embedding Universal Design for Learning and technology. Learning Disability Quarterly, v. 33(Fall), p. 243-255, 2010. DOI: https://doi.org/10.1177/073194871003300403

BRANSFORD, John D.; BROWN, Ann L.; COCKING, Rodney R. (Eds.). How people learn: Brain, mind, experience, and school. Washington: National Academy Press, 2000.

CAST. Universal Design for Learning guidelines. National Center on Universal Design for Learning, 2018. Disponível em: https://udlguidelines.cast.org/. Acesso em: 05 set. 2024.

CHEN, Bodong; ZHU, Xiran; DEL CASTILLO, Fernando Díaz H. Integrating generative AI in knowledge building. Computers and Education: Artificial Intelligence, v. 5, 100184, 2023. Disponível em: https://doi.org/10.1016/j. caeai.2023.100184. Acesso em: 06 set. 2024. DOI: https://doi.org/10.1016/j.caeai.2023.100184

CHRISTIAN, Brian. The alignment problem: Machine learning and human values. New York: W. W. Norton, 2020.

COPE, Bill; KALANTZIS, Mary. Creating a different kind of learning management system: The CGScholar experiment. In: MONTEBELLO, Matthew. (Ed.). Promoting next-generation learning environments through CGScholar. New York: IGI Global, 2023. p. 1–18. DOI: https://doi.org/10.4018/978-1-6684-5124-3.ch001

COPE, Bill; KALANTZIS, Mary. On cyber-social learning: A critique of artificial intelligence in education. In: KOURKOULOU, Dora; TZIRIDES, Anastasia-Olga (Olnancy); COPE, Bill; KALANTZIS, Mary (Eds.). Trust and inclusion in AI-mediated education: Where human learning meets learning machines. London: Springer, 2024. p. 3–34. DOI: https://doi.org/10.1007/978-3-031-64487-0_1

COPE, Bill; KALANTZIS, Mary; ZAPATA, Gabriela C. Language learning after generative AI. In: ZAPATA, Gabriela C. (Ed.). Generative AI technologies, multiliteracies, and language education. New York: Routledge, 2025. DOI: https://doi.org/10.4324/9781003531685-2

CRAWFORD, Kate. Atlas of AI: Power, Politics, and the Planetary Costs of Artificial Intelligence. Yale: Yale University Press, 2021. CRESWELL, John W. Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. 4th Edition. London: SAGE Publications, 2013.

DEMBSEY, J. M. Closing the Grammarly gaps: A study of claims and feedback from an online grammar program. The Writing Center Journal, 36(1), p. 63–100, 2017. DOI: https://doi.org/10.7771/2832-9414.1815

GODWIN-JONES, Robert. Partnering with AI: Intelligent writing assistance and instructed language learning. Language Learning & Technology, 26(2), p. 5–24, 2022. Disponível em: http://doi.org/10125/73474. Acesso em: 04 set. 2024. DOI: https://doi.org/10.64152/10125/73474

GURAJALA, Swathi. Maximizing the Utility of Online Assessment Tools in the Pandemic Era: A Narrative Review. Journal of Education Technology in Health Sciences, 7(3), p. 80-85, 2020. Disponível em: https://doi.org/https://doi. org/10.18231/j.jeths.2020.020. Acesso em: 10 set. 2024. DOI: https://doi.org/10.18231/j.jeths.2020.020

GHUFRON, M. Ali. Exploring an automated feedback program ‘Grammarly’ and teacher corrective feedback in EFL writing assessment: Modern vs. traditional assessment [Paper presentation]. The 3rd English Language and Literature International Conference, Semarang, Indonesia., abril de 2019. Disponível em: https://doi.org/10.4108/eai.27-42019.2285308. Acesso em: 12 out. 2024. DOI: https://doi.org/10.4108/eai.27-4-2019.2285308

HATTIE, John; YATES, Gregory C. R. Visible Learning and the Science of How We Learn. New York: Routledge, 2014. HATTIE, John. Visible Learning: A Synthesis of Over 800 Meta-Analyses Relating to Achievement. New York: Routledge. 2009. DOI: https://doi.org/10.4324/9781315885025

INSTITUTO NACIONAL DE ESTUDOS E PESQUISAS EDUCACIONAIS ANÍSIO TEIXEIRA (Inep). Desempenho em língua portuguesa é desafio para próximos anos. 5 de maio de 2023. Disponível em: https://www.gov. br/inep/pt-br/assuntos/noticias/saeb/desempenho-em-lingua-portuguesa-e-desafio-para-proximos-anos. Acesso em: 05 out. 2024.

ILLINOIS STATE BOARD OF EDUCATION. (2023). Illinois Report Card. Disponível em: https://www.illinoisreportcard.com/. Acesso em: 03 out. 2024.

ISRAEL, Maya; MAYNARD, Kathie; WILLIAMSON, Pamela. Promoting Literacy-embedded Authentic STEM Instruction for Students with Disabilities and Other Struggling Learners. Teaching Exceptional Children, 45(4), 18-25, 2013. DOI: https://doi.org/10.1177/004005991304500402

ISRAEL, Maya; WANG, Shuai; MARINO, Matthew T. A Multilevel Analysis of Diverse Learners Playing Life Science Video Games: Interactions between Gaming Content, Learning Disability Status, Reading Proficiency, and Gender. Journal of Research in Science Teaching, Advanced online publication, 2015. DOI: https://doi.org/10.1002/tea.21273

KAY, Judy; KLEITMAN, Sabina; AZEVEDO, Roger. Empowering Teachers to Design Learning Resources with Metacognitive Interface Elements. In: LUCKIN, Rosemary; PUNTAMBEKAR, Sadhana; GOODYEAR, Peter; GRABOWSKI, Barbara L.; UNDERWOOD, Joshua; WINTERS, Niall. (Eds.), Handbook of Design in Educational Technology. New York: Routledge, 2013.

KINGSTON, Neal; NASH, Brooke. Formative Assessment: A Meta-analysis and a Call for Research. Educational Measurement: Issues and Practice, 30(4), p. 28-37, 2011. DOI: https://doi.org/10.1111/j.1745-3992.2011.00220.x

KNOCH, Ute. Rating scales for diagnostic assessment of writing: What should they look like and where should the criteria come from? Assessing Writing, 16(2), p. 81–96, 2011. Disponível em: https://doi.org/10.1016/j.asw.2011.02.003. Acesso em: 10 de out. 2024. DOI: https://doi.org/10.1016/j.asw.2011.02.003

LADSON-BILLINGS, Gloria. “#Literate Lives Matter”: Black Reading, Writing, Speaking, and Listening in the 21st Century. Literacy Research: Theory, Method, and Practice, 65, p. 141-151, 2016. Disponível em: https://doi.org/https:// doi.org/10.1177/2381336916661526. Acesso em: 10 abr. 2018. DOI: https://doi.org/10.1177/2381336916661526

LUKE, Allan. Critical Literacy, Schooling, and Social Justice: The Selected Works of Allan Luke. New York: Routledge, 2018. DOI: https://doi.org/10.4324/9781315100951

MARINO, Marino T.; GOTCH, Chad M.; ISRAEL, Maya; VASQUEZ, Eleazar.; BASHAM, James D; BECHT, Kathleen. UDL in the middle school science classroom: Can video games and alternate text heighten engagement and learning for students with learning disabilities? Learning Disabilities Quarterly, 37(2), p. 87–99, 2014. Disponível em: https://doi. org/10.1177/0731948713503963. Acesso em: 20 nov. 2016. DOI: https://doi.org/10.1177/0731948713503963

MCCARTHY, John; MINSKY, Marvin L.; ROCHESTER, Nathaniel; SHANNON, Claude E. A proposal for the Dartmouth Summer Research Project on Artificial Intelligence. 1955. Disponível em: https://www-formal.stanford.edu/jmc/history/ dartmouth/dartmouth.html. Acesso em: 24 ago. 2024.

MOLLICK, Ethan R.; MOLLICK, Lilach. Assigning AI: Seven approaches for students, with prompts. The Wharton School Research Paper. New York: SSRN, 2023. Disponível em: https://doi.org/10.2139/ssrn.447599. Acesso em: 19 ago. 2024. DOI: https://doi.org/10.2139/ssrn.4475995

MAHANAN, Mangai Solomon; TALIB, Corrienna Abdul; IBRAHIM, Nor Hasniza. Online formative assessment in higher STEM education: A systematic literature review. Asian Journal of Assessment in Teaching and Learning, 11(1), p. 47–62, 2021. Disponível em: https://doi.org/10.37134/ajatel.vol11.1.5.2021. Acesso em: 12 ago. 2023. DOI: https://doi.org/10.37134/ajatel.vol11.1.5.2021

MARTIN, Robert Cecil. Agile Software Development, Principles, Patterns, and Practices. New Jersey: Prentice Hall, 2009. NATIONAL CENTER FOR EDUCATION STATISTICS. Technical summary of preliminary analyses of NAEP 2017 writing assessments. 2019. Disponível em: https://nces.ed.gov/nationsreportcard/subject/writing/pdf/2017_writing_technical_summary.pdf. Acesso em: 10 jan. 2020.

NATIONAL COMMISSION ON WRITING. The neglected “R”: The need for a writing revolution. National Commission on Writing in America’s Schools and Colleges. 2003.

NATIONAL COMMISSION ON WRITING. Writing: A ticket to work ... or a ticket out - A survey of business leaders. National Commission on Writing. 2004. OGURLU, Uzeyir; MOSSHOLDER, Jesse. The perception of ChatGPT among educators: Preliminary findings. Research in Social Sciences and Technology, 8(1), p. 196–215, 2023. Disponível em: https://doi.org/10.46303/ressat.2023.39. Acesso em: 25 jan. 2024. DOI: https://doi.org/10.46303/ressat.2023.39

PAIVA, Vera Lúcia Menezes de Oliveira. Manual de Pesquisa em Estudos Linguísticos. São Paulo: Parábola, 2019. PETERS, Michael A.; JACKSON, Liz; PAPASTEPHANOU, Marianna; JANDRIĆ, Petar; LAZAROIU, George; EVERS, Colin W.; COPE, Bill; KALANTZIS, Mary; ARAYA, Daniel; TESAR, Marek; MIKA, Carl; CHEN, Lei; WANG, Chengbing; STURM, S.; RIDER, Sharon.; FULLER, Steve. AI and the future of humanity: ChatGPT-4, philosophy and education – Critical responses. Educational Philosophy and Theory, v. 56, n.9, 828-862, 2023. Disponível em: https://doi.org/1 0.1080/00131857.2023.2213437. Acesso em: 22 out. 2024. DOI: https://doi.org/10.1080/00131857.2023.2213437

RANDALL, Jennifer. ‘Color-neutral’ is not a thing: Redefining construct definition and representation through a justice-oriented critical antiracist lens. Educational Measurement: Issues and Practice, 40(4), p. 82–90, 2021. SAEED, Sultan. Evaluating the Effectiveness of AI Tools in Enhancing Writing Skills: Perspectives from Writing Centers. ResearchGate, 2024. Disponível em: https://www.researchgate.net/publication/383263687. Acesso em: 06 jan. 2025. DOI: https://doi.org/10.1111/emip.12429

SHAHVAROUGHI FARAHANI, Milad; GHASEMI, Ghazal. How AI Changes the Game in Finance Business Models. International Journal of Innovation in Management, Economics and Social Sciences, 4(1), p. 35–46, 2024. Disponível em: https://doi.org/10.59615/ijimes.4.1.35. Acesso em: 03 jan. 2025. DOI: https://doi.org/10.59615/ijimes.4.1.35

SHEPARD, Lorrie A. Formative assessment: Caveat emptor. Educational Measurement: Issues and Practice, 28(3), p. 32–37, 2010. SHOR, Ira. Critical Pedagogy Is Too Big to Fail. Journal of Basic Writing (CUNY), 28 (2), p. 6-27, Fall, 2009. DOI: https://doi.org/10.37514/JBW-J.2009.28.2.02

STOBER, Thomas; HANSMANN, Uwe. Agile software development: Best practices for large software development projects. London: Springer, 2009. DOI: https://doi.org/10.1007/978-3-540-70832-2

TURING, Alan Mathison. Intelligent machinery. A Report to the National Physical Laboratory, 1948. UYGUN, Derya. Teachers’ perspectives on artificial intelligence in education. Advances in Mobile Learning Educational Research, 4(1), p. 931–939, 2024. Disponível em: https://doi.org/10.25082/AMLER.2024.01.005. Acesso em: 10 jan. 2025. DOI: https://doi.org/10.25082/AMLER.2024.01.005

WILIAM, Dylan. Embedded Formative Assessment. Indiana: Solution Tree Press, 2011.

WINNE, Philip H.; BAKER, Ryan S. The potentials of educational data mining for researching metacognition, motivation, and self-regulated learning. Journal of Educational Data Mining, 5(1), p. 1–8, 2013.