Future mathematics teachers’ perception of artificial intelligence integration in assessment in a digital technologies course
Article Sidebar
Main Article Content
Abstract
The integration of generative Artificial Intelligence (AI) in higher education requires understanding student perceptions. This study analyzed the views of pre-service mathematics teachers (N=14) on using ChatGPT as an assessment tool in a university course. Through a mixed-methods approach, their perceptions of the quality of feedback and the validity of AI-generated grades were explored. The findings reveal a fundamental dichotomy: students positively value AI as a formative feedback tool, recognizing its utility for improvement. However, they express significant distrust in its role as a summative assessment agent, perceiving it as incapable of making holistic judgments. The analysis suggests that students view the instructor and AI as agents with complementary strengths, outlining an “augmented assessment” model. The opacity of the AI’s process (the “black box” problem) was identified as a critical barrier. Although a majority (57.1%) prefers human grading, a significant minority (42.9%) leans towards AI, valuing its immediacy and objectivity. It is concluded that the most promising role for AI in assessment is not that of an autonomous judge, but of an assessment copilot that enhances the instructor’s capabilities.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Los autores conservan los derechos de autor y ceden a la revista el derecho de la primera publicación y pueda editarlo, reproducirlo, distribuirlo, exhibirlo y comunicarlo en el país y en el extranjero mediante medios impresos y electrónicos. Asimismo, asumen el compromiso sobre cualquier litigio o reclamación relacionada con derechos de propiedad intelectual, exonerando de responsabilidad a la Editorial Tecnológica de Costa Rica. Además, se establece que los autores pueden realizar otros acuerdos contractuales independientes y adicionales para la distribución no exclusiva de la versión del artículo publicado en esta revista (p. ej., incluirlo en un repositorio institucional o publicarlo en un libro) siempre que indiquen claramente que el trabajo se publicó por primera vez en esta revista.
References
[1] I. Roll and R. Wylie, “Evolution and revolution in artificial intelligence in education,” International Journal of Artificial Intelligence in Education, vol. 26, no. 2, pp. 582-599, 2016. doi: 10.1007/s40593-016-0110-3.
[2] E. Kasneci et al., “ChatGPT for good? On opportunities and challenges of large language models for education,” Learning and Individual Differences, vol. 103, Art. no. 102274, 2023. doi: 10.1016/j.lindif.2023.102274.
[3] R. Rondon et al., “El Impacto de la Inteligencia Artificial en la Formación Docente,” Revista Tecnológica-Educativa Docentes 2.0, vol. 17, no. 2, pp. 368-375, 2024. doi: 10.37843/rted.v17i2.566.
[4] J. Rudolph, S. Tan, and S. Tan, “ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?,” Journal of Applied Learning and Teaching, vol. 6, no. 1, 2023. doi: 10.37074/jalt.2023.6.1.9.
[5] Y. Attali and J. Burstein, “Automated essay scoring with e-rater® V.2,” The Journal of Technology, Learning, and Assessment, vol. 4, no. 3, pp. 1-30, 2006.
[6] K. Bouziane and A. Bouziane, “AI versus human effectiveness in essay evaluation,” Discovery Education, vol. 3, no. 201, 2024. doi: 10.1007/s44217-024-00320-6.
[7] X. Zhai, “ChatGPT for next generation science learning,” ACM, vol. 29, no. 3, pp. 42-46, 2023. doi: 10.1145/3589649.
[8] A. Clark-Wilson, O. Robutti, and N. Sinclair, The Mathematics Teacher in the Digital Era: International Research on Professional Learning and Practice. Springer Nature, 2023.
[9] M. Bobula, “Generative artificial intelligence (AI) in higher education: a comprehensive review of challenges, opportunities, and implications,” Journal of Learning Development in Higher Education, no. 30, pp. 1-27, 2024. doi: 10.47408/jldhe.vi30.1137.
[10] M. Henderson et al., “Comparing Generative AI and teacher feedback: student perceptions of usefulness and trustworthiness,” Assessment & Evaluation in Higher Education, vol. 50, no. 1, pp. 1-16, 2025. doi: 10.1080/02602938.2025.2502582.
[11] F. Pedro, M. Subosa, A. Rivas, and P. Valverde, Artificial Intelligence in Education: Challenges and Opportunities for Sustainable Development. París, Francia: UNESCO, 2019.