人工智能驱动计算机类专业过程性考核的实践与反思
Practice and Reflection on AI-Driven Process-Oriented Assessment for Computer Science Majors
摘要: 计算机类专业课程的过程性考核仍存在评价维度单一、反馈滞后和个性化支持不足等问题。基于教学改革实践,本文将大语言模型辅助评阅、课程知识图谱和认知诊断引入过程性考核,构建智能考核系统。系统对主观题和代码作答进行分维度辅助评阅,并结合Q矩阵与G-DINA模型形成知识点掌握诊断,据此提供反馈与学习支持。研究以一门专业核心课程开展准实验,比较实验组与对照组在评阅效率、学习表现和反馈利用等方面的变化,并结合访谈与课堂观察进行分析。结果显示,该机制有助于缩短反馈周期,促进学生依据反馈改进任务成果,也为教师识别共性问题和调整教学提供依据。大语言模型仅承担辅助初评和诊断支持,关键评价由教师复核确认。
Abstract: Formative assessment in computer science courses still faces several challenges, including limited evaluation dimensions, delayed feedback, and insufficient personalized support. Drawing on teaching reform practices, this study integrates large language model-assisted assessment, a course knowledge graph, and cognitive diagnosis into formative assessment, and develops an intelligent assessment system. The system conducts multidimensional auxiliary assessment of open-ended responses and programming submissions, and combines a Q-matrix with the G-DINA model to generate diagnostic information on students’ mastery of knowledge points, which is then used to support feedback and learning. A quasi-experimental study was conducted in a core professional course to compare changes in assessment efficiency, learning performance, and feedback use between an experimental group and a comparison group, supplemented by interviews and classroom observations. The results indicate that the proposed mechanism helps shorten the feedback cycle, encourages students to improve their work based on feedback, and provides evidence for instructors to identify common learning difficulties and adjust teaching. The large language model is used only for auxiliary preliminary assessment and diagnostic support, while key evaluative judgments are reviewed and confirmed by instructors.
文章引用:蔡维维, 耿雅婷, 雷玉霞. 人工智能驱动计算机类专业过程性考核的实践与反思[J]. 创新教育研究, 2026, 14(11): 117-131. https://doi.org/10.12677/ces.2026.1411869

参考文献

[1] 李志义, 黎青青. 过程性评价与形成性评价辨析——工程教育专业认证视角[J]. 高等工程教育研究, 2022(5): 6-11.
[2] Black, P. and Wiliam, D. (1998) Inside the Black Box: Raising Standards through Classroom Assessment. Phi Delta Kappan, 80, 139-144, 146-148.
[3] 姚丽丽, 曹阳, 李晓明, 张维冬. 基于OBE理念的计算机类专业课程过程化考核评价模型[J]. 计算机教育, 2025(8): 230-235.
[4] Corbett, A.T. and Anderson, J.R. (1995) Knowledge Tracing: Modeling the Acquisition of Procedural Knowledge. User Modelling and User-Adapted Interaction, 4, 253-278.
https://doi.org/10.1007/bf01099821
[5] Piech, C., Bassen, J., Huang, J., et al. (2015) Deep Knowledge Tracing. In: Cortes, C., Lawrence, N.D., Lee, D.D., et al., Eds., Advances in Neural Information Processing Systems 28, Curran Associates, Inc., 505-513.
[6] Leighton, J.P. and Gierl, M.J. (Eds.) (2007) Cognitive Diagnostic Assessment for Education: Theory and Applications. Cambridge University Press.
[7] Brusilovsky, P. and Peylo, C. (2003) Adaptive and Intelligent Web-Based Educational Systems. International Journal of Artificial Intelligence in Education, 13, 159-172.
https://doi.org/10.3233/irg-2003-13(2-4)02
[8] VanLehn, K. (2006) The Behavior of Tutoring Systems. International Journal of Artificial Intelligence in Education, 16, 227-265.
https://doi.org/10.3233/irg-2006-16(3)02
[9] Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., et al. (2023) ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education. Learning and Individual Differences, 103, Article ID: 102274.
https://doi.org/10.1016/j.lindif.2023.102274
[10] 祝智庭, 彭红超. 智慧学习生态系统研究之兴起[J]. 中国电化教育, 2017(6): 1-10+23.
[11] 余胜泉. 人工智能教师的未来角色[J]. 开放教育研究, 2018, 24(1): 16-28.
[12] 郑勤华, 陈耀华, 孙洪涛, 陈丽. 基于学习分析的在线学习测评建模与应用——学习者综合评价参考模型研究[J]. 电化教育研究, 2016, 37(9): 33-40.
[13] 杨昊, 朱烨, 沈艳, 陈敏. 智能时代下计算机专业能力导向教学评价体系研究[J]. 高教学刊, 2025, 11(34): 92-96.
[14] 雷玉霞, 赵景秀. 人工智能“多元化全程性阶梯式”教学研究与实践[J]. 创新教育研究, 2020, 8(3): 298-306.
[15] 王华, 李琪, 刘效武, 雷玉霞. OBE-CDIO理念下计算机类专业“房子”型本硕贯通创新培养模式探索[J]. 创新教育研究, 2026, 14(2): 559-566.
[16] 唐满, 郭东恩, 詹英. “AI+”背景下计算机类课程过程性评价改革[J]. 计算机教育, 2025(10): 133-138.
[17] 陆丽娜, 谷学强, 刘鸿福, 陈少飞, 谢愈. 人工智能通识教育过程性考核改革创新[J]. 电气电子教学学报, 2025, 47(5): 32-34.
[18] de la Torre, J. (2011) The Generalized DINA Model Framework. Psychometrika, 76, 179-199.
https://doi.org/10.1007/s11336-011-9207-7
[19] Junker, B.W. and Sijtsma, K. (2001) Cognitive Assessment Models with Few Assumptions, and Connections with Nonparametric Item Response Theory. Applied Psychological Measurement, 25, 258-272.
https://doi.org/10.1177/01466210122032064
[20] 罗燕, 海蒂·罗斯, 岑逾豪. 国际比较视野中的高等教育测量——NSSE-China工具的开发: 文化适应与信度、效度报告[J]. 复旦教育论坛, 2009, 7(5): 12-18.