在线课程质量综合评价模型的设计和验证
Design and Verification of Online Course Quality Comprehensive Evaluation Model
摘要: 课程质量是开放大学发展面临的最大挑战之一。为了保证课程质量,远程教育机构有必要对课程的结构和组成成分,以及课程规划、实施及其效果开展综合评价。然而,现有的在线课程质量评价标准维度不一,测量指标差异很大,且很少同时兼顾对课程本身质量和课程规划、实施和结果质量的评价。本研究在文献综述和内容分析的基础上,参考已有在线课程质量评价标准,通过对专家、授课教师和在线学习者的问卷调查法、成熟度模型(CMM)分析方法,构建一个涵盖对在线课程本身质量和课程规划、实施和效果进行持续评价的在线课程质量综合评价模型,并利用德尔菲访谈法和层次分析法,确定测量指标的权重赋值。最后,通过邀请远程教育专家、任课教师和在线学习者利用构建的模型,对随机挑选的课程独立评价的方式,对提出的在线课程质量评价指标体系的信效度进行交叉验证。最后,提出完善在线课程质量测量指标体系的建议和在实践中推广测量指标体系的策略。
Abstract:
Course quality is one of the biggest challenges facing the development of open universities. In order to guarantee the quality of courses, it is necessary for distance education institutions to carry out comprehensive evaluation on the structure and composition of courses, as well as the planning, implementation and effect of courses. However, the existing online course quality evaluation standards have different dimensions, and the measurement indicators vary greatly, and rarely take into account the evaluation of the quality of the course itself and the quality of the course planning, implementation and results. On the basis of literature review and content analysis, referring to the existing evaluation standards of online course quality, this study constructs a comprehensive evaluation model of online course quality that covers the continuous evaluation of the quality of online course itself and the course planning, implementation and effect through questionnaire survey and maturity model (CMM) analysis of experts, teachers and online learners, and uses Delphi interview method and analytic hierarchy process to determine the weight assignment of measurement indi-cators. Finally, by inviting distance education experts, teachers and online learners to use the con-structed model, the reliability and validity of the proposed online course quality evaluation index system are cross-verified by means of independent evaluation of randomly selected courses. Finally, the paper puts forward suggestions to improve the online course quality measurement index sys-tem and strategies to promote the measurement index system in practice.
参考文献
|
[1]
|
林世员, 陈丽, 彭义平. 我国高校现代远程教育外部质量保障体系建设——现状、反思与建议[J]. 中国远程教育, 2016(5): 43-49+80.
|
|
[2]
|
陈然. 开放大学在线课程质量保障体系构建研究——基于TQM理论视角[J]. 终身教育研究, 2021, 32(1): 66-72.
|
|
[3]
|
刘永福, 李静辉. 网络课程在线评价指标体系的设计与实现[J]. 中国远程教育, 2015(8): 57-63.
|
|
[4]
|
Marciniak, R. (2018) Quality Assurance for Online Higher Education Programmes: Design and Validation of an Integrative Assessment Model Applicable to Spanish Universities. International Review of Research in Open & Distance Learning, 19, 126-154. [Google Scholar] [CrossRef]
|
|
[5]
|
李青, 刘娜. MOOC质量保证体系研究[J]. 开放教育研究, 2015, 21(5): 66-73.
|
|
[6]
|
杨晓宏, 周海军, 周效章, 郝照. 国内在线课程质量认定研究述评[J]. 电化教育研究, 2019, 40(6): 50-57.
|
|
[7]
|
张福涛. 如何认识和评价在线课程的质量[EB/OL].
http://www.360doc.com/content/20/0326/20/30898787_901871912.shtml, 2020-03-06.
|
|
[8]
|
教育部办公厅. 教育部办公厅关于开展2018年国家精品在线开放课程认定工作的通知[EB/OL].
http://www.moe.gov.cn/srcsite/A08/s5664/s7209/s6872/201807/t20180725_343681.html, 2018-07-24.
|
|
[9]
|
张伟远. PDPP网络课程评价模式的建构及其应用案例[J]. 中国远程教育, 2009(11): 17-20+79.
|
|
[10]
|
张建飞, 胡央波, 纪雪聪. 在线开放课程质量评价体系探究——基于浙江省高等学校精品在线开放课程共享平台[J]. 高等继续教育学报, 2017, 30(6): 19-24+37.
|
|
[11]
|
王晖, 许启胜, 吴晓凤. UOOC联盟教学质量评价体系的研究与实践[J]. 工业和信息化教育, 2016(8): 12-17.
|
|
[12]
|
黄璐, 裴新宁, 朱莹希. 在线课程内容质量评价指标体系新探——基于学习者体验和知识付费的视角[J]. 远程教育杂志, 2020, 38(1): 104-112.
|
|
[13]
|
Khan, B.H. (2007) Program Evaluation in E-Learning. https://asianvu.com/bk/elearning_evaluation_article.pdf
|
|
[14]
|
MarylandOnline (2019) National Stand-ards for Quality Online Courses.
https://www.nsqol.org/wp-content/uploads/2019/09/National-Standards-for-Quality-Online-Courses-Catalog3-2019.09.01.pdf
|
|
[15]
|
Matters, Q. (2018) Quality Matters Higher Education Rubric Workbook Sixth Edition.
https://www.qualitymatters.org/sites/
default/files/PDFs/StandardsfromtheQMHigherEducationRubric.pdf
|
|
[16]
|
金贤. 开放在线课程质量评价CMM模型应用研究[J]. 中国教育信息化, 2020(3): 48-51.
|
|
[17]
|
Yusoff, M.S.B. (2019) ABC of Response Process Validation and Face Validity Index Calculation. Education in Medicine Journal, 11, 55-61. [Google Scholar] [CrossRef]
|
|
[18]
|
史静琤, 莫显昆, 孙振球. 量表编制中内容效度指数的应用[J]. 中南大学学报(医学版), 2012, 37(2): 49-52.
|