国际写作评估研究主题动态演化趋势分析
A Bibliometric Analysis of Dynamic Evolution Trends in International Writing Assessment Studies
DOI: 10.12677/ml.2025.137741, PDF,    科研立项经费支持
作者: 汤小艺:北京科技大学外国语学院,北京
关键词: 写作评估SciMAT主题动态演化文献计量分析Writing Assessment SciMAT Thematic Dynamic Evolution Bibliometric Analysis
摘要: 本研究使用文献可视化工具SciMAT,对2003~2023年Web of Science核心数据库中写作评估领域的文献,进行主题动态演化的文献计量学分析。通过关键词演进覆盖图、聚类战略图以及动态演化路径图的剖析,研究发现写作评估领域呈现出繁荣发展的态势,形成了“句法复杂度”“学生感知”“效度”“写作自动评估”“教学策略”“二语写作”及“性能评估”七个研究方向的十条演化路径。未来写作评估相关研究需融合基于语言规则的理性主义和基于语言大数据的经验主义的跨学科研究方法,解构“写作质量”多维度、多层级构念,拓宽写作评估领域的研究内容与视角。
Abstract: The present study harnesses the literature visualization tool SciMAT to conduct a bibliometric analysis of the dynamic thematic evolution within the writing assessment domain, drawing from documents indexed in the Web of Science Core Collection from 2003 to 2023. Through an in-depth examination of keyword evolution coverage maps, clustering strategy maps, and thematic dynamic evolution pathway diagrams across three distinct periods, our investigation unveiled that, over the past two decades, the domain of writing assessment has experienced a flourishing development, culminating in the establishment of seven research directions: Syntactic Complexity, Students Perceptions, Validity, Automated Writing Evaluation, Instructional Strategies, L2 Writing, and Performance Assessment with ten evolutionary pathways. Future research on writing assessment could integrate interdisciplinary approaches that combine rationalism based on language rules and empiricism based on big language data, thereby deconstructing the multidimensional and multilevel constructs of writing quality and expanding the perspective of research within the field of writing assessment.
文章引用:汤小艺. 国际写作评估研究主题动态演化趋势分析[J]. 现代语言学, 2025, 13(7): 545-556. https://doi.org/10.12677/ml.2025.137741

参考文献

[1] 赵秀凤. 英语写作评估与语体量化体系[J]. 外语教学, 2003(5): 76-79.
[2] 高海英. 国内外二语写作评估研究现状与思考[J]. 外语界, 2010(2): 77-82.
[3] 齐曦. 国外学术英语写作评估研究述评[J]. 外国语文, 2018(5): 94-101.
[4] Cobo, M.J., López‐Herrera, A.G., Herrera‐Viedma, E. and Herrera, F. (2012) SciMAT: A New Science Mapping Analysis Software Tool. Journal of the American Society for Information Science and Technology, 63, 1609-1630. [Google Scholar] [CrossRef
[5] 李文婷, 祝朝伟. 基于SciMAT的国际译学动态演化(2010-2019)分析研究[J]. 外国语文, 2022(1): 123-132.
[6] McNamara, D.S., Graesser, A.C., McCarthy, P.M. and Cai, Z. (2014) Automated Evaluation of Text and Discourse with Cohmetrix. Cambridge University Press. [Google Scholar] [CrossRef
[7] Kyle, K., Crossley, S. and Berger, C. (2017) The Tool for the Automatic Analysis of Lexical Sophistication (TAALES): Version 2.0. Behavior Research Methods, 50, 1030-1046. [Google Scholar] [CrossRef] [PubMed]
[8] Crossley, S.A., Kyle, K. and Dascalu, M. (2018) The Tool for the Automatic Analysis of Cohesion 2.0: Integrating Semantic Similarity and Text Overlap. Behavior Research Methods, 51, 14-27. [Google Scholar] [CrossRef] [PubMed]
[9] Shermis, M.D. and Burstein, J. (2013) Handbook of Automated Essay Evaluation: Current Applications and New Directions. Routledge.
[10] 刘应亮, 刘胜蓝, 杨进才. 社会文化活动理论视域下人机协同教学及应用探索——以iWrite协同英语写作教学为例[J]. 中国电化教育, 2022(11): 108-116.
[11] 秦文娟, 周季鸣. 基于写作自动评估的教师反馈素养研究[J]. 外语界, 2023(3): 47-54.
[12] Deane, P. (2013) On the Relation between Automated Essay Scoring and Modern Views of the Writing Construct. Assessing Writing, 18, 7-24. [Google Scholar] [CrossRef
[13] Wilson, J. and Czik, A. (2016) Automated Essay Evaluation Software in English Language Arts Classrooms: Effects on Teacher Feedback, Student Motivation, and Writing Quality. Computers & Education, 100, 94-109. [Google Scholar] [CrossRef
[14] Hockly, N. (2018) Automated Writing Evaluation. ELT Journal, 73, 82-88. [Google Scholar] [CrossRef
[15] 李慧娴, 郑咏滟, 秦文娟. 精细化句法复杂度对写作质量预测效果的研究[J]. 解放军外国语学院学报, 2022, 45(4): 61-69.
[16] 张晓鹏,李雯雯. 句法复杂度对中国大学生英语说明文写作质量的预测效应[J]. 现代外语, 2022(3): 331-343.
[17] Lu, X. (2010) Automatic Analysis of Syntactic Complexity in Second Language Writing. International Journal of Corpus Linguistics, 15, 474-496. [Google Scholar] [CrossRef
[18] Lu, X. (2011) A Corpus‐Based Evaluation of Syntactic Complexity Measures as Indices of College‐Level ESL Writers’ Language Development. TESOL Quarterly, 45, 36-62. [Google Scholar] [CrossRef
[19] Kyle, K. and Crossley, S.A. (2018) Measuring Syntactic Complexity in L2 Writing Using Fine‐grained Clausal and Phrasal Indices. The Modern Language Journal, 102, 333-349. [Google Scholar] [CrossRef
[20] Li, Y. and Yang, R. (2023) Assessing the Writing Quality of English Research Articles Based on Absolute and Relative Measures of Syntactic Complexity. Assessing Writing, 55, Article ID: 100692. [Google Scholar] [CrossRef
[21] Zhang, Z. (2020) Engaging with Automated Writing Evaluation (AWE) Feedback on L2 Writing: Student Perceptions and Revisions. Assessing Writing, 43, Article ID: 100439. [Google Scholar] [CrossRef
[22] Chen, W. and Zhang, M. (2023) Understanding an Assessment Approach in Computer-Mediated Collaborative Writing: Learner Perceptions and Interactions. Language Awareness, 33, 135-162. [Google Scholar] [CrossRef
[23] Evans, N.W., Hartshorn, K.J., Cox, T.L. and Martin de Jel, T. (2014) Measuring Written Linguistic Accuracy with Weighted Clause Ratios: A Question of Validity. Journal of Second Language Writing, 24, 33-50. [Google Scholar] [CrossRef
[24] 吴雪峰, 柳烨琛, 殷缘. 英语写作评分标准模型的建构及其效度研究[J]. 外国语文, 2018(5): 137-146.
[25] 郭茜, 冯瑞玲, 华远方. ChatGPT在英语学术论文写作与教学中的应用及潜在问题[J]. 外语电化教学, 2023(2): 18-23+107.
[26] 魏爽, 李璐遥. 人工智能辅助二语写作反馈研究——以ChatGPT为例[J]. 中国外语, 2023, 20(3): 33-40.
[27] 陈茉, 吕明臣. ChatGPT环境下的大学英语写作教学[J]. 当代外语研究, 2024(1): 161-168.
[28] Li, J., Link, S. and Hegelheimer, V. (2015) Rethinking the Role of Automated Writing Evaluation (AWE) Feedback in ESL Writing Instruction. Journal of Second Language Writing, 27, 1-18. [Google Scholar] [CrossRef
[29] Abdelhalim, S.M. (2023) Online Writing Instruction: Understanding University EFL Instructors’ Beliefs and Practices as a Complex System. Language Teaching Research. [Google Scholar] [CrossRef
[30] Kyle, K., Crossley, S.A. and Jarvis, S. (2020) Assessing the Validity of Lexical Diversity Indices Using Direct Judgements. Language Assessment Quarterly, 18, 154-170. [Google Scholar] [CrossRef
[31] 张洁, 王敏, 陈康. 体裁对读后续写中协同效应和写作质量的影响[J]. 现代外语, 2023, 46(2): 259-269.
[32] Crossley, A.S. and McNamara, S.D. (2016) Say More and Be More Coherent: How Text Elaboration and Cohesion Can Increase Writing Quality. Journal of Writing Research, 7, 351-370. [Google Scholar] [CrossRef
[33] 贾文峰, 张培欣. TEM8写作测试文本的语篇特征与写作质量的关系研究[J]. 外语测试与教学, 2020(1): 1-9.
[34] 冯志伟, 李颖. 自然语言处理中的预训练范式[J]. 外语研究, 2021(1): 1-14+112.