关于影响托福写作自动化阅卷工具E-Rater评分因素的实证研究
Factors That Affect the Automated Scoring Engine E-Rater in the TOEFL Writing Section: An Empirical Study
摘要: 本研究通过分析ETS和新东方合作的e-rater评分系统,通过控制变量和数据分析,探讨e-rater针对不同特征的作文评分情况,比如:1) 文章字数和文章得分的关联度;2) 文章分段和文章得分的关联度;3) 文章衔接词数量和文章得分的关联度;4) 文章错误数量和文章得分的关联度;5) 文章错误种类和文章得分的关联度;6) 文章平均词句长度和文章得分的关联度等等。
Abstract: By analyzing the ETS e-rater scoring system which is now available on the New Oriental TPO website, and by analyzing the control variables and data, this study discusses the scoring performance of ETS e-rater mainly targeted at compositions with different characteristics, such as: 1) the correlation between the number of words and the essay scores; 2) the correlation between paragraph organization and the essay scores; 3) the correlation between the number of cohesive connectors and the essay scores; 4) the correlation between the number of errors and the essay scores; 5) the correla-tion between the types of error and the essay scores; 6) the correlation between the average sentence and word length and the essay scores.
文章引用:李丰贤. 关于影响托福写作自动化阅卷工具E-Rater评分因素的实证研究[J]. 国外英语考试教学与研究, 2021, 3(3): 104-118. https://doi.org/10.12677/OETPR.2021.33012

参考文献

[1] 杜璟, 冷楠. 对GRE写作自动化评分器e-rater评分准确性的实证研究[J]. 国外英语考试教学与研究, 2020, 2(3): 140-148. [Google Scholar] [CrossRef
[2] Quinlan, T., Higgins, D. and Wolff, S. (2009) Evaluating the Construct Coverage of the E-Rater® Scoring Engine. ETS, Princeton, NJ. [Google Scholar] [CrossRef
[3] https://tpo.xdf.cn/question-analysis/write?quesNo=1&qId=23504&activeT-ab=video
[4] https://tpo.xdf.cn/question-analysis/write?quesNo=1&qId=23540&activeTab=video
[5] http://www.readabilityformulas.com/free-readability-formula-tests.php
[6] An Investigation of the e-rater® Automated Scoring Engine’s Gram-mar, Usage, Mechanics, and Style Microfeatures and Their Aggregation Model, ETS. https://files.eric.ed.gov/fulltext/EJ1168485.pdf