自动语法检查方法研究述评
An Overview of the Methods on Automatic Detection of Grammatical Errors
DOI: 10.12677/CSA.2018.89149, PDF,    国家科技经费支持
作者: 陈 功*:对外经济贸易大学英语学院,北京;王 健:杭州绿湾网络科技有限公司,浙江 杭州
关键词: 语法错误自动语法检查基于规则基于统计Grammatical Errors Automatic Grammar Checking Rule-Based Statistic-Based
摘要: 语法错误自动检查是自然语言处理领域的重要研究课题。尽管前人已经在该领域积累了丰富的经验,但是针对中国学生的英语语法错误自动检查研究尚处在初级阶段。本文对国外自动语法检查系统的理论和方法进行了梳理,详细描述了已有研究所采用的两大主流方法——基于规则的方法和基于统计的方法,并对这两者的优势和问题进行了评述。最后本文指出了今后自动语法检查系统可能采用的方法,并进行了试验,旨在对中国学生英语语法错误自动检查系统的开发提供启示。
Abstract: Automatic detection of grammatical errors is an important research topic in the field of natural language processing. Although previous researches have accumulated a wealth of experience in this field, the automatic detection of grammatical errors for Chinese EFL learners’ English is still in its early stages. By reviewing the theories and methods of the relevant studies, this paper elaborates the two main methods used in the previous researches, i.e. the rule-based approach and the statistic-based approach, and makes a comment on their advantages and potential problems. Finally, the paper puts forward a possible hybrid method of building a system and makes a test, aiming to help develop a grammatical error checking system for Chinese EFL learners.
文章引用:陈功, 王健. 自动语法检查方法研究述评[J]. 计算机科学与应用, 2018, 8(9): 1372-1381. https://doi.org/10.12677/CSA.2018.89149

参考文献

[1] Naber, D. (2003) A Rule-Based Style and Grammar Checker. MS Thesis. Universität Bielefeld, Bielefeld, 4, 7.
[2] Vandeventer-Faltin, A. (2003) Syntactic Error Diagnosis in the Context of Computer-Assisted Language Learning. PhD Dis-sertation, University of Geneva, Geneva, 9, 43, 71.
[3] Han, N., Tetreault, J., Lee, S., et al. (2010) Using Error-Annotated ESL Data to Develop an ESL Error Correction System. Proceedings of the Seventh International Conference on Language Resources and Evalu-ation (LREC), 763-770.
[4] Han, N., Chodorow, M. and Leacock, C. (2006) Detecting Errors in English Article Usage by Non-Native Speakers. Natural Language Engineering, 12, 115-129. [Google Scholar] [CrossRef
[5] MacDonald, N.H., Lawrence, T.F., Patricia, S.G., et al. (1982) The Writer’s Workbench: Computer Aids for Text Analysis. IEEE Transactions on Communications, 30, 172-179. [Google Scholar] [CrossRef
[6] Pusack, J.P. (1984) Answer Processing and Error Correction in Foreign Language CAL. In: Wyatt, D.H., Ed., Computer-Assisted Language Instruction, Pergamon Press, Oxford, 63.
[7] Leacock, C., Chodorow, M., Gamon, M. and Tetreault, J. (2010) Automated Grammatical Error Detection for Language Learners. Morgan & Clay-pool Publishers, San Rafael, 5-6, 12-13.
[8] 冯志伟. 自然语言处理的形式模型[M]. 合肥: 中国科学技术大学出版社, 2010: 21, 33, 174.
[9] Dodigovic, M. (2005) Artificial Intelligence in Second Language Learning: Raising Error Awareness. Multilingual Mat-ters Ltd., Clevedon, 108.
[10] 刘海涛. 依存语法的理论与实践[M]. 北京: 科学出版社, 2009: 156-157.
[11] Holland, M., Mai-sano, R., Alderks, C. and Martin, J. (1993) Parsers in Tutors: What Are They Good for? CALICO Journal, 11, 28-46.
[12] Schulze, M. (1999) From the Developer to the Learner: Describing Grammar-Learning Grammar. ReCALL Journal, 11, 117-124. [Google Scholar] [CrossRef
[13] 龚小谨, 罗振声, 骆卫华. 中文文本自动校对中的语法错误检查[J]. 计算机工程与应用, 2003(8): 98-100, 127.
[14] Liou, H. (1991) Development of an English Grammar Checker: A Progress Report. CALICO Journal, 9, 57-70.
[15] Rypa, M. and Feurman, K. (1995) CALLE: An Exploratory Environment for Foreign Language Learning. In: Holland, et al., Eds., Intelligent Language Tutors. Lawrence Erlbaum, Mahwah, 55-76.
[16] Matthews, C. and Fox, J. (1991) Foundations of ICALL—An Overview of Student Modeling. Proceedings of Eurocall, 163-170.
[17] Chen, S. and Xu, L. (1990) Grammar-Debugger: A Parser for Chinese EFL Learners. CALICO Journal, 8, 63-75.
[18] Vosse, T. (1992) Detecting and Correcting Morpho-Syntactic Errors in Real Texts. The Proceedings of the 3rd Conference on Applied Natural Language Processing, Trento, 31 March-3 April 1992, 111-118. [Google Scholar] [CrossRef
[19] Catt, M. and Graeme, H. (1990) An Intelligent CALL System for Grammatical Error Diagnosis. Computer Aided Language Learning, 3, 3-26. [Google Scholar] [CrossRef
[20] Sanders, A.F. and Sanders, R.H. (1989) Syntactic Parsing: A Survey. Computer and the Humanities, 23, 13-30. [Google Scholar] [CrossRef
[21] Weischede, R.M., Voge, W.M. and James, M. (1978) An Artificial Intelligence Ap-proach to Language Instruction. Artificial Intelligence, 10, 225-240. [Google Scholar] [CrossRef
[22] Schwind, C.B. (1995) Error Analysis and Explanation in Knowledge Based Language Tutoring. Computer Assisted Language Learning, 8, 295-324. [Google Scholar] [CrossRef
[23] Yazdani, M. (1991) The LINGER Project: An Artificial Intelligence Approach to Second-Language Tutoring. Computer Assisted Language Learning, 4, 107-116. [Google Scholar] [CrossRef
[24] Schneider, D. and McCoy, K. (1998) Recognizing Syntactic Errors in the Writ-ing of Second Language Learners. Proceedings of the 36th Annual Meeting of the Association for Computational Linguistics (ACL) and the 17th International Conference on Computational Linguistics, 1198-1204.
[25] Carlberger, J., Domeij, R., Kann, V. and Knutsson, O. (2000) A Swedish Grammar Checker. http://www.csc.kth.se/tcs/projects/granska/rapporter/compling20000419.ps
[26] Rider, Z. (2005) Grammar Checking Using POS Tagging and Rules Matching. Proceedings of the Class of 2005 Senior Conference, 14-19.
[27] Murphy, M., Kruger, A. and Grieszl, A. (1998) RECALL—Providing an Individualized CALL Environment. In: Jager, S., Nerboone, J. and Essen, A.V., Eds., Language Teaching and Language Technology, Routledge, London & New York, 62-73.
[28] Sanders, R.H. (1991) Error Analysis in Purely Syntactic Parsing of Free Input: The Example of German. CALICO Journal, 5, 77-86.
[29] Knight, K. and Chander, I. (1994) Auto-mated Post Editing of Documents. Proceedings of the 12th National Conference on Artificial Intelligence, Seattle, 31 July-4 August 1994, 779-784.
[30] Chodorow, M., Tetreault, J. and Han, N. (2007) Detection of Grammatical Errors Involving Prepositions. Pro-ceedings of the 4th ACL-SIGSEM Workshop on Prepositions, Prague, 28 June 2007, 25-30. [Google Scholar] [CrossRef
[31] Gamon, M., Gao, J., Brockett, C., et al. (2008) Using Contextual Speller Tech-niques and Language Modeling for ESL Error Correction. Proceedings of the International Joint Conference on Natural Language Processing, Hyderabad, 7-12 January 2008, 449-456.
[32] Bergsma, S., Lin, D. and Goebel, R. (2009) Web-Scale n-Gram Models for Lexical Disambiguation. Proceedings of the 21st International Joint Conference on Artificial Intelligence, Pasadena, 11-17 July 2009, 1507-1512.
[33] 邢永康, 马少平. 统计语言模型综述[J]. 计算机科学, 2003, 30(9): 22-26.
[34] 邢富坤, 程东元. 基于统计语言模型的英语易读性研究[J]. 解放军外国语学院学报, 2010, 33(6): 19-24.
[35] Atwell, E.S. (1987) How to Detect Grammatical Errors in a Text without Parsing It. Proceedings of the 3rd Conference of the European Association for Computational Linguistics, Copenhagen, 1-3 April 1987, 38-45. [Google Scholar] [CrossRef
[36] Nagata, R., Iguchi, T., Masui, F., et al. (2005) A Statistical Model Based on the Three Head Words for Detecting Article Errors. Transactions on Information and Systems, 7, 1700-1706. [Google Scholar] [CrossRef
[37] Lee, J. and Seneff, S. (2006) Automatic Grammar Correction for Sec-ond-Language Learners. Proceedings of the 9th International Conference on Spoken Language Processing, Pittsburgh, 17-21 Septem-ber 2006, 1978-1981.
[38] Yarowsky, D. (1994) Decision Lists for Lexical Ambiguity Resolution: Application to Accent Restoration in Spanish and French. Proceedings of the 32nd Annual Meeting of the Association for Computational Linguistics, Las Cruces, 27-30 June 1994, 88-95. [Google Scholar] [CrossRef
[39] Foster, J. and Andersen, Ø. (2009) GenERRate: Generating Er-rors for Use in Grammatical Error Detection. Proceedings of the 4th Workshop on Building Educational Applications Using NLP, Boulder, 5 June 2009, 82-90. [Google Scholar] [CrossRef
[40] Lee, J., Zhou, M. and Lin, X. (2007) Detection of Non-Native Sentences Using Machine-Translated Training Data. Proceedings of the Annual Conference of the North American Chapter of the Association for Com-putational Linguistics, Rochester, 22-27 April 2007, 93-97. [Google Scholar] [CrossRef
[41] Yi, X., Gao, J. and Dolan, W.B. (2008) A Web-Based English Proofing System for English as a Second Language Users. Proceedings of the International Joint Conference on Natural Language Processing, Hyderabad, 7-12 January 2008, 619-624.
[42] Chodorow, M. and Leacock, C. (2000) An Unsupervised Method for Detecting Grammatical Errors. Proceedings of the Conference of the North American Chapter of the Association of Computational Linguistics, 140-147.
[43] 李霞, 刘建达. 适用于中国外语学习者的英文作文全自动集成评分算法[J]. 中文信息学报, 2013, 27(5): 100-106.
[44] Gamon, M., Leacock, C., Brockett, C., et al. (2009) Using Statistical Techniques and Web Search to Correct ESL Errors. CALICO Journal, 26, 491-511. [Google Scholar] [CrossRef
[45] 张仰森, 丁冰青. 中文文本自动校对技术现状及展望[J]. 中文信息学报, 1998, 3(12): 50-56.
[46] Francis, G., Hunston, S. and Manning, E. (1996) Collins COBUILD Grammar Patterns 1: Verbs. HarperCollins, London.
[47] Hunston, S. and Francis, G. (2000) Pattern Grammar: A Corpus-Driven Approach to the Lexical Grammar of English. John Benjamins, Amsterdam/Philadelphia. [Google Scholar] [CrossRef
[48] 梁茂成. 理性主义, 经验主义与语料库语言学[J]. 中国外语, 2010(4): 90-97.
[49] Francis, G. and Sinclair, J.M. (1994) “I Bet He Drinks Carling Black Label”: A Riposte to Owen on Corpus Grammar. Applied Linguistic, 15, 190-200. [Google Scholar] [CrossRef
[50] Xiao, R. (2009) Theory-Driven Corpus Research: Using Corpora to Inform Aspect Theory. In: Lüdeling, A. and Kytö, M., Eds., Corpus Linguistics: An International Handbook, Volume 2, Mouton de Gruyter, Berlin, 987-1007.