基于眼动视觉情境范式的听理解加工研究
Research on Auditory Comprehension Processing Based on the Visual-World Paradigm
DOI: 10.12677/ml.2025.134407, PDF,    科研立项经费支持
作者: 郑巧斐：金华职业技术大学师范学院，浙江 金华
关键词: 眼动；视觉情境；听理解；习得；Eye Movement； Visual-World； Auditory Comprehension； Acquisition
摘要: 视觉情境范式的兴起以及视听交互理论的发展，为研究者提供了通过眼动模式分析听觉输入加工的新途径。目前，研究者利用视觉情境范式探究了语言加工的语音、词汇和句法层面。这些研究为中国外语听力习得的研究提供了坚实的基础。中国外语教学与习得领域的研究者应勇于采用现代心理学和神经科学技术，如眼动追踪技术，针对中国外语学习者及汉语特点，在听力习得和听力教学领域展开研究。
Abstract: The rise of the visual-world paradigm and the development of audio-visual interaction theories have provided researchers with a new avenue for analyzing auditory input processing through eye-tracking. Currently, researchers have utilized the visual-world paradigm to explore language processing at the levels of phonetics, vocabulary, and syntax. These studies have laid a solid foundation for research on the acquisition of listening acquisition in foreign languages in China. It is imperative that researchers in the field of Chinese foreign language teaching and acquisition embrace modern psychological and neuroscientific research technologies, such as eye-tracking, to conduct research tailored to Chinese foreign language learners and the unique characteristics of the Chinese language in the areas of listening acquisition and instruction.
文章引用：郑巧斐. 基于眼动视觉情境范式的听理解加工研究[J]. 现代语言学, 2025, 13(4): 739-748. https://doi.org/10.12677/ml.2025.134407

参考文献

[1] Bojko, A. 眼动追踪: 用户体验优化操作指南[M]. 葛缨, 何吉波, 译. 北京: 人民邮电出版社, 2019: 9.
[2] Aline, G. (2020) Eye Tracking in Second Language Acquisition and Bilingualism. Routledge, 88.
[3] 闫国利, 白学军. 眼动分析技术的基础与运用[M]. 北京: 北京师范大学出版社, 2018: 11, 116.
[4] Tanenhaus, M.K., Spivey-Knowlton, M.J., Eberhard, K.M. and Sedivy, J.C. (1995) Integration of Visual and Linguistic Information in Spoken Language Comprehension. Science, 268, 1632-1634. [Google Scholar] [CrossRef] [PubMed]
[5] Kamide, Y., Scheepers, C. and Altmann, G.T.M. (2003) Integration of Syntactic and Semantic Information in Predictive Processing: Cross-Linguistic Evidence from German and English. Journal of Psycholinguistic Research, 32, 37-55. [Google Scholar] [CrossRef] [PubMed]
[6] Altmann, G.T.M. and Kamide, Y. (2007) The Real-Time Mediation of Visual Attention by Language and World Knowledge: Linking Anticipatory (and Other) Eye Movements to Linguistic Processing. Journal of Memory and Language, 57, 502-518. [Google Scholar] [CrossRef] 
[7] Allopenna, P.D., Magnuson, J.S. and Tanenhaus, M.K. (1998) Tracking the Time Course of Spoken Word Recognition Using Eye Movements: Evidence for Continuous Mapping Models. Journal of Memory and Language, 38, 419-439. [Google Scholar] [CrossRef] 
[8] Dahan, D., Magnuson, J.S. and Tanenhaus, M.K. (2001) Time Course of Frequency Effects in Spoken-Word Recognition: Evidence from Eye Movements. Cognitive Psychology, 42, 317-367. [Google Scholar] [CrossRef] [PubMed]
[9] Simmons, E.S. and Magnuson, S. (2018) Word Length, Proportion of Overlap, and Phonological Competition in Spoken Word Recognition. Proceedings of the 40th Annual Conference of the Cognitive Science Society. Madison, 25-28 July 2018, 1064-1069.
[10] Hendrickson, K., Spinelli, J. and Walker, E. (2020) Cognitive Processes Underlying Spoken Word Recognition during Soft Speech. Cognition, 198, Article 104196. [Google Scholar] [CrossRef] [PubMed]
[11] 袁周敏, 易保树, 张砚妮. 国外语言学学科眼动研究: 现状与前瞻(1934-2020) [J]. 外语界, 2020(6): 46-53.
[12] Tanenhaus, M.K. and Spivey-Knowlton, M.J. (1996) Eye-Tracking. Language and Cognitive Processes, 11, 583-588. [Google Scholar] [CrossRef] 
[13] Huettig, F. and Altmann, G.T.M. (2005) Word Meaning and the Control of Eye Fixation: Semantic Competitor Effects and the Visual World Paradigm. Cognition, 96, B23-B32. [Google Scholar] [CrossRef] [PubMed]
[14] Chow, J., Aimola Davies, A. and Plunkett, K. (2017) Spoken-Word Recognition in 2-Year-Olds: The Tug of War between Phonological and Semantic Activation. Journal of Memory and Language, 93, 104-134. [Google Scholar] [CrossRef] 
[15] Altmann, G.T.M. and Kamide, Y. (1999) Incremental Interpretation at Verbs: Restricting the Domain of Subsequent Reference. Cognition, 73, 247-264. [Google Scholar] [CrossRef] [PubMed]
[16] Yee, E. and Sedivy, J.C. (2006) Eye Movements to Pictures Reveal Transient Semantic Activation during Spoken Word Recognition. Journal of Experimental Psychology: Learning, Memory, and Cognition, 32, 1-14. [Google Scholar] [CrossRef] [PubMed]
[17] Huettig, F. and McQueen, J.M. (2007) The Tug of War between Phonological, Semantic and Shape Information in Language-Mediated Visual Search. Journal of Memory and Language, 57, 460-482. [Google Scholar] [CrossRef] 
[18] de Groot, F., Huettig, F. and Olivers, C.N.L. (2016) When Meaning Matters: The Temporal Dynamics of Semantic Influences on Visual Attention. Journal of Experimental Psychology: Human Perception and Performance, 42, 180-196. [Google Scholar] [CrossRef] [PubMed]
[19] Rayner, K., Fischer, M.H. and Pollatsek, A. (1998) Unspaced Text Interferes with Both Word Identification and Eye Movement Control. Vision Research, 38, 1129-1144. [Google Scholar] [CrossRef] [PubMed]
[20] 王露, 万鹏, 任桂琴. 汉语口语词汇识别中声调、语境的作用: 来自眼动研究的证据[J]. 心理与行为研究, 2018, 16(2): 150-156.
[21] Moss, H.E. and Marslen-Wilson, W.D. (1993) Access to Word Meanings during Spoken Language Comprehension: Effects of Sentential Semantic Context. Journal of Experimental Psychology: Learning, Memory, and Cognition, 19, 1254-1276. [Google Scholar] [CrossRef] [PubMed]
[22] Salverda, A.P., Kleinschmidt, D. and Tanenhaus, M.K. (2014) Immediate Effects of Anticipatory Coarticulation in Spoken-Word Recognition. Journal of Memory and Language, 71, 145-163. [Google Scholar] [CrossRef] [PubMed]
[23] 卢张龙, 白学军, 闫国利. 汉语词汇识别中词频和可预测性交互作用的眼动研究[J]. 心理研究, 2008, 1(4): 29-33.
[24] 任桂琴, 韩玉昌, 刘颖. 句子语境中汉语词汇识别的即时加工过程[J]. 心理科学进展, 2012, 20(4): 493-503.
[25] Yip, M.C.W. and Zhai, M. (2017) Context Effects and Spoken Word Recognition of Chinese: An Eye‐Tracking Study. Cognitive Science, 42, 1134-1153. [Google Scholar] [CrossRef] [PubMed]
[26] Chambers, C.G. and Cooke, H. (2009) Lexical Competition during Second-Language Listening: Sentence Context, but Not Proficiency, Constrains Interference from the Native Lexicon. Journal of Experimental Psychology: Learning, Memory, and Cognition, 35, 1029-1040. [Google Scholar] [CrossRef] [PubMed]
[27] 杨雯琴, 李荣宝. 中国英语学习者母语加工中的二语竞争激活——来自眼动研究的证据[J]. 外语研究, 2012, 29(4): 34-39, 112.
[28] Bock, J.K. (1986) Syntactic Persistence in Language Production. Cognitive Psychology, 18, 355-387. [Google Scholar] [CrossRef] 
[29] 陈庆荣. 句法启动研究的范式及其在语言理解中的争论[J]. 心理科学进展, 2012, 20(2): 208-218.
[30] 夏赛辉, 汪朋. 句法启动与二语复杂结构学习[J]. 现代外语, 2017, 40(1): 69-79.
[31] Scheepers, C. and Crocker, M.W. (2004) Constituent Order Priming from Reading to Listening: A Visual-World Study. In Carreiras, M. and Clifton, C., Eds., The On-Line Study of Sentence Comprehension: Eye-Tracking, ERP, and Beyond, Psychology Press, 167-187.
[32] Cleland, A. (2003) The Use of Lexical and Syntactic Information in Language Production: Evidence from the Priming of Noun-Phrase Structure. Journal of Memory and Language, 49, 214-230. [Google Scholar] [CrossRef] 
[33] Melinger, A. and Cleland, A.A. (2011) The Influence of Sentential Position on Noun Phrase Structure Priming. Quarterly Journal of Experimental Psychology, 64, 2211-2235. [Google Scholar] [CrossRef] [PubMed]
[34] Arai, M., van Gompel, R.P.G. and Scheepers, C. (2007) Priming Ditransitive Structures in Comprehension. Cognitive Psychology, 54, 218-250. [Google Scholar] [CrossRef] [PubMed]
[35] Thothathiri, M. and Snedeker, J. (2008) Give and Take: Syntactic Priming during Spoken Language Comprehension. Cognition, 108, 51-68. [Google Scholar] [CrossRef] [PubMed]
[36] 陈广耀, 张维, 陈庆, 等. 类别型状态不确定独立否定句的加工机制: 来自眼动实验的证据[J]. 心理学报, 2014, 46(10): 1426-1441.
[37] 陈广耀, 陈颖心, 邓玉梅, 等. 结果不确定离散型否定句加工机制: 锚激活与限制满足模型的修正与补充[J]. 心理科学, 2016, 39(5): 1064-1070.
[38] 陈广耀, 何先友, 刘涛. 强弱语义语境下的否定句加工机制[J]. 心理学报, 2018, 50(2): 186-196.
[39] Chun, E. and Kaan, E. (2019) L2 Prediction during Complex Sentence Processing. Journal of Cultural Cognitive Science, 3, 203-216. [Google Scholar] [CrossRef] 
[40] Chambers, C.G., Tanenhaus, M.K. and Magnuson, J.S. (2004) Actions and Affordances in Syntactic Ambiguity Resolution. Journal of Experimental Psychology: Learning, Memory, and Cognition, 30, 687-696. [Google Scholar] [CrossRef] [PubMed]
[41] Knoeferle, P., Crocker, M.W., Scheepers, C. and Pickering, M.J. (2005) The Influence of the Immediate Visual Context on Incremental Thematic Role-Assignment: Evidence from Eye-Movements in Depicted Events. Cognition, 95, 95-127. [Google Scholar] [CrossRef] [PubMed]
[42] Sussman, R.S. and Sedivy, J. (2003) The Time-Course of Processing Syntactic Dependencies: Evidence from Eye Movements. Language and Cognitive Processes, 18, 143-163. [Google Scholar] [CrossRef] 
[43] Chambers, C.G. and Juan, V.S. (2008) Perception and Presupposition in Real-Time Language Comprehension: Insights from Anticipatory Processing. Cognition, 108, 26-50. [Google Scholar] [CrossRef] [PubMed]
[44] Huettig, F., Rommers, J. and Meyer, A.S. (2011) Using the Visual World Paradigm to Study Language Processing: A Review and Critical Evaluation. Acta Psychologica, 137, 151-171. [Google Scholar] [CrossRef] [PubMed]
[45] van Hell, J.G. and Tanner, D. (2012) Second Language Proficiency and Cross‐Language Lexical Activation. Language Learning, 62, 148-171. [Google Scholar] [CrossRef] 
[46] Farris-Trimble, A. and McMurray, B. (2013) Test-Retest Reliability of Eye Tracking in the Visual World Paradigm for the Study of Real-Time Spoken Word Recognition. Journal of Speech, Language, and Hearing Research, 56, 1328-1345. [Google Scholar] [CrossRef] [PubMed]
[47] Sajin, S.M. (2016) Language-Vision Interactions in the Visual World Paradigm: Examining the Effects of Display and Working Memory. Ph.D. Thesis, Binghamton University.
[48] 陈平. 语言交叉学科研究的理论与实践[J]. 语言战略研究, 2021, 6(1): 13-25.