句子理解过程中心理模拟研究进展
The Developments of Mental Simulation Research in Sentence Comprehension
摘要: 心理模拟是指在语言理解中语言材料所描述感觉–运动经验的重新激活,具身语言观认为该过程在语言意义的构建中发挥着重要的作用。本文主要关注句子层面的心理模拟过程,在回顾以往研究的基础上,总结了近年来该领域研究的新进展。主要表现为:在研究范式上,所探究问题的深度不断增加。在研究内容上,所研究范围逐渐拓展。未来研究可进一步将心理模拟的研究范围拓展到触觉、味觉模态,进一步厘清不同研究范式之间的差异性,考虑语言形式与心理模拟在语言理解中的相互作用。
Abstract: Mental simulation refers to the reactivation of sensory-motor experience described by language materials in language comprehension. The embodied view of language understanding holds that this process plays an essential role in the construction of linguistic meaning. This paper focuses on the process of mental simulation at sentence level, and summarizes the recent advances in this field based on the review of previous studies. It mainly includes the following two aspects: 1) In the research paradigm, the depth of exploration has gradually increased; 2) In terms of research content, the scope of research has gradually expanded. Future research can further expand the scope of mental simulation to touch and taste modality, further clarify the differences between different research paradigms, and consider the interaction between language form and mental simulation in language comprehension.
文章引用:周广方, 金花 (2023). 句子理解过程中心理模拟研究进展. 心理学进展, 13(5), 2019-2029. https://doi.org/10.12677/AP.2023.135249

参考文献

[1] 韩冬, 叶浩生(2014). 重中之“重”——具身视角下重的体验与表征. 心理科学进展, 22(6), 918-925.
[2] 刘文娟, 李莹, 王瑞明(2015). 感知运动信息在概念表征中的作用. 心理科学, (6), 1347-1352.
[3] 曲方炳, 殷融, 钟元, 叶浩生(2012). 语言理解中的动作知觉: 基于具身认知的视角. 心理科学进展, 20(6), 834-842.
[4] 苏得权, 叶浩生(2013). 大脑理解语言还是身体理解语言——具身认知视角下的语义理解. 华中师范大学学报(人文社会科学版), (6), 189-194.
[5] 殷融, 曲方炳, 叶浩生(2012). 具身概念表征的研究及理论述评. 心理科学进展, 20(9), 1372-1381.
[6] 殷融, 叶浩生(2013). 语言与情境仿真理论: 概念与展望. 心理学探新, (4), 308-314.
[7] 张恩涛, 方杰, 林文毅, 罗俊龙(2013). 抽象概念表征的具身认知观. 心理科学进展, 21(3), 429-436.
[8] 周继(2019). 基于CFS范式的空间朝向属性对意识下视觉的影响研究. 硕士学位论文, 昆明: 云南大学.
[9] Bai, B., Yang, C., & Fan, J. (2021). Semantic Integration of Multidimensional Perceptual Information in L1 Sentence Comprehension. Language and Cognition, 14, 109-130.[CrossRef
[10] Barsalou, L. W. (1999). Perceptions of Perceptual Symbols. Behavioral and Brain Sciences, 22, 637-660.[CrossRef
[11] Barsalou, L. W. (2009). Simulation, Situated Conceptualization, and Prediction. Philosophical Transactions of the Royal Society B: Biological Sciences, 364, 1281-1289.[CrossRef] [PubMed]
[12] Barsalou, L. W., Santos, A., Simmons, W. K., & Wilson, C. D. (2008). Language and Simulation in Conceptual Processing. In M. de Vega, A. Glenberg, & A. Graesser (Eds.), Symbols and Embodiment: Debates on Meaning and Cognition (pp. 245-283). Oxford Academic.[CrossRef
[13] Bedny, M., & Saxe, R. (2012). Insights into the Origins of Knowledge from the Cognitive Neuroscience of Blindness. Cognitive Neuropsychology, 29, 56-84.[CrossRef] [PubMed]
[14] Bedny, M., Koster-Hale, J., Elli, G., Yazzolino, L., & Saxe, R. (2019). There’s More to “Sparkle” than Meets the Eye: Knowledge of Vision and Light Verbs among Congenitally Blind and Sighted Individuals. Cognition, 189, 105-115.[CrossRef] [PubMed]
[15] Bobrow, D. G., & Winograd, T. (1977). An Overview of KRL, a Knowledge Representation Language. Cognitive Science, 1, 3-46.[CrossRef
[16] Bottini, R., Ferraro, S., Nigri, A., Cuccarini, V., Bruzzone, M. G., & Collignon, O. (2020). Brain Regions Involved in Conceptual Retrieval in Sighted and Blind People. Journal of Cognitive Neuroscience, 32, 1009-1025.[CrossRef] [PubMed]
[17] Brunye, T. T., Ditman, T., Mahoney, C. R., Walters, E. K., & Taylor, H. A. (2010). You Heard It Here First: Readers Mentally Simulate Described Sounds. Acta Psychologica, 135, 209-215.[CrossRef] [PubMed]
[18] Chen, D., Wang, R., Zhang, J., & Liu, C. (2020). Perceptual Representations in L1, L2 and L3 Comprehension: Delayed Sentence-Picture Verification. Journal of Psycholinguistic Research, 49, 41-57.[CrossRef] [PubMed]
[19] Chen, S. C., de Koning, B. B., & Zwaan, R. A. (2020). Does Object Size Matter with Regard to the Mental Simulation of Object Orientation? Experimental Psychology, 67, 56-72.[CrossRef] [PubMed]
[20] Connell, L., & Lynott, D. (2009). Is a Bear White in the Woods? Parallel Representation of Implied Object Color during Language Comprehension. Psychonomic Bulletin & Review, 16, 573-577.[CrossRef
[21] de Koning, B. B., Bos, L. T., Wassenburg, S. I., & Van der Schoot, M. (2016). Effects of a Reading Strategy Training Aimed at Improving Mental Simulation in Primary School Children. Educational Psychology Review, 29, 869-889.[CrossRef
[22] de Koning, B. B., Wassenburg, S. I., Bos, L. T., & Van der Schoot, M. (2017a). Mental Simulation of Four Visual Object Properties: Similarities and Differences as Assessed by the Sentence-Picture Verification Task. Journal of Cognitive Psychology, 29, 420-432.[CrossRef
[23] de Koning, B. B., Wassenburg, S. I., Bos, L. T., & Van der Schoot, M. (2017b). Size Does Matter: Implied Object Size Is Mentally Simulated during Language Comprehension. Discourse Processes, 54, 493-503.[CrossRef
[24] Dove, G. (2016). Three Symbol Ungrounding Problems: Abstract Concepts and the Future of Embodied Cognition. Psychonomic Bulletin & Review, 23, 1109-1121.[CrossRef] [PubMed]
[25] Engelen, J. A., Bouwmeester, S., de Bruin, A. B., & Zwaan, R. A. (2011). Perceptual Simulation in Developing Language Comprehension. Journal of Experimental Child Psychology, 110, 659-675.[CrossRef] [PubMed]
[26] Hoeben Mannaert, L. N., Dijkstra, K., & Zwaan, R. A. (2017). Is Color an Integral Part of a Rich Mental Simulation? Memory & Cognition, 45, 974-982.[CrossRef] [PubMed]
[27] Hoeben Mannaert, L. N., Dijkstra, K., & Zwaan, R. A. (2019). How Are Mental Simulations Updated across Sentences? Memory & Cognition, 47, 1201-1214.[CrossRef] [PubMed]
[28] Hoeben Mannaert, L. N., Dijkstra, K., & Zwaan, R. A. (2020). Object Combination in Mental Simulations. Quarterly Journal of Experimental Psychology, 73, 1796-1806.[CrossRef] [PubMed]
[29] Hoeben Mannaert, L. N., Dijkstra, K., & Zwaan, R. A. (2021). Is Color Continuously Activated in Mental Simulations across a Broader Discourse Context? Memory & Cognition, 49, 127-147.[CrossRef] [PubMed]
[30] Horchak, O. V., & Garrido, M. V. (2020). Is Complex Visual Information Implicated during Language Comprehension? The Case of Cast Shadows. Cognitive Science, 44, e12870.[CrossRef] [PubMed]
[31] Horchak, O. V., & Garrido, M. V. (2021). Dropping Bowling Balls on Tomatoes: Representations of Object State-Changes during Sentence Processing. Journal of Experimental Psychology: Learning, Memory, and Cognition, 47, 838-857.[CrossRef] [PubMed]
[32] Kan, I. P., Barsalou, L. W., Solomon, K. O., Minor, J. K., & Thomp-son-Schill, S. L. (2003). Role of Mental Imagery in a Property Verification Task: FMRI Evidence for Perceptual Representations of Conceptual Knowledge. Cognitive Neuropsychology, 20, 525-540.[CrossRef] [PubMed]
[33] Kim, J. S., Elli, G. V., &Bedny, M. (2019). Knowledge of Animal Appearance among Sighted and Blind Adults. Proceedings of the National Academy of Sciences, 116, 11213-11222.[CrossRef] [PubMed]
[34] Koster, D., Cadierno, T., & Chiarandini, M. (2018). Mental Simulation of Object Orientation and Size: A Conceptual Replication with Second Language Learners. Journal of the European Second Language Association, 2, 38-48.[CrossRef
[35] Landauer, T. K., & Dumais, S. T. (1997). A solution To Plato’s Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. Psychological Review, 104, 211-240.[CrossRef
[36] Lupyan, G., & Ward, E. J. (2013). Language Can Boost Otherwise Unseen Objects into Visual Awareness. Proceedings of the National Academy of Sciences, 110, 14196-14201.[CrossRef] [PubMed]
[37] Madden, C. J., & Dijkstra, K. (2010). Contextual Constraints in Situation Model Construction: An Investigation of Age and Reading Span. Aging, Neuropsychology, and Cognition, 17, 19-34.[CrossRef] [PubMed]
[38] Madden, C. J., & Zwaan, R. A. (2006). Perceptual Representation as a Mechanism of Lexical Ambiguity Resolution: An Investigation of Span and Processing Time. Journal of Experimental Psychology: Learning, Memory, and Cognition, 32, 1291-1303.[CrossRef] [PubMed]
[39] Mahon, B. Z., & Caramazza, A. (2008). A Critical Look at the Embodied Cognition Hypothesis and a New Proposal for Grounding Conceptual Content. Journal of Physiology-Paris, 102, 59-70.[CrossRef] [PubMed]
[40] Majid, A., Roberts, S. G., Cilissen, L., Emmorey, K., Nicodemus, B., O’Grady, L., & Levinson, S. C. (2018). Differential Coding of Perception in the World’s Languages. Proceedings of the National Academy of Sciences, 115, 11369-11376.[CrossRef] [PubMed]
[41] Ortega, G., & Ostarek, M. (2021). Evidence for Visual Simulation during Sign Language Processing. Journal of Experimental Psychology: General, 150, 2158-2166.[CrossRef] [PubMed]
[42] Ostarek, M., & Bottini, R. (2021). Towards Strong Inference in Research on Embodiment—Possibilities and Limitations of Causal Paradigms. Journal of Cognition, 4, 5.[CrossRef] [PubMed]
[43] Ostarek, M., & Huettig, F. (2017). Spoken Words Can Make the Invisible Visible-Testing the Involvement of Low-Level Visual Representations in Spoken Word Processing. Journal of Experimental Psychology: Human Perception and Performance, 43, 499-508.[CrossRef] [PubMed]
[44] Ostarek, M., & Huettig, F. (2019). Six Challenges for Embodiment Research. Current Directions in Psychological Science, 28, 593-599.[CrossRef
[45] Ostarek, M., & Vigliocco, G. (2017). Reading Sky and Seeing a Cloud: On the Relevance of Events for Perceptual Simulation. Journal of Experimental Psychology: Learning, Memory, and Cognition, 43, 579-590.[CrossRef] [PubMed]
[46] Ostarek, M., Joosen, D., Ishag, A., de Nijs, M., & Huettig, F. (2019). Are Visual Processes Causally Involved in “Perceptual Simulation” Effects in the Sentence-Picture Verification Task? Cognition, 182, 84-94.[CrossRef] [PubMed]
[47] Pecher, D., Dantzig, S. V., Zwaan, R. A., & Zeelenberg, R. (2009). Language Comprehenders Retain Implied Shape and Orientation of Objects. Quarterly Journal of Experimental Psychology, 62, 1108-1114.[CrossRef] [PubMed]
[48] Peleg, O., Ozer, R., Norman, T., & Segal, O. (2018). Perceptual Simulations during Sentence Comprehension: A Comparison between Typical Adolescents and Adolescents with Autism Spectrum Disorder. Journal of Neurolinguistics, 45, 36-44.[CrossRef
[49] Platt, J. R. (1964). Strong Inference: Certain Systematic Methods of Scientific Thinking May Produce Much More Rapid Progress than Others. Science, 146, 347-353.[CrossRef] [PubMed]
[50] Richter, T., & Zwaan, R. A. (2010). Integration of Perceptual Information in Word Access. Quarterly Journal of Experimental Psychology, 63, 81-107.[CrossRef] [PubMed]
[51] Rommers, J., Meyer, A. S., & Huettig, F. (2013). Object Shape and Orientation Do Not Routinely Influence Performance during Language Processing. Psychological Science, 24, 2218-2225.[CrossRef] [PubMed]
[52] San Roque, L., Kendrick, K. H., Norcliffe, E., Brown, P., Defina, R., Dingemanse, M., & Majid, A. (2015). Vision Verbs Dominate in Conversation across Cultures, but the Ranking of Non-Visual Verbs Varies. Cognitive Linguistics, 26, 31-60.[CrossRef
[53] Saysani, A., Corballis, M. C., & Corballis, P. M. (2018). Colour Envisioned: Concepts of Colour in the Blind and Sighted. Visual Cognition, 26, 382-392.[CrossRef
[54] Setic, M., & Domijan, D. (2017). Numerical Congruency Effect in the Sentence-Picture Verification Task. Experimental Psychology, 64, 159-169.[CrossRef] [PubMed]
[55] Solomon, K. O., & Barsalou, L. W. (2004). Perceptual Simulation in Property Verification. Memory & Cognition, 32, 244-259.[CrossRef
[56] Sorabji, R. (1971). Aristotle on Demarcating the Five Senses. The Philosophical Review, 80, 55-79.[CrossRef
[57] Speed, L. J., & Majid, A. (2018). An Exception to Mental Simulation: No Evidence for Embodied Odor Language. Cognitive Science, 42, 1146-1178.[CrossRef] [PubMed]
[58] Speed, L. J., & Majid, A. (2019). Grounding Language in the Neglected Senses of Touch, Taste, and Smell. Cognitive Neuropsychology, 37, 363-392.[CrossRef] [PubMed]
[59] Stanfield, R. A., & Zwaan, R. A. (2001). The Effect of Implied Orientation Derived from Verbal Context on Picture Recognition. Psychological Science, 12, 153-156.[CrossRef] [PubMed]
[60] Thelen, E., Schöner, G., Scheier, C., & Smith, L. B. (2001). The Dynamics of Embodiment: A Field Theory of Infant Perseverative Reaching. Behavioral and Brain Sciences, 24, 1-34.[CrossRef
[61] Wang, X., Men, W., Gao, J., Caramazza, A., & Bi, Y. (2020). Two Forms of Knowledge Representations in the Human Brain. Neuron, 107, 383-393e385.[CrossRef] [PubMed]
[62] Wang, X., Peelen, M. V., Han, Z., He, C., Caramazza, A., & Bi, Y. (2015). How Visual Is the Visual Cortex? Comparing Connectional and Functional Fingerprints between Congenitally Blind and Sighted Individuals. Journal of Neuroscience, 35, 12545-12559.[CrossRef
[63] Winter, B., & Bergen, B. (2012). Language Comprehenders Represent Object Distance both Visually and Auditorily. Language and Cognition, 4, 1-16.[CrossRef
[64] Yaxley, R. H., & Zwaan, R. A. (2007). Simulating Visibility during Language Comprehension. Cognition, 105, 229-236.[CrossRef] [PubMed]
[65] Zwaan, R. A., & Pecher, D. (2012). Revisiting Mental Simulation in Language Comprehension: Six Replication Attempts. PLOS ONE, 7, e51382.[CrossRef] [PubMed]
[66] Zwaan, R. A., Stanfield, R. A., & Yaxley, R. H. (2002). Language Comprehenders Mentally Represent the Shapes of Objects. Psychological Science, 13, 168-171.[CrossRef] [PubMed]