听觉注意负荷对视听整合的影响
Effects of Auditory Load on Audiovisual Integration
DOI: 10.12677/AP.2021.118217, PDF,  被引量   
作者: 毕浚皓, 李君缘, 平 航, 罗 瑞, 刘铸汉:贵州中医药大学人文与管理学院,贵州 贵阳
关键词: 听觉负荷视听整合竞争模型注意负荷Auditory Load Audiovisual Integration Race Model Attention Resources
摘要: 由于听觉负荷控制范式的不同,听觉负荷对视听整合影响尚存争议。本研究采用RSVP范式操纵听觉负荷(低负荷、中负荷、高负荷),通过设置0%、30%和70%三种干扰刺激同时呈现比例考察不同负荷对视听整合的影响。结果发现,除视觉通道下高负荷反应时显著低于低负荷外,其余通道不同负荷间反应时、击中率均无显著差异;不同负荷间视听结合较单独视、听觉反应时更低、击中率更高;竞争模型进一步研究表明,低负荷下发生视听整合效应(p < 0.05),中负荷下视听整合时程缩短、峰值降低、窗口期提前,高负荷下未发生视听整合。结果表明,视听整合效应受听觉负荷影响显著,随负荷增加而降低直至消失。
Abstract: The effect of auditory load on audiovisual integration is still controversial due to the different auditory load control paradigms. To clarify the impact of auditory load on audiovisual integration, the RSVP paradigm was used to manipulate the auditory load in this study (low load, medium load, high load), and three kinds of interference stimulus presentation ratios of 0%, 30% and 70% were presented to investigate the effects of these on the audiovisual integration. The results showed that there were no significant differences in response time and hit rate between different loads in visual and auditory channels; except that the response time under high load was significantly lower than that under low load in visual channel. The response time of audiovisual was lower than that of visual and auditory alone, but the hit rate, under different load. A further study of Race model shows that audiovisual integration effect occurs under low load (p < 0.05), and the duration of audiovisual integration was shortened, the peak value was reduced, of course the window period was advanced under medium load. Under high load, no audiovisual integration occurred. The results showed that the audiovisual integration effect was significantly affected by the auditory load, and decreased until disappeared with the increase of the auditory load.
文章引用:毕浚皓, 李君缘, 平航, 罗瑞, 刘铸汉 (2021). 听觉注意负荷对视听整合的影响. 心理学进展, 11(8), 1934-1940. https://doi.org/10.12677/AP.2021.118217

参考文献

[1] 崔俭俭(2020). 不同难度的视觉任务认知决策过程脑机制的研究. 硕士学位论文, 郑州: 郑州大学.
[2] 顾吉有(2016). 注意对视听整合加工的影响. 博士学位论文, 天津: 天津师范大学.
[3] 吴彦文, 游旭群, 李海霞(2014). 注意力资源限制与双任务的相互干扰机制. 心理学报, 46(2), 174-184.
[4] 张迎(2006). 大脑视觉通路在不同注意任务难度下的ERP研究. 硕士学位论文, 天津: 河北工业大学.
[5] Alsius, A., Navarra, J., & Soto-Faraco, S. (2007). Attention to Touch Weakens Audiovisual Speech Integration. Experimental Brain Research, 183, 399-404.[CrossRef] [PubMed]
[6] Alsius, A., Navarra, J., Campbell, R., & Soto-Faraco, S. (2005). Audiovisual Integration of Speech Falters under High Attention Demands. Current Biology CB, 15, 839-843.[CrossRef] [PubMed]
[7] Bexton, W. H., Heron, W., & Scott, T. H. (1954). Effects of Decreased Variation in the Sensory Environment. The Canadian Journal of Psychiatry, 8, 70-76.[CrossRef] [PubMed]
[8] Broadbent, D. E., & Broadbent, M. (1987). From Detection to Identification: Response to Multiple Targets in Rapid Serial Visual Presentation. Perception & Psychophysics, 42, 105-113.[CrossRef
[9] Brungart, D. S. (2001). Informational and Energetic Masking Effects in the Perception of Multiple Simultaneous Talkers. Journal of the Acoustical Society of America, 109, 2527-2538.[CrossRef] [PubMed]
[10] Dalton, P., Murphy, S., & Spence, C. (2017). Auditory Perceptual Load: A Review. Hearing Research: An International Journal, 352, 40-48.
[11] Fairnie, J., Moore, B., & Remington, A. (2016). Missing a Trick: Auditory Load Modulates Conscious Awareness in Audition. Journal of Experimental Psychology Human Perception & Performance, 42, 930-938.[CrossRef] [PubMed]
[12] Fischler, I. (1976). Beating the Memory Drum: Rapid Sequential Visual Presentation (RSVP) on a 4K PDP-8. Behavior Research Methods & Instrumentation, 8, 233-234.[CrossRef
[13] Kahneman, D. (1973). Attention and Effort. Englewood Cliffs, NJ: Pren-tice-Hall.
[14] Kidd, G., Mason, C. R., Richards, V. M., Gallun, F. J., & D Urlach, N. I. (2007). Informational Masking. New York: Springer.
[15] Laberge, D. (1997). Attention, Awareness, and the Triangular Circuit. Consciousness & Cognition, 6, 149.[CrossRef] [PubMed]
[16] Lavie, N., & Tsal, Y. (1994). Perceptual Load as a Major Determinant of the Locus of Selection in Visual Attention. Perception & Psychophysics, 56, 183-197.[CrossRef
[17] Mcgurk, H., & Macdonald, J. (1976). Hearing Lips and Seeing Voices. Nature, 264, 746-748.[CrossRef] [PubMed]
[18] Miller, J. (1986). Timecourse of Coactivation in Bimodal Divided Attention. Perception & Psychophysics, 40, 331-343.[CrossRef
[19] Murphy, S., Fraenkel, N., & Dalton, P. (2013). Perceptual Load Does Not Modulate Auditory Distractor Processing. Cognition, 129, 345-355.[CrossRef] [PubMed]
[20] Norman, D. A., & Bobrow, D. G. (1975). On Data-Limited and Resource-Limited Processes. Cognitive Psychology, 7, 44-64.[CrossRef
[21] Stein, B. E., & Meredith, M. A. (1990). Multisensory Integration. Annals of the New York Academy of Sciences, 608, 51-70.[CrossRef] [PubMed]
[22] Stoep, N., Janssen, M. A., Stigchel, S., & Nijboer, T. (2013). Exogenous Auditory Cues Decrease Audiovisual Integration of Simple Lights and Sounds. The 14th International Multisensory Research Forum 2013, Jerusalem, 3-6 June 2013, 223-224.
[23] Talsma, D., Doty, T. J., & Woldorff, M. G. (2007). Selective Attention and Audiovisual Integration: Is Attending to Both Modalities a Prerequisite for Early Integration? Cerebral Cortex, 17, 679-690.[CrossRef] [PubMed]
[24] Talsma, D., Senkowski, D., Soto-Faraco, S., & Woldorff, M. G. (2010). The Multifaceted Interplay between Attention and Multisensory Integration. Trends in Cognitive Sciences, 14, 400-410.[CrossRef] [PubMed]
[25] Teder-Slejrvi, W. A., Mcdonald, J. J., Russo, F. D., & Hillyard, S. A. (2002). An Analysis of Audio-Visual Crossmodal Integration by Means of Event-Related Potential (ERP) Recording. Cognitive Brain Research, 14, 106-114.[CrossRef
[26] Tiippana, K., Andersen, T. S., & Sams, M. (2004). Visual Attention Modulates Audiovisual Speech Perception. European Journal of Cognitive Psychology, 16, 457-472.[CrossRef
[27] Xu, Z., Yang, W., Zhou, Z., & Ren, Y. (2020). Cue-Target Onset Asynchrony Modulates Interaction between Exogenous Attention and Audiovisual Integration. Cognitive Processing, 21, 261-270.[CrossRef] [PubMed]