统一实验范式下GSR与ECG的短时情感识别 性能差异分析
Performance Difference Analysis of GSR and ECG in Short-Term Emotion Recognition under a Unified Experimental Paradigm
DOI: 10.12677/airr.2026.154092, PDF,    科研立项经费支持
作者: 张善斌*:重庆对外经贸学院大数据与智能工程学院,重庆
关键词: 情感分类GSR信号ECG信号“信号–情感”适用性BP神经网络 Emotion Classification GSR Signals ECG Signals “Signal-Emotion” Applicability BP Neural Network
摘要: 当前生理信号情感识别领域已经证实单信号、短时程在技术上是可行的,有力推动了情感实时识别的发展,但是不同信号适用性差异尚不明确。本文在已证实有效的心电(ECG)短时情感识别框架下,系统引入皮肤电(GSR)信号在统一的实验范式下进行对照研究。通过电影片段诱发被试喜、怒、哀、惧和平静5种基本情感,同步采集GSR信号,经去噪、归一化与特征提取后,采用BP神经网络建立分类模型,并与前期研究建立的ECG模型进行对比。结果表明,GSR信号的平均情感识别率为82.29%,低于ECG信号的89.14%;两者在各类情感上的识别率分布也存在明显差异。通过对这种差异的生理机制分析与讨论,本文提出单一生理信号情感识别存在“信号–情感”适用性差异,为实时情感识别系统的信号选型提供了实证依据。两类信号的特征提取与分类总耗时均小于0.15 s,具备良好的实时性。
Abstract: The feasibility of using single physiological signals with short time windows has been demonstrated in the field of emotion recognition, significantly advancing real-time emotion detection. However, the applicability differences among various signal types remain unclear. Under a unified experimental paradigm, this study systematically introduces galvanic skin response (GSR) signals into an already validated short-term electrocardiogram (ECG) emotion recognition framework for a controlled comparison. Five basic emotions—joy, anger, sadness, fear, and calmness—were induced in participants through film clips, while GSR signals were synchronously collected. After denoising, normalization, and feature extraction, a BP neural network model was constructed and compared with the previously established ECG model. The results show that the average recognition rate of GSR signals is 82.29%, which is lower than the 89.14% achieved by ECG signals; the two signal types also exhibit distinct recognition rate distributions across individual emotions. Through physiological mechanism analysis and discussion of these differences, this paper proposes the existence of “signal-emotion” applicability differences in single-signal emotion recognition, providing empirical evidence for signal selection in real-time emotion recognition systems. The total time required for feature extraction and classification of both signal types is less than 0.15 seconds, demonstrating good real-time performance.
文章引用:张善斌. 统一实验范式下GSR与ECG的短时情感识别 性能差异分析[J]. 人工智能与机器人研究, 2026, 15(4): 1027-1036. https://doi.org/10.12677/airr.2026.154092

参考文献

[1] Picard, R.W. (2000) Affective Computing. MIT Press.
[2] Luo, S.-L. and Pan, L.-M. (2003) Theory and Technology on Affective Computing. Systems Engineering and Electronics, 25, 905-909.
[3] 寿步. 论科学知识生产中的人类-AI行为体协作系统[J/OL]. 高等工程教育研究: 1-20.
https://link.cnki.net/urlid/42.1026.g4.20260318.1747.002, 2026-06-24.
[4] Anderson, K. and McOwan, P.W. (2006) A Real-Time Automated System for the Recognition of Human Facial Expressions. IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics), 36, 96-105. [Google Scholar] [CrossRef] [PubMed]
[5] Zhang, L., Jiang, M., Farid, D. and Hossain, M.A. (2013) Intelligent Facial Emotion Recognition and Semantic-Based Topic Detection for a Humanoid Robot. Expert Systems with Applications, 40, 5160-5168. [Google Scholar] [CrossRef
[6] Haag, A., Goronzy, S., Schaich, P. and Williams, J. (2004) Emotion Recognition Using Bio-Sensors: First Steps towards an Automatic System. In: André, E., et al., Eds., Affective Dialogue Systems, Springer, 36-48. [Google Scholar] [CrossRef
[7] Winton, W.M., Putnam, L.E. and Krauss, R.M. (1984) Facial and Autonomic Manifestations of the Dimensional Structure of Emotion. Journal of Experimental Social Psychology, 20, 195-216. [Google Scholar] [CrossRef
[8] Picard, R.W., Vyzas, E. and Healey, J. (2001) Toward Machine Emotional Intelligence: Analysis of Affective Physiological State. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23, 1175-1191. [Google Scholar] [CrossRef
[9] Lisetti, C.L. and Nasoz, F. (2004) Using Noninvasive Wearable Computers to Recognize Human Emotions from Physiological Signals. EURASIP Journal on Advances in Signal Processing, 2004, 1672-1687. [Google Scholar] [CrossRef
[10] Wagner, J., Kim, J. and André, E. (2005) From Physiological Signals to Emotions: Implementing and Comparing Selected Methods for Feature Extraction and Classification. 2005 IEEE International Conference on Multimedia and Expo, Amsterdam, 6 July 2005, 940-943.
[11] Kim, K.H., Bang, S.W. and Kim, S.R. (2004) Emotion Recognition System Using Short-Term Monitoring of Physiological Signals. Medical & Biological Engineering & Computing, 42, 419-427. [Google Scholar] [CrossRef] [PubMed]
[12] Cheng, B. and Liu, G. (2008) Emotion Recognition from Surface EMG Signal Using Wavelet Transform and Neural Network. Journal of Computer Applications, 28, 333-335. [Google Scholar] [CrossRef
[13] Ma, C.-W. and Liu, G.-Y. (2009) Feature Extraction, Feature Selection and Classification from Electrocardiography to Emotions. 2009 International Conference on Computational Intelligence and Natural Computing, Vol. 1, 190-193.
[14] 王宝贵, 范鹏, 施韶亭. ChatGPT影响民主的技术逻辑、研判分析及应对策略[J]. 海南大学学报(人文社会科学版), 2025, 43(1): 76-85.
[15] 宣寒宇, 陈强, 吴之亮, 等. 视听多模态学习综述[J/OL]. 自动化学报: 1-44. 2026-03-20.[CrossRef
[16] 孔维嘉. 基于脑电信号的实时情感识别系统[D]: [硕士学位论文]. 兰州: 兰州大学, 2019.
[17] 冯京浩. 基于眼动追踪视频的实时情感识别系统[D]: [硕士学位论文]. 南京: 南京大学, 2019.
[18] 张善斌. 以BP神经网络为工具的短时ECG信号情感分类[J]. 福建电脑, 2024, 40(2): 11-16.
[19] Boucsein, W. (2012) Electrodermal Activity. Springer.
[20] Kreibig, S.D. (2010) Autonomic Nervous System Activity in Emotion: A Review. Biological Psychology, 84, 394-421. [Google Scholar] [CrossRef] [PubMed]
[21] Boucsein, W. and Wendt-Suhl, G. (1976) The Effect of Chlordiazepoxide on the Anticipation of Electric Shocks. Psychopharmacology, 48, 303-306. [Google Scholar] [CrossRef] [PubMed]
[22] Trudel-Fitzgerald, C., Qureshi, F., Appleton, A.A. and Kubzansky, L.D. (2017) A Healthy Mix of Emotions: Underlying Biological Pathways Linking Emotions to Physical Health. Current Opinion in Behavioral Sciences, 15, 16-21. [Google Scholar] [CrossRef