基于GCN-LSTM融合模型的脑电情绪时空特征协同识别——融合频域特征的建模与识别性能分析
Based on GCN-LSTM Fusion Model for Synergistic Recognition of Spatiotemporal Features in EEG Emotion—Modeling with Fusion of Frequency-Domain Features and Recognition Performance Analysis
摘要: 本文围绕脑电情绪识别展开研究,针对脑电信号低信噪比、非平稳特性及现有模型在空间时序建模、跨被试泛化等方面的不足,提出融合图卷积网络(GCN)与长短期记忆网络(LSTM)的模型架构,通过深度融合空间特征与时序特征,实现情绪在效价、唤醒度等维度的连续识别。研究设计多组对比实验,验证了模型在DEAP等数据集上的性能优势,同时分析了不同预处理流程、模块组合及通道关联方式对识别结果的影响,为脑电情绪识别的模型优化与应用拓展提供了参考。
Abstract: This study focuses on electroencephalogram (EEG) emotion recognition. To address the low signal-to-noise ratio (SNR) and non-stationary characteristics of EEG signals, as well as the shortcomings of existing models in spatiotemporal modeling and cross-subject generalization, a model architecture fusing Graph Convolutional Network (GCN) and Long Short-Term Memory (LSTM) is proposed. By deeply integrating spatial and temporal features, the model achieves continuous recognition of emotions in dimensions such as valence and arousal. Multiple sets of comparative experiments are designed to verify the performance advantages of the proposed model on datasets like DEAP. Meanwhile, the study analyzes the impacts of different preprocessing pipelines, module combinations, and channel correlation methods on recognition results, providing references for model optimization and application expansion of EEG emotion recognition.
参考文献
|
[1]
|
赵莹莹, 李刚, 王健. 基于图卷积神经网络的脑电情绪空间特征提取与识别[J]. 自动化学报, 2021, 47(5): 1123-1132.
|
|
[2]
|
钟扬, 陈明, 刘敏. 结合CNN与GRU的脑电情绪时空特征协同建模研究[J]. 电子学报, 2020, 48(12): 2356-2363.
|
|
[3]
|
刘畅, 张宇, 李丽. 基于注意力机制的GCN-LSTM 脑电情绪识别模型[J]. 模式识别与人工智能, 2022, 35(3): 245-253.
|
|
[4]
|
王瑞, 马超, 陈曦. 脑电信号频域特征优化与深度学习情绪识别[J]. 仪器仪表学报, 2021, 42(7): 189-197.
|
|
[5]
|
陈雨婷, 吴昊, 张磊. 跨被试脑电情绪识别中的域自适应方法研究[J]. 计算机应用研究, 2023, 40(2): 456-462.
|
|
[6]
|
Zhang, Y., Li, D. and Wang, H. (2020) EEG Emotion Recognition Based on GCN-LSTM Hybrid Model with Attention Mechanism. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 28, 1621-1630.
|
|
[7]
|
Li, S., Zhang, J. and Chen, W. (2021) Spatiotemporal Feature Fusion for EEG Emotion Recognition Using CNN and BiLSTM. Neural Computing and Applications, 33, 9245-9256.
|
|
[8]
|
Wu, X., Liu, Y. and Zhao, J. (2019) EEG Emotion Recognition with Graph Convolutional Networks: A Comparative Study. Journal of Neural Engineering, 16, Article 056019.
|