基于条件双重对齐注意力U-Net的跨被试脑电情绪识别方法
Cross-Subject EEG Emotion Recognition Method Based on Conditional Dual-Aligned Attention U-Net
摘要: 针对跨被试脑电情绪识别中的个体差异与特征分布偏移问题,本文提出一种条件双重对齐注意力U-Net (CDA-AUNet)模型。该模型由脑电特征编码器与双重域对齐模块构成。特征编码阶段构建了融合压缩–激励(SE)通道注意力机制的U-Net架构,以实现对多频带和空间通道特征的自适应加权;并在深层引入信息瓶颈机制以抑制生理噪声、缓解过拟合。在跨域对齐阶段,模型结合条件域对抗网络(CDAN)与相关对齐(CORAL)算法,通过特征与预测概率的张量外积对齐联合条件分布,并在二阶协方差维度约束特征偏移,实现源域与目标域特征的深度协同对齐。在SEED数据集上的留一被试交叉验证结果表明,CDA-AUNet的平均分类准确率达到85.18%,显著优于现有主流基线模型。消融实验进一步验证了各核心模块在提升跨被试泛化能力中的有效性。
Abstract: To address the challenges of individual differences and feature distribution shifts in cross-subject EEG-based emotion recognition, this paper proposes a Conditional Dual-Aligned Attention U-Net (CDA-AUNet) model. The proposed model consists of an EEG feature encoder and a dual-domain alignment module. During the feature encoding phase, a U-Net architecture integrated with a Squeeze-and-Excitation (SE) channel attention mechanism is constructed to perform adaptive weighting across multi-band and spatial channel features. Furthermore, an information bottleneck mechanism is introduced in the deep layers to suppress physiological noise and mitigate overfitting. During the cross-domain alignment phase, the model integrates a Conditional Domain Adversarial Network (CDAN) with the Correlation Alignment (CORAL) algorithm. By utilizing the tensor outer product of deep features and prediction probabilities to align the joint conditional distribution, and constraining feature shifts at the second-order covariance dimension, the model achieves deep collaborative alignment of feature distributions between the source and target domains. Leave-one-subject-out (LOSO) cross-validation results on the SEED dataset demonstrate that the CDA-AUNet achieves an average classification accuracy of 85.18%, significantly outperforming current mainstream baseline models. Ablation studies further validate the effectiveness of the core modules in enhancing cross-subject generalization capabilities.
文章引用:许子豪, 廖志强, 赵孟君. 基于条件双重对齐注意力U-Net的跨被试脑电情绪识别方法[J]. 计算机科学与应用, 2026, 16(4): 563-573. https://doi.org/10.12677/csa.2026.164153

参考文献

[1] Adolphs, R., Mlodinow, L. and Barrett, L.F. (2019) What Is an Emotion? Current Biology, 29, R1060-R1064. [Google Scholar] [CrossRef] [PubMed]
[2] Ahern, G.L. and Schwartz, G.E. (1985) Differential Lateralization for Positive and Negative Emotion in the Human Brain: EEG Spectral Analysis. Neuropsychologia, 23, 745-755. [Google Scholar] [CrossRef] [PubMed]
[3] Alarcao, S.M. and Fonseca, M.J. (2019) Emotions Recognition Using EEG Signals: A Survey. IEEE Transactions on Affective Computing, 10, 374-393. [Google Scholar] [CrossRef
[4] Kamrud, A., Borghetti, B. and Schubert Kabban, C. (2021) The Effects of Individual Differences, Non-Stationarity, and the Importance of Data Partitioning Decisions for Training and Testing of EEG Cross-Participant Models. Sensors, 21, Article 3225. [Google Scholar] [CrossRef] [PubMed]
[5] Yin, Y., Zheng, X., Hu, B., Zhang, Y. and Cui, X. (2021) EEG Emotion Recognition Using Fusion Model of Graph Convolutional Neural Networks and LSTM. Applied Soft Computing, 100, Article 106954. [Google Scholar] [CrossRef
[6] Chen, H., He, H., Zhu, J., et al. (2022) Weight-Based Channel-Model Matrix Framework Provides a Reasonable Solution for EEG-Based Cross-Dataset Emotion Recognition. arXiv:2209.05849.
[7] Yu, M., Zhang, D., Zhang, G., Zhao, G., Liu, Y., Han, Y., et al. (2019) A Review of EEG Features for Emotion Recognition. Scientia Sinica Informationis, 49, 1097-1118. [Google Scholar] [CrossRef
[8] Jenke, R., Peer, A. and Buss, M. (2014) Feature Extraction and Selection for Emotion Recognition from EEG. IEEE Transactions on Affective Computing, 5, 327-339. [Google Scholar] [CrossRef
[9] Craik, A., He, Y. and Contreras-Vidal, J.L. (2019) Deep Learning for Electroencephalogram (EEG) Classification Tasks: A Review. Journal of Neural Engineering, 16, Article 031001. [Google Scholar] [CrossRef] [PubMed]
[10] Lawhern, V.J., Solon, A.J., Waytowich, N.R., Gordon, S.M., Hung, C.P. and Lance, B.J. (2018) EEGNet: A Compact Convolutional Neural Network for EEG-Based Brain-Computer Interfaces. Journal of Neural Engineering, 15, Article 056013. [Google Scholar] [CrossRef] [PubMed]
[11] Schirrmeister, R.T., Springenberg, J.T., Fiederer, L.D.J., Glasstetter, M., Eggensperger, K., Tangermann, M., et al. (2017) Deep Learning with Convolutional Neural Networks for EEG Decoding and Visualization. Human Brain Mapping, 38, 5391-5420. [Google Scholar] [CrossRef] [PubMed]
[12] Tao, W., Li, C., Song, R., Cheng, J., Liu, Y., Wan, F., et al. (2023) EEG-Based Emotion Recognition via Channel-Wise Attention and Self Attention. IEEE Transactions on Affective Computing, 14, 382-393. [Google Scholar] [CrossRef
[13] Ganin, Y. and Lempitsky, V. (2015) Unsupervised Domain Adaptation by Backpropagation. International Conference on Machine Learning, Lille, 6-11 July 2015, 1180-1189.
[14] Long, M., Cao, Z., Wang, J., et al. (2018) Conditional Adversarial Domain Adaptation. Advances in Neural Information Processing Systems, 31, 1640-1650.
[15] Zheng, W.L. and Lu, B.L. (2015) Investigating Critical Frequency Bands and Channels for EEG-Based Emotion Recognition with Deep Neural Networks. IEEE Transactions on Autonomous Mental Development, 7, 162-175. [Google Scholar] [CrossRef
[16] Cortes, C. and Vapnik, V. (1995) Support-Vector Networks. Machine Learning, 20, 273-297. [Google Scholar] [CrossRef
[17] Song, T., Zheng, W., Song, P. and Cui, Z. (2018) EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks. IEEE Transactions on Affective Computing, 11, 532-541. [Google Scholar] [CrossRef
[18] Gu, Y., Zhong, X., Qu, C., Liu, C. and Chen, B. (2023) A Domain Generative Graph Network for EEG-Based Emotion Recognition. IEEE Journal of Biomedical and Health Informatics, 27, 2377-2386. [Google Scholar] [CrossRef] [PubMed]
[19] Van der Maaten, L. and Hinton, G. (2008) Visualizing Data Using t-SNE. Journal of Machine Learning Research, 9, 2579-2605.