基于类感知对比学习的半监督故障诊断
Fault Diagnosis Based on Class-Aware Contrastive Semi-Supervised Learning
摘要: 当前基于数据驱动的故障诊断方法依赖于标注完备的训练样本,然而在实际工程活动中标注足量故障样本需要耗费大量人力物力。对此提出一种基于类感知对比学习的半监督故障诊断方法以综合应用少量标注样本以及大量无标注样本进行训练,减少模型训练对于标注样本的需求。首先根据模型最大概率预测值动态赋予无标注样本伪标签以参与模型训练,并结合置信度筛选以减少伪标签中噪声标签所引起的负面影响,同时引入一致性正则化,增强模型对伪标签样本的特征表达能力,构建更为完备的决策边界。随后设计类感知对比学习模块以确保模型特征空间中的各类故障样本间的类内一致性以及类间对比度,实现判别能力增强。实验结果证实,该方法能够在较少标签的条件下取得良好的诊断结果。
Abstract: The current data-driven fault diagnosis methods rely on well-labeled training dataset, however those datasets in practical engineering activities require lots of resources. In this way, a semi su-pervised fault diagnosis method based on class-aware contrastive learning is proposed to compre-hensively apply a small number of labeled samples and a large number of unlabeled samples for training, reducing the need for labeled samples in model training. Firstly, based on the maximum probability prediction value of the model, unlabeled samples are dynamically assigned pseudo la-bels to participate in model training, and confidence screening is combined to reduce the negative impact caused by noisy labels in the pseudo labels. At the same time, consistency regularization is introduced to enhance the model’s feature expression ability for pseudo label samples and con-struct a more complete decision boundary. Subsequently, a class-aware contrastive learning mod-ule is designed to ensure intra class consistency and inter class contrast among various fault sam-ples in the feature space, achieving enhanced discriminative ability. The experimental results con-firm that this method can maintain great fault diagnosis performance with few labels.
文章引用:金泽中, 叶春明. 基于类感知对比学习的半监督故障诊断[J]. 建模与仿真, 2024, 13(2): 1203-1211. https://doi.org/10.12677/MOS.2024.132113

参考文献

[1] 曹正志, 叶春明. 改进CNN-LSTM模型在滚动轴承故障诊断中的应用[J]. 计算机系统应用, 2021, 30(3): 126-133.
[2] Zhang, S., Liu, Z., Chen, Y., et al. (2022) Selective Kernel Convolution Deep Residual Network Based on Channel-Spatial Attention Mechanism and Feature Fusion for Mechanical Fault Diagnosis. ISA Transactions, 133, 369-383.
[3] Xu, Z., Bashir, M., Zhang, W., et al. (2022) An Intelligent Fault Diagnosis for Machine Maintenance Using Weighted Soft-Voting Rule Based Multi-Attention Module with Multi-Scale Information Fusion. Information Fusion, 86-87, 17-29. [Google Scholar] [CrossRef
[4] Zhang, K., Tang, B., Deng, L., et al. (2021) A Fault Diagnosis Method for Wind Turbines Gearbox Based on Adaptive Loss Weighted Meta-ResNet under Noisy Labels. Mechanical Systems and Signal Processing, 161, Article ID: 107963. [Google Scholar] [CrossRef
[5] 韩特, 李彦夫, 雷亚国, 等. 融合图标签传播和判别特征增强的工业机器人关键部件半监督故障诊断方法[J]. 机械工程学报, 2022, 58(17): 116-124.
[6] Yu, K., Ma, H., Lin, R., et al. (2020) A Consistency Regularization Based Semi-Supervised Learning Approach for Intelligent Fault Diagnosis of Rolling Bearing. Measurement, 165, Article ID: 107987. [Google Scholar] [CrossRef
[7] Liao, Y., Huang, R., Li, J., et al. (2020) Deep Semi-Supervised Domain Generalization Network for Rotary Machinery Fault Diagnosis under Variable Speed. IEEE Transactions on Instru-mentation and Measurement, 69, 8064-8075. [Google Scholar] [CrossRef
[8] Chen, Y., Mancini, M., Zhu, X., et al. (2022) Semi-Supervised and Un-supervised Deep Visual Learning: A Survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6, 302-314.
[9] Sohn, K., Berthelot, D., et al. (2020) FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence. Proceedings of the 34th International Conference on Neural Information Processing Systems, Vancouver, Decem-ber 2020, 596-608.
[10] Wang, T. and Isola, P. (2020) Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere. Proceedings of the 37th International Conference on Machine Learning, 9871-9881. arXiv: 2005.10242v10.
[11] Chen, T., Kornblith, S., et al. (2020) A Simple Framework for Contrastive Learning of Visual Represen-tations. Proceedings of the 37th International Conference on Machine Learning, Vienna, 1597-1607.
[12] Khosla, P., Teterwak, P., Wang, C., et al. (2020) Supervised Contrastive Learning. Proceedings of the 34th International Conference on Neural In-formation Processing Systems, December 2020, 18661-18673.
[13] 吕枫, 王义, 阮胡林, 等. 深度嵌入关系空间下齿轮箱标记样本扩充及其半监督故障诊断方法[J]. 仪器仪表学报, 2021, 42(2): 55-65.
[14] Berthelot, D., Carlini, N., Goodfel-low, I., et al. (2019) MixMatch: A Holistic Approach to Semi-Supervised Learning. Proceedings of the 33rd Advances in Neu-ral Information Processing Systems, 5603-5614. arXiv: 1905.02249v2.