基于原型联邦学习的工业故障诊断方法
A Prototype Federated Learning Based Approach to Industrial Fault Diagnosis
DOI: 10.12677/mos.2024.136565, PDF,   
作者: 徐丹丹, 杨夏洁, 樊重俊*:上海理工大学管理学院,上海;尤艳丽:上海市静安区业余大学(上海开放大学静安分校),上海
关键词: 联邦学习原型网络时间序列分类分布式故障诊断Federated Learning Prototype Networks Time Series Classification Distributed Fault Diagnosis
摘要: 故障诊断是保障工业系统安全运行的关键。当前,数据异构导致的非独立同分布问题使得传统的中心化数据处理方法在工业故障诊断领域面临着巨大的挑战。基于此本文提出一种基于原型联邦学习的时序数据处理方法AP-FED,该方法分为基础阶段和原型学习阶段。基础阶段进行数据增强、特征提取与全局参数的传递;原型学习阶段进行边缘设备端的原型提取与云端的全局原型聚合,确保在全局类原型的指导下,联邦学习的局部网络能够更有效地学习到特征表示。为验证模型有效性,使用真实工业数据集与多个联邦学习基线方法进行对比。经仿真实验,所提方法在FD、CWRU与CNC三个数据集中分别至少提升15.37%、21.30%与1.81%,证明该方法具有较高的精度和泛化能力。
Abstract: Fault diagnosis is the key to ensuring the safe operation of industrial systems. Currently, the non-independent homogeneous distribution problem caused by data heterogeneity makes the traditional centralized data processing method face great challenges in industrial fault diagnosis. This paper proposes a temporal data processing method AP-FED based on prototype federated learning, divided into a foundation phase and a prototype learning phase. The foundation phase carries out data enhancement, feature extraction, and global parameter transfer; the prototype learning phase carries out prototype extraction at the edge device end and global prototype aggregation in the cloud, ensuring that the local network of federated learning learns the feature representations more efficiently under the guidance of the global class prototypes. To validate the model’s effectiveness, real industrial datasets are used for comparison with multiple federated learning baseline methods. After simulation experiments, the proposed method improves at least 15.37%, 21.30%, and 1.81% in the three datasets of FD, CWRU, and CNC, respectively, which proves that the method has high accuracy and generalization ability.
文章引用:徐丹丹, 尤艳丽, 杨夏洁, 樊重俊. 基于原型联邦学习的工业故障诊断方法[J]. 建模与仿真, 2024, 13(6): 6164-6176. https://doi.org/10.12677/mos.2024.136565

参考文献

[1] 刘强, 柴天佑, 秦泗钊, 等. 基于数据和知识的工业过程监视及故障诊断综述[J]. 控制与决策, 2010, 25(6): 801-807+813.
[2] 郭桂娟, 田晖, 皮慧娟, 等. 面向非独立同分布数据的联邦学习研究进展[J]. 小型微型计算机系统, 2023, 44(11): 2442-2449.
[3] 刘晶, 朱家豪, 袁闰萌, 等. 非独立同分布工业大数据下联邦动态加权学习方法[J]. 计算机集成制造系统, 2023, 29(5): 1602-1614.
[4] Lai, F., Zhu, X., Madhyastha, H.V., et al. (2021) Oort: Efficient Federated Learning via Guided Participant Selection. Operating Systems Design and Implementation, 14-16 July 2021, 19-35.
[5] Zhou, B., Xie, H., Liu, Q., Chen, X., Guo, X., Feng, Z., et al. (2023) FedFTN: Personalized Federated Learning with Deep Feature Transformation Network for Multi-Institutional Low-Count PET Denoising. Medical Image Analysis, 90, Article ID: 102993. [Google Scholar] [CrossRef] [PubMed]
[6] Hamer, J., Mohri, M. and Suresh, A.T. (2020) FedBoost: A Communication-Efficient Algorithm for Federated Learning. International Conference on Machine Learning. PMLR, 13-18 July 2020, 3973-3983.
[7] Snell, J., Swersky, K. and Zemel, R. (2017) Prototypical Networks for Few-Shot Learning. NIPS’17: Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, 4-9 December 2017, 4080-4090.
[8] 何心, 段亚穷, 王子栋, 等. 具有隐私保护功能的半监督小样本齿轮箱故障诊断[J]. 中国科学: 技术科学, 2024, 54(6): 1105-1119.
[9] 徐炜钦, 肖婷, 王喆. 平衡信息与动态更新的原型表示联邦学习[J]. 华东理工大学学报(自然科学版), 2024: 1-9.
[10] Arslan, M., Guzel, M., Demirci, M. and Ozdemir, S. (2019). SMOTE and Gaussian Noise Based Sensor Data Augmentation. 2019 4th International Conference on Computer Science and Engineering (UBMK), Samsun, 11-15 September 2019, 1-5.[CrossRef
[11] Um, T.T., Pfister, F.M.J., Pichler, D., Endo, S., Lang, M., Hirche, S., et al. (2017). Data Augmentation of Wearable Sensor Data for Parkinson’s Disease Monitoring Using Convolutional Neural Networks. Proceedings of the 19th ACM International Conference on Multimodal Interaction, Glasgow, 13-17 November 2017, 216-220.[CrossRef
[12] Cheng, D., Zhang, L., Bu, C., Wang, X., Wu, H. and Song, A. (2023) ProtoHAR: Prototype Guided Personalized Federated Learning for Human Activity Recognition. IEEE Journal of Biomedical and Health Informatics, 27, 3900-3911. [Google Scholar] [CrossRef] [PubMed]
[13] Lessmeier, C., Kimotho, J.K., Zimmer, D. and Sextro, W. (2016) Condition Monitoring of Bearing Damage in Electromechanical Drive Systems by Using Motor Current Signals of Electric Motors: A Benchmark Data Set for Data-Driven Classification. PHM Society European Conference, 3, No. 1. [Google Scholar] [CrossRef
[14] Smith, W.A. and Randall, R.B. (2015) Rolling Element Bearing Diagnostics Using the Case Western Reserve University Data: A Benchmark Study. Mechanical Systems and Signal Processing, 64, 100-131. [Google Scholar] [CrossRef
[15] Tnani, M., Feil, M. and Diepold, K. (2022) Smart Data Collection System for Brownfield CNC Milling Machines: A New Benchmark Dataset for Data-Driven Machine Monitoring. Procedia CIRP, 107, 131-136. [Google Scholar] [CrossRef
[16] Tan, A.Z., Yu, H., Cui, L. and Yang, Q. (2023) Towards Personalized Federated Learning. IEEE Transactions on Neural Networks and Learning Systems, 34, 9587-9603. [Google Scholar] [CrossRef] [PubMed]
[17] Wang, Y., Tong, Y. and Shi, D. (2020) Federated Latent Dirichlet Allocation: A Local Differential Privacy Based Framework. Proceedings of the AAAI Conference on Artificial Intelligence, 34, 6283-6290. [Google Scholar] [CrossRef
[18] McMahan, B., Moore, E., Ramage, D., et al. (2017) Communication-Efficient Learning of Deep Networks from Decentralized Data. Artificial Intelligence and Statistics. PMLR, Fort Lauderdale, 20-22 April 2017, 1273-1282.
[19] Li, T., Sahu, A.K., Zaheer, M., et al. (2020) Federated Optimization in Heterogeneous Networks. Proceedings of Machine Learning and Systems, Vol. 2, 429-450.
[20] Hu, R., Guo, Y., Li, H., et al. (2020) Personalized Federated Learning with Differential Privacy. IEEE Internet of Things Journal, 7, 9530-9539.
https://par.nsf.gov/servlets/purl/10183051
[21] Tan, Y., Long, G., LIU, L., Zhou, T., Lu, Q., Jiang, J., et al. (2022) FedProto: Federated Prototype Learning across Heterogeneous Clients. Proceedings of the AAAI Conference on Artificial Intelligence, 36, 8432-8440. [Google Scholar] [CrossRef
[22] Li, X., Zhan, D., Shao, Y., Li, B. and Song, S. (2021) FedPHP: Federated Personalization with Inherited Private Models. European Conference, ECML PKDD 2021, Bilbao, 13-17 September 2021, 587-602. [Google Scholar] [CrossRef
[23] Seo, H., Park, J., Oh, S., et al. (2022) Federated Knowledge Distillation. In: Eldar, Y.C., Goldsmith, A., Gündüz, D. and Poor, H.V., Eds., Machine Learning and Wireless Communications, Cambridge University Press, 457-485.