基于Transformer的残差EWMA控制图
Residual EWMA Control Chart Based on Transformer
DOI: 10.12677/aam.2024.1312514, PDF,    科研立项经费支持
作者: 胡小红, 宋学力*, 王凯明, 卿 晶, 王佳颖：长安大学理学院，陕西 西安
关键词: Transformer模型；残差控制图；自相关过程；Transformer Model； Residual Control Chart； Autocorrelation Process
摘要: 过程数据的相关性是设计和应用控制图进行质量监测时需要解决的关键且极具挑战性的问题。本文利用Transformer的自注意力机制能有效捕捉数据全局信息的优点挖掘数据的相关性，提出基于Transformer的残差EWMA (TREWMA)控制图，实现了对自相关过程的过程均值监测。实验通过仿真和真实数据演示了TREWMA控制图的实施；其结果表明，TREWMA控制图在监测自相关过程的均值漂移时，展现出比现有控制图更好的性能。
Abstract: Correlation in process data is the key and challenging problem to be solved when designing and applying a control chart to carry out a Quality monitoring. Bying utilizing the self-attention mechanism of Transformer to learn the correlation and overall information of data, propose a Transformer-based residual EWMA (TREWMA) control chart, and achieve process-mean-monitoring for autocorrelation process. Experiments demonstrate the implementation of the TREWMA control chart through simulation and real data; the results show that the TREWMA control chart exhibits better performance than existing control charts in monitoring the mean shift of autocorrelation processes.
文章引用：胡小红, 宋学力, 王凯明, 卿晶, 王佳颖. 基于Transformer的残差EWMA控制图[J]. 应用数学进展, 2024, 13(12): 5330-5337. https://doi.org/10.12677/aam.2024.1312514

参考文献

[1] Alwan, L.C. and Roberts, H.V. (1988) Time-Series Modeling for Statistical Process Control. Journal of Business & Economic Statistics, 6, 87-95. [Google Scholar] [CrossRef] 
[2] Johnson, R.A. and Bagshaw, M. (1974) The Effect of Serial Correlation on the Performance of CUSUM Tests. Technometrics, 16, 103-112. [Google Scholar] [CrossRef] 
[3] Alwan, L.C. (1992) Effects of Autocorrelation on Control Chart Performance. Communications in Statistics—Theory and Methods, 21, 1025-1049. [Google Scholar] [CrossRef] 
[4] Yashchin, E. (1993) Performance of CUSUM Control Schemes for Serially Correlated Observations. Technometrics, 35, 37-52. [Google Scholar] [CrossRef] 
[5] Woodall, W.H. and Faltin, F. (1993) Autocorrelated Data and SPC. ASQC Statistics Division Newsletter, 13, 18-21.
[6] Qiu, P. (2013) Introduction to Statistical Process Control. CRC Press.
[7] 杨穆尔, 孙静. 二元自相关过程的残差T2控制图[J]. 清华大学学报(自然科学版), 2006, 46(3): 403-406.
[8] 孙静, 杨穆尔. 多元自相关过程的残差T2控制图[J]. 清华大学学报(自然科学版), 2007, 47(12): 2184-2187.
[9] 马义中, 田甜, 刘利平. 自相关过程协方差阵的残差MEWMA控制图[J]. 系统工程学报, 2012, 27(2): 279-286.
[10] Lu, C. and Reynolds, M.R. (1999) EWMA Control Charts for Monitoring the Mean of Autocorrelated Processes. Journal of Quality Technology, 31, 166-188. [Google Scholar] [CrossRef] 
[11] Lu, C. and Reynolds, M.R. (1999) Control Charts for Monitoring the Mean and Variance of Autocorrelated Processes. Journal of Quality Technology, 31, 259-274. [Google Scholar] [CrossRef] 
[12] Apley, D.W. and Shi, J. (1999) The GLRT for Statistical Process Control of Autocorrelated Processes. IIE Transactions, 31, 1123-1134. [Google Scholar] [CrossRef] 
[13] Cook, D.F. and Chiu, C. (1998) Using Radial Basis Function Neural Networks to Recognize Shifts in Correlated Manufacturing Process Parameters. IIE Transactions, 30, 227-234. [Google Scholar] [CrossRef] 
[14] Issam, B.K. and Mohamed, L. (2008) Support Vector Regression Based Residual MCUSUM Control Chart for Autocorrelated Process. Applied Mathematics and Computation, 201, 565-574. [Google Scholar] [CrossRef] 
[15] Alshraideh, H. and Runger, G. (2013) Process Monitoring Using Hidden Markov Models. Quality and Reliability Engineering International, 30, 1379-1387. [Google Scholar] [CrossRef] 
[16] Chen, S. and Yu, J. (2019) Deep Recurrent Neural Network‐Based Residual Control Chart for Autocorrelated Processes. Quality and Reliability Engineering International, 35, 2687-2708. [Google Scholar] [CrossRef] 
[17] 郑辉, 姜美玲, 王东菲. 基于改进支持向量回归的旋片泵自相关过程监控[J]. 工业工程与管理, 2022, 27(6): 9-13.
[18] Vaswani, A., Shazeer, N., Parmar, N., et al. (2017) Attention Is All You Need. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, 4-9 December 2017, 6000-6010.
[19] Wu, N., Green, B., Ben, X., et al. (2020) Deep Transformer Models for Time Series Forecasting: The Influenza Prevalence Case. arXiv: 2001.08317.
[20] Gehring, J., Auli, M., Grangier, D., et al. (2017) Convolutional Sequence to Sequence Learning. Proceedings of the 34th International Conference on Machine Learning, Sydney, 6-11 August 2017, 1243-1252.
[21] Wardell, D.G., Moskowitz, H. and Plante, R.D. (1994) Run-Length Distributions of Special-Cause Control Charts for Correlated Processes. Technometrics, 36, 3-17. [Google Scholar] [CrossRef] 
[22] Hwarng, H.B. (2004) Detecting Process Mean Shift in the Presence of Autocorrelation: A Neural-Network Based Monitoring Scheme. International Journal of Production Research, 42, 573-595. [Google Scholar] [CrossRef] 
[23] Yu, J. and Liu, J. (2010) Lrprob Control Chart Based on Logistic Regression for Monitoring Mean Shifts of Auto-Correlated Manufacturing Processes. International Journal of Production Research, 49, 2301-2326. [Google Scholar] [CrossRef] 
[24] Box, G.E.P., Jenkins, G.M., Reinsel, G.C., et al. (2015) Time Series Analysis: Forecasting and Control. John Wiley & Sons.

为你推荐