基于最小协方差行列式分布对齐的模型转移的研究
Research on Model Transfer Based on Minimum Covariance Determinant Distribution Alignment
摘要: 针对近红外光谱中无监督模型转移方法在目标域存在异常样本时预测性能不佳、鲁棒性不足的问题,本文提出一种基于最小协方差行列式分布对齐的无监督模型转移方法(MCD-uDAR)。该方法通过MCD实现对源域与目标域预测值的稳健分布参数估计,自动识别并抑制异常样本的干扰,完成无监督条件下的跨域分布对齐与模型转移。仿真实验结果表明,无异常样本时,该方法可实现与源域理想模型相当的预测精度;在10%~40%比例的分布漂移异常样本干扰下,其预测性能显著优于uDOP、di-PLS经典方法,为复杂场景下的无监督模型转移提供了可靠方案。
Abstract: To address the issues of unstable prediction performance and insufficient robustness in unsupervised model transfer methods for near-infrared spectroscopy when anomalous samples exist in the target domain, this paper proposes an unsupervised model transfer method based on minimum covariance determinant alignment (MCD-uDAR). This method employs MCD to achieve robust distribution parameter estimation for predictions in both source and target domains, automatically identifying and suppressing interference from anomalous samples to accomplish cross-domain distribution alignment and model transfer under unsupervised conditions. Simulation results demonstrate that in the absence of anomalous samples, this method achieves prediction accuracy comparable to an ideal source domain model. Under interference from distribution-drifted anomalous samples at rates of 10% to 40%, its predictive performance significantly outperforms classical methods such as uDOP and di-PLS, providing a reliable solution for unsupervised model transfer in complex scenarios.
文章引用:叶龙锋. 基于最小协方差行列式分布对齐的模型转移的研究[J]. 应用物理, 2026, 16(4): 323-334. https://doi.org/10.12677/app.2026.164030

参考文献

[1] Liu, J., Zhang, J., Tan, Z., Hou, Q. and Liu, R. (2022) Detecting the Content of the Bright Blue Pigment in Cream Based on Deep Learning and Near-Infrared Spectroscopy. Spectrochimica Acta Part A: Molecular and Biomolecular Spectroscopy, 270, Article ID: 120757. [Google Scholar] [CrossRef] [PubMed]
[2] Shi, C. and Sang, J. (2025) Qualitative Recognition of Waste Textiles Based on Near-Infrared Spectroscopy and ModernTCN. Microchemical Journal, 214, Article ID: 113902. [Google Scholar] [CrossRef
[3] Fearn, T. (2001) Standardisation and Calibration Transfer for near Infrared Instruments: A Review. Journal of Near Infrared Spectroscopy, 9, 229-244. [Google Scholar] [CrossRef
[4] Dong, X., Dong, J., Li, Y., Xu, H. and Tang, X. (2019) Maintaining the Predictive Abilities of Egg Freshness Models on New Variety Based on VIS-NIR Spectroscopy Technique. Computers and Electronics in Agriculture, 156, 669-676. [Google Scholar] [CrossRef
[5] 冯佳豪, 程泉翔, 张智勇, 等. 淫羊藿与柔毛淫羊藿中朝藿定A、B、C和淫羊藿苷的近红外光谱定量分析及模型转移研究[J]. 分析测试学报, 2025, 44(6): 995-1004.
[6] Mishra, P. and Nikzad-Langerodi, R. (2021) A Brief Note on Application of Domain-Invariant PLS for Adapting Near-Infrared Spectroscopy Calibrations between Different Physical Forms of Samples. Talanta, 232, Article ID: 122461. [Google Scholar] [CrossRef] [PubMed]
[7] Rabatel, G., Marini, F., Walczak, B. and Roger, J. (2019) VSN: Variable Sorting for Normalization. Journal of Chemometrics, 34, e3164. [Google Scholar] [CrossRef
[8] Xie, Z., Chen, X., Roger, J., Ali, S., Huang, G. and Shi, W. (2024) Calibration Transfer via Filter Learning. Analytica Chimica Acta, 1298, Article ID: 342404. [Google Scholar] [CrossRef] [PubMed]
[9] Verboven, S., Hubert, M. and Goos, P. (2012) Robust Preprocessing and Model Selection for Spectral Data. Journal of Chemometrics, 26, 282-289. [Google Scholar] [CrossRef
[10] 何佳艳, 李亭, 郭长凯, 等. 近红外光谱法快速无损测定奶粉的脂肪含量[J]. 食品与发酵工业, 2017, 43(10): 228-233.
[11] Rousseeuw, P.J. (1984) Least Median of Squares Regression. Journal of the American Statistical Association, 79, 871-880. [Google Scholar] [CrossRef
[12] Fonseca Diaz, V., Roger, J. and Saeys, W. (2022) Unsupervised Dynamic Orthogonal Projection. An Efficient Approach to Calibration Transfer without Standard Samples. Analytica Chimica Acta, 1225, Article ID: 340154. [Google Scholar] [CrossRef] [PubMed]
[13] Nikzad-Langerodi, R., Zellinger, W., Lughofer, E. and Saminger-Platz, S. (2018) Domain-Invariant Partial-Least-Squares Regression. Analytical Chemistry, 90, 6693-6701. [Google Scholar] [CrossRef] [PubMed]
[14] Chang, C., Laird, D.A., Mausbach, M.J. and Hurburgh, C.R. (2001) Near‐Infrared Reflectance Spectroscopy-Principal Components Regression Analyses of Soil Properties. Soil Science Society of America Journal, 65, 480-490. [Google Scholar] [CrossRef