面向通用异构域适应的部分最优传输模型
Partial Optimal Transport for Universal Heterogeneous Domain Adaptation
DOI: 10.12677/sa.2026.153056, PDF,    科研立项经费支持
作者: 艾诗琪, 马丽涛*:河北工程大学数理科学与工程学院,河北 邯郸
关键词: 通用域适应异构域适应部分最优传输正则化Universal Domain Adaptation Heterogeneous Domain Adaptation Partial Optimal Transport Regularization
摘要: 通用异构域适应指在源域和目标域的数据分布不同且标签集部分重叠时,通过迁移学习的方法,将源域的知识迁移到目标域。然而现有方法大多依赖同构特征空间假设或全局对齐,难以在通用异构域场景下实现精确的语义匹配与私有类拒绝。为此,本文提出一种面向通用异构域适应的部分融合最优传输模型。首先,针对异构空间中跨域距离难以直接度量问题,引入关键点引导机制,构建具有语义一致性的跨域关系代价函数。在此基础上,引入Gromov-Wasserstein距离保持域内几何结构,实现异构特征空间的分布匹配,引导跨域样本结构上的几何对齐。其次,为在共享部分标签情况下精准对齐公共类别并拒绝私有类别,将模型扩展为部分最优传输形式,通过限制总传输质量,仅对公共类别进行选择性匹配,从而有效拒绝目标域中的私有类样本。此外,引入了一种基于标签的组稀疏正则项,以诱导传输计划在类别维度呈现群稀疏性,进一步抑制私有类样本的误匹配。最终,本文构建了一个融合几何结构对齐、语义引导匹配与私有类拒绝的统一优化模型,并设计了一种结合Majorization-Minimization框架与Frank-Wolfe方法的高效求解算法。在三个跨域数据集上的实验结果表明,所提模型在公共类分类和私有类检测上均优于主流对比方法,验证了其在处理通用异构域适应问题上的有效性。
Abstract: Universal heterogeneous domain adaptation aims to transfer knowledge from a source domain to a target domain with distinct data distributions and partially overlapping label sets. However, most existing methods rely on homogeneous feature space assumptions or global alignment, making it difficult to achieve precise semantic matching and private class rejection under universal heterogeneous domain scenarios. To address these issues, this paper proposes a partial fused optimal transport model for universal heterogeneous domain adaptation. First, to directly measure cross-domain distances in heterogeneous spaces, a keypoint-guided mechanism is introduced to construct a semantically consistent cross-domain relational cost function. Building on this, the Gromov-Wasserstein distance is incorporated to preserve intra-domain geometric structures, enabling distribution matching across heterogeneous feature spaces and guiding geometric alignment of cross-domain samples at the structural level. Second, to accurately align common classes and reject private classes under partially shared labels, a partial optimal transport formulation is adopted, which restricts the total transported mass to selectively match only common categories, thereby effectively rejecting private-class samples in the target domain. Third, we introduce a label-based group-sparsity regularization, inducing structured sparsity in the transport plan at the category level to further suppress private-class mismatches. Finally, we formulate a unified optimization model that integrates geometric structure alignment, semantically guided matching, and private-class rejection. Then an efficient solver based on the Majorization-Minimization framework combined with the Frank-Wolfe method is designed. Experiments on three cross-domain datasets show that the proposed model outperforms competing methods in both public-class classification and private-class detection, demonstrating its effectiveness for general heterogeneous domain adaptation.
文章引用:艾诗琪, 马丽涛. 面向通用异构域适应的部分最优传输模型[J]. 统计学与应用, 2026, 15(3): 66-80. https://doi.org/10.12677/sa.2026.153056

参考文献

[1] 杨鹰, 李宁, 唐守伟, 等. 基于域适应的巡检场景跨域智能分析技术研究[J]. 电子元器件与信息技术, 2025, 9(9): 141-143, 147.
[2] Li, G., Kang, G., Zhu, Y., Wei, Y. and Yang, Y. (2021) Domain Consensus Clustering for Universal Domain Adaptation. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, 20-25 June 2021, 9752-9761. [Google Scholar] [CrossRef
[3] Saito, K., Yamamoto, S., Ushiku, Y. and Harada, T. (2018) Open Set Domain Adaptation by Backpropagation. In: Ferrari, V., Hebert, M., Sminchisescu, C. and Weiss, Y., Eds., Computer VisionECCV 2018, Springer, 156-171. [Google Scholar] [CrossRef
[4] Zhang, J., Ding, Z., Li, W. and Ogunbona, P. (2018) Importance Weighted Adversarial Nets for Partial Domain Adaptation. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, 18-23 June 2018, 8156-8164. [Google Scholar] [CrossRef
[5] 何秋妍, 邓明华. 通用域适应综述[J]. 计算机研究与发展, 2024, 61(1): 120-144.
[6] 吴兰, 崔全龙. 基于伪标签细化和语义对齐的异构域自适应[J]. 浙江大学学报(工学版), 2023, 57(9): 1876-1884, 1902.
[7] Tsai, Y.H., Yeh, Y. and Wang, Y.F. (2016) Learning Cross-Domain Landmarks for Heterogeneous Domain Adaptation. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, 27-30 June 2016, 5081-5090. [Google Scholar] [CrossRef
[8] Wang, Q. and Breckon, T.P. (2022) Cross-Domain Structure Preserving Projection for Heterogeneous Domain Adaptation. Pattern Recognition, 123, Article ID: 108362. [Google Scholar] [CrossRef
[9] Yao, Y., Zhang, Y., Li, X. and Ye, Y. (2020) Discriminative Distribution Alignment: A Unified Framework for Heterogeneous Domain Adaptation. Pattern Recognition, 101, Article ID: 107165. [Google Scholar] [CrossRef
[10] Wu, H., Wu, Q. and Ng, M.K. (2021) Knowledge Preserving and Distribution Alignment for Heterogeneous Domain Adaptation. ACM Transactions on Information Systems, 40, 1-29. [Google Scholar] [CrossRef
[11] Zhou, Z., Wang, Y., Niu, C. and Shang, J. (2022) Label-guided Heterogeneous Domain Adaptation. Multimedia Tools and Applications, 81, 20105-20126. [Google Scholar] [CrossRef
[12] Yan, Y., Li, W., Wu, H., Min, H., Tan, M. and Wu, Q. (2018) Semi-Supervised Optimal Transport for Heterogeneous Domain Adaptation. Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, Stockholm, 13-19 July 2018, 2969-2975. [Google Scholar] [CrossRef
[13] 王碧琳. 基于最优传输的无监督领域自适应方法研究[D]: [博士学位论文]. 长春: 吉林大学, 2023.
[14] Yang, Y., Gu, X. and Sun, J. (2023) Prototypical Partial Optimal Transport for Universal Domain Adaptation. Proceedings of the AAAI Conference on Artificial Intelligence, 37, 10852-10860. [Google Scholar] [CrossRef
[15] You, K., Long, M., Cao, Z., Wang, J. and Jordan, M.I. (2019) Universal Domain Adaptation. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, 15-20 June 2019, 2715-2724. [Google Scholar] [CrossRef
[16] Yin, Y., Yang, Z., Wu, X. and Hu, H. (2021) Pseudo-Margin-Based Universal Domain Adaptation. Knowledge-Based Systems, 229, Article ID: 107315. [Google Scholar] [CrossRef
[17] Saito, K. and Saenko, K. (2021) OVANet: One-Vs-All Network for Universal Domain Adaptation. 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, 10-17 October 2021, 8980-8989. [Google Scholar] [CrossRef
[18] Fu, B., Cao, Z., Long, M. and Wang, J. (2020) Learning to Detect Open Classes for Universal Domain Adaptation. In: Vedaldi, A., Bischof, H., Brox, T. and Frahm, J.M., Eds., Computer VisionECCV 2020, Springer, 567-583. [Google Scholar] [CrossRef
[19] Chen, L., Lou, Y., He, J., Bai, T. and Deng, M. (2022) Geometric Anchor Correspondence Mining with Uncertainty Modeling for Universal Domain Adaptation. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, 18-24 June 2022, 16113-16122. [Google Scholar] [CrossRef
[20] Saito, K., Kim, D., Sclaroff, S. and Saenko, K. (2020) Universal Domain Adaptation through Self Supervision. Advances in Neural Information Processing Systems, 33, 16282-16292.
[21] Ma, X., Gao, J. and Xu, C. (2021) Active Universal Domain Adaptation. 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, 10-17 October 2021, 8948-8957. [Google Scholar] [CrossRef
[22] 陈庚彪. 基于通用域自适应的开放世界多模态社会媒体事件检测研究[D]: [硕士学位论文]. 南京: 南京信息工程大学, 2025.
[23] 陈汇. 基于Gromov-Wasserstein距离的3D对称图形匹配新方法[D]: [硕士学位论文]. 长春: 吉林大学, 2023.
[24] del Barrio, E., González Sanz, A. and Loubes, J. (2024) Central Limit Theorems for Semi-Discrete Wasserstein Distances. Bernoulli, 30, 554-580. [Google Scholar] [CrossRef
[25] Nguyen, K., Nguyen, D., Pham, T. and Ho, N. (2022) Improving Mini-Batch Optimal Transport via Partial Transportation. International Conference on Machine Learning, Baltimore, 17-23 July 2022, 16656-16690.
[26] 王碧琳, 王生生, 张哲. 面向领域自适应的部分最优传输高光谱图像分类[J]. 光学精密工程, 2023, 31(17): 2555-2563.
[27] Xu, H., Liu, J., Luo, D. and Carin, L. (2023) Representing Graphs via Gromov-Wasserstein Factorization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45, 999-1016. [Google Scholar] [CrossRef] [PubMed]
[28] Chapel, L., Alaya, M.Z. and Gasso, G. (2020) Partial Optimal Transport with Applications on Positive-Unlabeled Learning. Advances in Neural Information Processing Systems, 33, 2903-2913.
[29] Gu, X., Sun, J., Xu, Z., Yang, Y. and Zeng, W. (2022) Keypoint-Guided Optimal Transport with Applications in Heterogeneous Domain Adaptation. Advances in Neural Information Processing Systems 35, New Orleans, 28 November-9 December 2022, 14972-14985. [Google Scholar] [CrossRef
[30] Courty, N., Flamary, R. and Tuia, D. (2014) Domain Adaptation with Regularized Optimal Transport. In: Calders, T., Esposito, F., Hüllermeier, E. and Meo, R., Eds., Machine Learning and Knowledge Discovery in Databases, Springer, 274-289. [Google Scholar] [CrossRef
[31] 仝灿. 基于Majorization-Minimization算法的机器学习算法研究[D]: [博士学位论文]. 沈阳: 东北大学, 2022.
[32] Jaggi, M. (2013) Revisiting Frank-Wolfe: Projection-Free Sparse Convex Optimization. International Conference on Machine Learning, Atlanta, 16-21 June 2013, 427-435.
[33] Chen, W., Hsu, T.H., Tsai, Y.H., Wang, Y.F. and Chen, M. (2016) Transfer Neural Trees for Heterogeneous Domain Adaptation. In: Leibe, B., Matas, J., Sebe, N. and Welling, M., Eds., Computer VisionECCV 2016, Springer, 399-414. [Google Scholar] [CrossRef
[34] Bucci, S., Loghmani, M.R. and Tommasi, T. (2020) On the Effectiveness of Image Rotation for Open Set Domain Adaptation. In: Vedaldi, A., Bischof, H., Brox, T. and Frahm, J.M., Eds., Computer VisionECCV 2020, Springer, 422-438. [Google Scholar] [CrossRef
[35] Conover, W.J. (1999) Practical Nonparametric Statistics. John Wiley & Sons.