面向多模态数据的信息综合保障知识图谱构建方法研究
Research on Construction Method of Knowledge Graph for Comprehensive Information Support Based on Multimodal Data
摘要: 信息化环境下,信息综合保障流程中的数据呈现多源异构、模态多样、语义关联复杂的特征,传统分散式信息管理模式存在信息孤岛突出、跨模态融合困难、决策支撑能力薄弱等问题。针对信息综合保障领域缺少定制化多模态知识建模方案的痛点,本文提出面向多模态数据的信息综合保障领域知识图谱构建方案。可有效整合多模态信息数据,为信息综合保障提供结构化知识支撑。本文详细介绍了多模态数据处理及知识图谱的构建方法,为相关领域的研究和实践提供参考。
Abstract: In the information-based environment, the data within the comprehensive information support workflow are characterized by multi-source heterogeneity, diverse modalities and complex semantic correlations. The traditional decentralized information management mode suffers from prominent information silos, difficulties in cross-modal fusion and insufficient decision-making support capacity. To address the pain point of lacking customized multimodal knowledge modeling solutions in the field of comprehensive information support, this paper proposes a construction scheme for domain knowledge graphs oriented to multimodal data for comprehensive information support. This scheme can effectively integrate multi-modal information data and provide structured knowledge support for comprehensive information support operations. This paper elaborates on multi-modal data processing and knowledge graph construction methods, offering references for research and practical applications in related fields.
文章引用:张智隆, 史小敏, 屠义强, 顾双龙, 商帅帅. 面向多模态数据的信息综合保障知识图谱构建方法研究[J]. 数据挖掘, 2026, 16(4): 143-153. https://doi.org/10.12677/hjdm.2026.164013

参考文献

[1] 李亮, 丁凡, 吴志豪, 等. 作战指挥信息系统智能化发展策略探析[C]//中国指挥与控制学会. 第十三届中国指挥控制大会论文集(上册). 北京: 兵器工业出版社, 2025: 462-466.
[2] 许雅平. 战场资源知识图谱的构建与应用[D]: [硕士学位论文]. 南京: 南京理工大学, 2021.
[3] 黄伟春. 军事术语知识图谱构建与应用研究[D]: [硕士学位论文]. 北京: 军事科学院, 2023.
[4] 龚博文. 面向指挥导调的领域知识图谱构建方法及应用[J]. 指挥控制与仿真, 2025, 47(4): 7-14.
[5] 姚奕, 陈朝阳, 杜晓明, 等. 多模态知识图谱构建技术及其在军事领域的应用综述[J]. 计算机工程与应用, 2024, 60(22): 18-37.
[6] 李至颖, 杨丽娜, 顾振雷, 等. 基于多模态知识图谱的海事检查智能问答系统构建[J]. 计算机工程与应用, 2026, 62(13): 353-364.
[7] 沈伟豪, 钟燕飞, 王俊珏, 等. 多模态数据的洪涝灾害知识图谱构建与应用[J]. 武汉大学学报(信息科学版), 2023, 48(12): 2009-2018.
[8] 姚鹏飞. 基于元数据的多源异构作战数据质量控制研究[J]. 舰船电子工程, 2026, 46(2): 21-24.
[9] 宗滕, 吴松涛, 周春华. 基于多模态数据分析的典型智能化军事应用[J]. 信息安全与通信保密, 2022(2): 9-16.
[10] Gao, J., Li, P., Chen, Z. and Zhang, J. (2020) A Survey on Deep Learning for Multimodal Data Fusion. Neural Computation, 32, 829-864.
https://doi.org/10.1162/neco_a_01273
[11] 陈烨, 周刚, 卢记仓. 多模态知识图谱构建与应用研究综述[J]. 计算机应用研究, 2021, 38(12): 3535-3543.
[12] Jiang, M. and Ji, S.X. (2022) Cross-Modality Gated Attention Fusion for Multimodal Sentiment Analysis.
https://arxiv.org/abs/2208.11893
[13] Lei, J., Li, L., Zhou, L., Gan, Z., Berg, T.L., Bansal, M., et al. (2021) Less Is More: CLIPBERT for Video-and-Language Learning via Sparse Sampling. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, 20-25 June 2021, 7327-7337.
https://doi.org/10.1109/cvpr46437.2021.00725
[14] Akbari, H., Yuan, L., Qian, R., et al. (2021) VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text. Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, 6-14 December 2021, 24206-24221.
[15] Huang, Z., Zeng, Z., Liu, B., et al. (2020) Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers.
https://arxiv.org/abs/2004.00849
[16] 王远, 罗士秒, 宋振之, 等. 演训多模态知识图谱的构建及应用[J]. 火力与指挥控制, 2025, 50(12): 124-134.
[17] 岳旭斌, 毛影, 张文戈. 面向军事信息化领域的知识图谱构建方法研究[J]. 舰船电子工程, 2026, 46(2): 25-29.