基于Hadoop作战试验异构数据平台的数据治理研究

Research on Data Governance Based on the Hadoop of Combat Test Heterogeneous Data Platform

摘要: 目前构建作战试验异构数据平台用以存储作战试验相关数据，然而装备作战试验的各项数据相对分散杂乱，缺乏对试验数据的有效管理与应用研究。针对平台建设使用过程中出现信息孤岛、数据质量低下、数据来源重复繁杂等不同程度的数据问题，进行数据治理的方法研究。本文分析了作战试验数据特点及治理需求，提出一套基于Hadoop作战试验异构数据平台的数据治理框架，构建了面向作战试验异构数据的HAO治理模型。有效解决大数据平台建设及使用、数据分析及可视化探索等大规模数据使用场景中可能遇到的数据问题，实现了大数据平台数据规范统一管理，极大地提高了数据质量，实现更加高效地发挥和挖掘作战试验数据的价值。

Abstract: The platform of heterogeneous combat test data is built to store the data related to combat test. The data of equipment combat test is relatively scattered and disorderly, and the effective management of test data is lacking. For the data problems of platform construction such as information islands, low data quality, and duplication of data sources, it studies the methods of data governance. This paper analyzes the characteristics and governance requirements of combat test data, proposes a set of data governance framework based on Hadoop combat test heterogeneous data platform, and constructs a HAO governance model. It effectively solves data problems that may be encountered in large-scale data usage scenarios such as construction and use of big data, data analysis and visual exploration, greatly improves data quality, realizes the unified management of data specifications of data platforms, and realizes more efficient play and mining of the value of combat test data.