摘要
为解决军用和民用装备领域各类信息系统,多源、异构数据融合难的问题。该文提出一种基于ETL技术的装备大数据治理方案,主要包括多源数据抽取服务、数据清洗服务及数据加载服务;提出了数据标准统一和数据处理、全量与增量抽取等关键技术;为装备大数据的治理融合提供了一种可行的方式。
In order to solve various information systems in the military and civilian fields,which is difficult to inter grate multiple sources of heterogeneity.This paper proposes an equipment big data govermance scheme based on ETL technology,which mainly includes data extraction service,data cleaning service and data loading service.Key technologys such as full-quantity and incremental extraction,data standard unification and data process-ing schemes are proposed.Besides,the support mode providing a viable way to integrate the governance of big data.
作者
韩戈白
王博
陈迪
杨绍雄
Han Ge-bai;Wang Bo;Chen Di;Yang Shao-xiong(The 28th Research Institute of China ElectronicScience and Technology Group,Jiangsu Nanjing 210007)
出处
《电子质量》
2019年第4期34-43,共10页
Electronics Quality
关键词
装备大数据
数据治理
数据抽取
数据清洗
Equipment big data
data governance
data extraction
data cleaning