摘要
在地质调查工作过程中,各类信息系统产生了海量的业务管理数据,需要解决这些多来源、高动态、复杂异构数据的有效集成辅助决策问题,驱动管理决策现代化。基于大数据、GIS、数据挖掘等技术,构建了地质调查业务管理数据集成辅助决策的总体架构;通过多源异构数据自动化动态集成处理、基于Hadoop的“湖仓一体”混合式数据组织管理、数据挖掘融合地理智能的分析决策模型等关键技术方法,研发了国家地质调查业务管理大数据系统。系统已接入24个数据源,实现了自动化动态集成,完成了1.5亿余条、20多万档异构数据的一体化组织管理,通过数据和分析服务有效辅助了管理决策。可有效解决大数据环境下数据集成辅助决策问题,提升国家地质调查工作管理决策的效率和水平。
Various information systems have been constructed for national geological survey organization,which have generated massive multi-source and heterogeneous management data.Effective integration and analysis of these data are in dire needs,for the collaborative and intelligent management of the national geological survey.This paper creates a framework based on big data,GIS and data mining technologies.Related key technologies are proposed,involving automatic and dynamic data integration,hybrid data management by Hadoop and"data-lake-warehouse"architecture,and decision support model for geological survey management.Based on the above,National Geological Survey Management Big Data System was constructed,which has integrated data from 24 different sources automatically and dynamically,more than 150 million records and 200 thousand documents have been organized in one,and has supported management decision by data or analysis services.It has been proved that can solve the problem of data integration for decision-making support,and has promoted the management efficiency of the national geological survey.
作者
文敏
月一
张怀东
王想红
施艳
刘荣梅
孙涵睿
WEN Min;YUE Yi;ZHANG Huaidong;WANG Xianghong;SHI Yan;LIU Rongmei;SUN Hanrui(Natural Resources Comprehensive Survey Command Center,China Geological Survey,Beijing 100055,China;Development and Research Center,China Geological Survey,Beijing 100037;National Engineering Research Center of Geographic Information System,Wuhan 430078,Hubei,China;Technology Innovation Center for Geological Information,MNR,Beijing 100037,China)
出处
《地质通报》
CAS
CSCD
北大核心
2024年第7期1221-1232,共12页
Geological Bulletin of China
基金
中国地质调查局项目《地质调查业务管理与辅助决策系统建设》(编号:DD20160356A)、《地质调查业务管理信息支撑与服务》(编号:DD20190403A)、《地球科学数据集成与服务》(编号:DD20221785)。
