摘要
海量卫星监测数据不断增大,为提高HBase数据库的入库效率,本文以张衡一号卫星空间电场探测仪ULF频段数据为例,进行基于HBase数据库的入库方法研究,将HBase提供的多种入库方法进行对比实验,提出了将HBase API方法和MapReduce Bulk Load方法结合的方案,来满足不同数据量的入库需求,为张衡一号卫星的海量数据入库提供了技术支撑,为后续基于HBase的大数据存储方案的设计奠定了基础。
With the increasing of massive satellite monitoring data,in order to improve the efficiency of HBase database entry,this paper takes the ULF frequency band data of Zhang Heng-1 satellite space electric field detector as an example to study the entry method based on HBase database,and carries out comparative experimental research on various entry methods provided by HBase.A scheme combining HBase API method and MapReduce Bulk Load method is proposed to meet the storage requirements of different amounts of data,which provides technical support for the massive data storage of Zhang Heng-1 satellite and lays a foundation for the subsequent design of HBase-based big data storage schemes.
作者
杨旭明
李忠
李锦文
贾娟
杨百一
张富志
YANG Xuming;LI Zhong;LI Jinwen;JIA Juan;YANG Baiyi;ZHANG Fuzhi(Institute of Disaster Prevention,Institute of Emergency Management,Sanhe Hebei 065201,China)
出处
《智能计算机与应用》
2022年第2期54-57,63,共5页
Intelligent Computer and Applications
基金
张衡一号卫星电场数据的大数据平台研发(2021057)
