摘要
随着物联网、无线传感器网络等技术在煤矿应急管理信息化建设中的广泛应用,煤矿大量监测、控制及自动化等实时系统产生的流式数据会形成相当规模的数据集,对煤矿企业现有信息系统构架的海量数据存储及处理性能提出了更大的挑战。为了研究应对此挑战的海量数据存储技术,通过分析煤矿应急管理海量数据的来源及其特点,设计了云计算环境下基于NoSQL的煤矿应急管理海量数据存储方式,并对煤矿应急云平台进行了Hadoop基准测试,同时利用陕西黄陵矿业集团一号矿井某段周期内的瓦斯数据,对煤矿应急云平台和DBMS系统的处理性能进行对比。实验结果表明,基于Hadoop构建的煤矿应急云平台在海量数据存储与处理时均有良好的性能表现。
With the wide application of the Internet of Things and wireless sensor network technology in coal mine emergency management informatization construction,there are large scale data sets consisted of streaming data from real-time monitoring,controlling and automating system. A large challenger is the problem of massive data storage and processing in current coal mine information systems. In order to research the massive date storing technique which faces the challenge,the storage method based on NoSQL in cloud computing is designed by analyzing the source and characteristic of coal mine emergency management massive data. At the same time,Hadoop benchmark has been carried out in coal mine emergency cloud platform. The experiments comparing the processing performance between CECloud platform and DBMS system have been made with a period of gas data from No. 1 mine of Huangling Mining Group. The experimental results show that the CECloud platform based on hadoop has better performance in massive data storage and processing.
出处
《西安科技大学学报》
CAS
2014年第5期596-601,共6页
Journal of Xi’an University of Science and Technology
基金
陕西省教育厅科技专项(14JK1486)
国家自然科学基金(51304156)
