摘要
随着云计算、物联网、移动互联网等技术的飞速发展,海量数据在这些崭新的领域迅猛地生长着,大数据作为一项颠覆性技术,为处理海量数据提供了无限可能。而传统的关系型数据库的不再适用,导致了分布式数据库NoSQL的应运而生。针对大数据领域面临的种种现实难题,设计并实现了一种基于Hadoop和NoSQL的新型分布式大数据管理系统(DBDMS),其提供大数据的实时采集、检索以及永久存储的功能。实验表明,DBDMS可以显著提高大数据处理能力,适用于海量日志备份和检索、海量网络报文抓取和分析等领域。
With the pretty rapid development of cloud computing,internet of things,mobile internet,and other technologies,mass data grows in those areas in violent speed.Big Data provides a possibility of handling mass data,which acts as a subversive technique.By the way,traditional relation database is no more effective of mass data that causes distributed database NoSQL to appear and evolve.Facing with actual and various difficulties,we designed and realized a new distributed big data management system（DBDMS）,which is based on Hadoop and NoSQL techniques,and it provides big data real-time collection,search and permanent storage.Proved by some experiment,DBDMS can enhance the processing capacity of mass data,and very fits for mass log backup and retrieval,mass network packet grab and analysis,and other applied areas.
出处
《计算机科学》
CSCD
北大核心
2014年第B11期393-395,共3页
Computer Science
基金
国家社会科学基金项目(06BFX051)
上海高校选拔培养优秀青年教师科研专项基金(hzf05046)
华东政法大学校级科研项目(09HZK014)资助
