期刊文献+

浅论Hadoop平台在大数据中的应用 被引量:2

On the Application of Hadoop Platform in Big Data
下载PDF
导出
摘要 随着互联网信息技术的突飞猛进发展,加上移动智能手机、PC电脑、传感器的广泛使用,全球数据信息总量正呈现几何倍的增长态势,并且数据结构向着半结构化、非结构化方向发展,传统数据处理技术已经远不能满足现有需要。在此背景下,Hadoop作为应用最广泛的一种开源计算平台应运而生。文章通过介绍Hadoop平台的构架与原理,对Hadoop平台的大数据处理能力进行分析,通过与传统数据处理方式的比较,对大数据下Hadoop平台的未来进行了展望。 With the rapid development of Internet information technology,and the wide use of mobile intelligent mobile phone,PC as well as sensor,the amount of global data is showing geometric growth.Meanwhile,the data is becoming semi-structured and non-structured,the traditional data processing technology has been unable to meet existing needs.In this context,Hadoop has emerged as the most widely used open source computing platform.This paper introduces the structure and principle of Hadoop platform and analyzes the processing capability of big data on Hadoop platform.Compared with the traditional data processing methods,the data under the Hadoop platform in the future was prospected.
作者 陈琳
出处 《太原学院学报(自然科学版)》 2017年第3期56-59,共4页 Journal of TaiYuan University:Natural Science Edition
关键词 HADOOP平台 大数据 数据处理 HDFS MAPREDUCE Hadoop platform big data data processing HDFS MapReduce
  • 相关文献

参考文献2

二级参考文献14

  • 1魏红宁.基于SPRINT方法的并行决策树分类研究[J].计算机应用,2005,25(1):39-41. 被引量:18
  • 2Michael Miller姜进磊,孙瑞志,向勇等译.云计算[M].北京:机械出版社.2009. 被引量:34
  • 3Jeffrey Dean, Sanjay Ghemawat. MapReduce: Symplified Date Processing on Large Clusters[J]. New York:ACM,2008, 51(1):107-113. 被引量:1
  • 4韩家炜,坎伯.数据挖掘概念与技术[M].北京:机械工业出版社.2008. 被引量:6
  • 5John Shafer, Rakesh Agrawal,Manish Mehta. SPRINT:A Scalable Parallel Classifier for Data Mining [C].U.S:IBM Almaden Research Center,1996:544-555. 被引量:1
  • 6Jeffrey Dean and Sanjay Ghemawat.. MapReduce: Simplified Data Processing on Large Clusters, Communications of the ACM, vol. 51, no. 1 (2008), pp. 107-113. 被引量:1
  • 7Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leung. The Google File System, in Proceedings of the 19th ACM Symposium on Operating Systems Principles, ACM, Bolton Landing, NY (2003), pp. 20-43. 被引量:1
  • 8Fay Chang, Jeffrey Dean, Sanjay Ghemawat, wilson C. Hsieh, Deborah A. Wallach, Mike Burrows, Tushar Chandra, Andrew Fikes, and Robert E. Gruber. Bigtable: A Distributed Storage System for Structured Data, In Proceedings of OSDI 2006, pp. 205-218, Seattle, WA, 2006. 被引量:1
  • 9Apache Hadoop. http://hadoop.apache.org/. 被引量:1
  • 10Apache Hive. http://hive.apache.org/. 被引量:1

共引文献42

同被引文献2

引证文献2

二级引证文献2

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部