期刊文献+

HBase负载均衡分析及优化策略 被引量:4

HBase Load Balancing Algorithm Analysis and Improvement
下载PDF
导出
摘要 HBase作为Hadoop分布式开源云数据库因其高可用性等优势越来越受到青睐,但是随着大量数据的注入,HBase对负载的分配状况将直接影响到整个集群的性能优劣.针对原有负载均衡算法在负载分配过程中可能产生的负载严重不均衡问题,通过分析原有算法和问题出现的因素,提出一种基于子表限制的负载均衡改进方法,并通过与不均衡状况下的对比实验,验证改进后的分配方式可以有效利用集群中各个节点的资源,从而提高分布式集群性能. As the Hadoop distributed open source database, HBase gradually gained a lot of attention due to its high- performance. However, with a large amount of data pouring into HBase, the situation of load distribution by HBase will directly affect the performance of the whole cluster. With the problem of load seriously imbalances in the process of original algorithm, proposed a novel load-balancing approach based on the limited child table, with the analysis of original algorithm and the causes of the problem. The contrast experiment showed that the improved approach of scheduling can make effective use of each node resources in the cluster, thereby improved the performance of the distributed cluster.
出处 《微电子学与计算机》 CSCD 北大核心 2016年第4期125-128,共4页 Microelectronics & Computer
基金 河北省自然科学基金项目(F2015402077) 河北省高等学校科学技术研究重点项目(ZD2014054)
关键词 云计算 HBASE 负载均衡 节点资源 集群性能 cloud computing HBase load balancing node resources cluster performance
  • 相关文献

参考文献10

  • 1The apache HBase reference guide. The Apache HBase Book[EB/OL].[2015-04-20]. http://hbase, apache. org/book/book, html. 被引量:1
  • 2王荣生,杨际祥,王凡.负载均衡策略研究综述[J].小型微型计算机系统,2010,31(8):1681-1686. 被引量:21
  • 3丛珉,陆民燕,白云峰.软件可靠性预计方法研究及实现[J].北京航空航天大学学报,2002,28(1):34-38. 被引量:13
  • 4刘琨,肖琳,赵海燕.Hadoop中云数据负载均衡算法的研究及优化[J].微电子学与计算机,2012,29(9):18-22. 被引量:19
  • 5Mk78x. HBase Load Balancing Algorithm[EB/OL]. [2015-04-20]. http: // www. linuxidc, com/Linux/ 2013-07/87233. htrn. 被引量:1
  • 6DataScientist. HBase Optimization Case Study[EB/OL]. [2015-04-20]. http: //yanbohappy, sinaapp, corn/? tag : hba se. 被引量:1
  • 7Oredope A, Moessner K, Peoples C, et al. Deploying cloud services in mobile networks[C]//Science and In- formation Conference (SAI), London: IEEE, 2013: 928-933. 被引量:1
  • 8Zhang Changlun, Wang Kaixuan, Mu Haibing. A Pri- ority Queue Algorithm for the Replication Task in HBase [J]. Journal of Software, 2013, 8 ( 7): 1765-1769. 被引量:1
  • 9lhcx1989. Hadoop and Hbase Cluster Setup[EB/OL]. [2015-04-20]. http:/blog, csdn. net/lhcx1989/arti- cle/details/8140265. 被引量:1
  • 10Search Technology Blog. How to Develop LoadBalanc- ing Plugins with HBase[EB/OL]. [2015-04-20]. ht- tp://www, searchtb, com/2012/05/hbase_loadbalance _plugins. html. 被引量:1

二级参考文献66

  • 1何国伟.软件的MTBF及其验证试验[J].电子产品可靠性与环境试验,1995,13(1):2-6. 被引量:6
  • 2杨学军,窦勇,胡庆丰.Progress and Challenges in High Performance Computer Technology[J].Journal of Computer Science & Technology,2006,21(5):674-681. 被引量:7
  • 3Lyu Michael R 刘喜成等(译).软件可靠性工程手册[M].北京:电子工业出版社,1996.47-107,274-285. 被引量:1
  • 4白云峰.基于失效数据的软件可靠性评估及其改进方法研究[M].北京:北京航空航天大学工程系统工程系,1999.. 被引量:1
  • 5The Top500 Supercomputer Sites, 2009. Processor Generation share for 11/2008[EB/OL], http://www.top500. org/charts/list/30/archtype, 2008-11-01/2009-05-14. 被引量:1
  • 6Wu X F, Taylor V, Lively C, et al. Performance analysis and optimization of parallel scientific applications on CMP clusters [J]. Scalable Computing: Practice and Experience, 2009, 10(1) : 61-74. 被引量:1
  • 7Hennessy J L, Patterson D A. Computer architecture: a quantitative approach [M]. San Francisco, CA: Morgan Kaufrman Publishers, 2007. 被引量:1
  • 8Yasar O, Dag H. Trends in parallel computing[ J]. Parallel Computing, 2007, 33(2):81-82. 被引量:1
  • 9Devine K D, Boman E G, Heaphy R T, et al. New challenges in dynamic load balancing [J]. Applied Numerical Mathematics, 2005, 52(2-3) :133-152. 被引量:1
  • 10Willebeek-LeMair M H,Reeves A P. Strategies for dynamic load balancing on highly parallel computers[ J]. IEEE Transactions on Parallel and Distributed Systems, 1993, 4(9) : 979-993. 被引量:1

共引文献50

同被引文献26

引证文献4

二级引证文献12

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部