期刊文献+

基于灰色马尔可夫链预测模型的HDFS云存储副本选择策略 被引量:3

Strategy of replica selection based on grey Markov chain prediction model in HDFS
下载PDF
导出
摘要 在Hadoop分布式文件系统(HDFS)云存储环境下,网络带宽和节点性能有限且动态变化,现有的副本选择策略无法根据环境的变化选择最合适副本。针对这一问题,提出一种综合考虑了网络带宽、节点I/O性能以及节点存储空间等因素,基于灰色马尔可夫链预测模型的副本选择策略,以此在系统可用性和负载均衡性之间寻求一个平衡。最后通过仿真实验,验证了该策略的可行性与有效性。 In Hadoop Distributed File System(HDFS) where the network bandwidth and performance of nodes are limited and changed dynamically,the current strategy of replica selection can not adopt the most suitable replica according to the changes of the environment.Aiming at this problem,a new strategy of replica selection based on grey Markov chain prediction model which takes network band width,performance of I/O and storage space of nodes into the comprehensive consideration was proposed to seek a balance between system usability and load balancing.Simulation experimental results prove the validity and practicability of this new strategy.
出处 《计算机应用》 CSCD 北大核心 2011年第A02期39-42,共4页 journal of Computer Applications
基金 国家自然科学基金资助项目(70801036)
关键词 云存储 副本选择 灰色马尔可夫链 HADOOP分布式文件系统 cloud storage replica selection grey Markov chain Hadoop Distributed File System(HDFS)
  • 相关文献

参考文献10

二级参考文献18

  • 1孙敏,孙济洲,李明楚,于策.基于蚂蚁算法的数据网格副本选择策略[J].计算机工程与应用,2007,43(1):145-147. 被引量:5
  • 2蒋承仪.灰色马尔柯夫预测模型[J].重庆建筑大学学报,1996,18(3):116-122. 被引量:48
  • 3孙海燕,等.数据网格中的数据复制技术研究[M].重庆:计算机科学,2005-7. 被引量:1
  • 4Sudharshna Vazhkudai, Steven Tuccke, lna Foster. Replica Selection in the Globus Data Grid [ C ]. IEEE International Symposium on Cluster Computing and the Grid. 2001. 被引量:1
  • 5Sudha Krishnamurtby, Willima H Sanders, Michhel Cukier. Performance Evaluation of a Probabilistic Replica Selection Algorithm [ C]. Proceeding of the 7th International Workshop on Object -Oriented Real -time Dependable Systems, 2002. 被引量:1
  • 6S Vazhkudai, J Schopf. Using Regression Techniques to Predict large Data Transfers [J]. The Journal of High Performance Computing Applications: Special Issue on Grid Computing: Infrastructure and Application. 2003. 被引量:1
  • 7熊信银 吴耀武.遗传算法及其在电力系统中的应用[M].武汉:华中科技大学出版社,2001.. 被引量:6
  • 8FOSTER I, KESSELMAN C, TUECKE S. The anatomy of the grid: enabling scalable virtual organizations [J]. International Journal of High Performance Computing Applications,2001,15(3) : 200 -222. 被引量:1
  • 9WEI JIE, CAI WEN-TONG. Dynamic load-balancing in a data parallel object-oriented system[ C]// Proceedings of the Eighth International Conference on Parallel and Distributed Systems. Washington, DC: IEEE Computer Society, 2001:279 -288. 被引量:1
  • 10SUDHARSHAN V,SCHOPF M J. Using regression techniques to predict large data transfers[ J]. International Journal of High Performance Computing Applications, 2003, 17(3) : 249 - 268. 被引量:1

共引文献26

同被引文献30

  • 1陈有孝,林晓言.灰色——马尔可夫链改进的预测方法[J].统计与决策,2005,21(08X):36-38. 被引量:26
  • 2Borthakur D.The hadoop distributed file system:Architecture and design[J].Hadoop Project Website,2007,11:21. 被引量:1
  • 3Shvachko K,Kuang H,Radia S,et al.The hadoop distributed file system[C]∥2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST).IEEE,2010:1-10. 被引量:1
  • 4Ghemawat S,Gobioff H,Leung S T.The Google file system[J].ACM SIGOPS Operating Systems Review.ACM,2003,37(5):29-43. 被引量:1
  • 5蔡斌,陈湘萍.Hadoop技术内幕[M].北京:机械工业出版,2013:216-217. 被引量:3
  • 6Xie J,Yin S,Ruan X,et al.Improving mapreduce performance through data placement in heterogeneous hadoop clusters[C]∥2010 IEEE International Symposium on Parallel & Distributed Processing,Workshops and Phd Forum (IPDPSW).IEEE,2010:1-9. 被引量:1
  • 7Ananthanarayanan G,Agarwal S,Kandula S,et al.Scarlett:co-ping with skewed content popularity in mapreduce clusters[C]∥Proceedings of the sixth conference on Computer systems.ACM,2011:287-300. 被引量:1
  • 8Abad C L,Lu Y,Campbell R H.DARE:Adaptive data replication for efficient cluster scheduling[C]∥2011 IEEE International Conference on Cluster Computing (CLUSTER).IEEE,2011:159-168. 被引量:1
  • 9Massie M L,Chun B N,Culler D E.The ganglia distributed monitoring system:design,implementation,and experience[J].Paral-lel Computing,2004,30(7):817-840. 被引量:1
  • 10邵静,王利超,刘新平.灰色马尔科夫模型及其应用[J].纺织高校基础科学学报,2009,22(3):370-374. 被引量:13

引证文献3

二级引证文献4

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部