摘要
分布式文件系统的性能对整个分布式系统的性能有着重要的影响,以Hadoop分布式文件系统(HDFS)为研究目标,针对HDFS处理小文件数据性能差的问题,分析存在的问题,提出一种新的文件合并策略,优化系统I/O性能。实现结果表明这种合并策略能有效提高分布式文件系统的性能。
The performance of distributed file system has an important effect on the performance of the whole distributed system.This paper took Hadoop Distributed File System(HDFS) as the research object.In order to solve the poor performance problem of HDFS in term of processing small files,this paper analyzed the existing problem and presented a novel file merging strategy to optimize system I/O performance.The experiment results show this merging strategy can effectively improve the performance of distributed file system.
出处
《计算机应用》
CSCD
北大核心
2011年第A02期161-163,共3页
journal of Computer Applications