摘要
对弹性分布式缓存动态扩展机制实现中的关键问题进行了研究。针对动态扩展时的数据重均衡问题,提出了一种适用于异构环境的热点感知的数据重均衡算法(hotspot sensitive data rebalancing algorithm,HSDRA)。该算法同时考虑内存占用和网络流量的均衡,在线识别热点分区,优先确保其在各缓存节点间均衡分布。针对动态扩展时缓存服务的数据一致性和持续可用性保障问题,分别提出了一种基于两阶段请求的数据访问协议和一种受控的数据迁移算法。实验结果表明,该方法能够在保障数据一致性和持续可用性的要求下实现缓存系统的动态扩展,HSDRA算法与未考虑各分区实际负载的加权静态数据重均衡算法相比响应时间更短。
This paper focuses on how to dynamically scale the cache system. Firstly, as to the data rebalancing problem, it proposes a hotspot sensitive data rebalancing algorithm (HSDRA), which can be applied in heterogeneous environment. HSDRA identifies hotspot partitions and gives priority to ensuring their uniform distribution across the cache servers while taking into account both memory footprint and network traffic. Then, as to the problem how to ensure data consistency and continuous availability of cache system in dynamic scaling, it proposes a data access protocol which is based on a two-phase request manner and a controlled data migration algorithm re- spectively. The experimental results show that the proposed approach can enable the cache system to scale dynami- cally under the condition that data consistency and continuous availability are guaranteed, and HSDRA outperforms the weighted static data rebalancing algorithm which doesn't consider actual load on each cache partition.
出处
《计算机科学与探索》
CSCD
2012年第2期97-108,共12页
Journal of Frontiers of Computer Science and Technology
基金
国家自然科学基金No.61173003
国家重点基础研究发展规划(973)No.2009CB320704
国家科技重大专项"核高基"项目No.2011ZX03002-002-01~~