摘要
随着全球数据的指数级激增,数据中心在存储和管理数据方面正面临空前挑战,基于服务器架构的传统数据中心在资源利用率、扩展性、性能等方面的缺陷日益显著,已经愈发难以满足业务需求.近年来,一种分离式数据中心架构得到了学术界和工业界的广泛关注:该架构下,硬件资源被拆分为不同的硬件资源池(例如处理器池、内存池、存储池等),并通过高速网络互连;管理员可以按需扩展特定的硬件资源池,且各类硬件资源可以在不同应用间灵活共享.然而,分离式数据中心架构在访存模式、存储层级、容错模型、软件开销等方面呈现出显著差异,这为构建分离式架构友好的存储系统带来了新的挑战.首先,分析了分离式数据中心的驱动因素,阐述了其架构特点及优势,并综述了对应存储系统的关键技术和代表性研究工作;然后,围绕数据容错、异构计算及异构网络,展望了未来的发展趋势并给出了总结.
Exponential growth in data has resulted in unprecedented challenges regarding data storage and management for data centers globally.It is becoming increasingly difficult to meet business needs due to the deficiencies of the traditional server-centric data center architecture in resource utilization,scalability,and performance.Recently,the disaggregated data center architecture has attracted considerable attention from academia and industry.In this architecture,hardware resources are decoupled into different hardware resource pools(such as processor,memory,and storage pools).These resource pools are interconnected through a high-speed network and can be scaled independently as needed;moreover,the pooled hardware resources can be flexibly shared among different applications,resulting in higher utilization.However,the disaggregated data center architecture presents significant differences in memory access mode,storage hierarchy,fault tolerance model,and software overhead,which elicits new challenges in building storage systems on top of such novel architectures.In this work,factors driving disaggregated data centers are analyzed,and their architectural features and advantages are described.Furthermore,the key technologies and representative research work on disaggregated storage systems are summarized.Lastly,future development trends,including memory-level data reliability and heterogeneous computing and networking,are outlined.
作者
舒继武
陈游旻
汪庆
王晶
李俊儒
廖晓坚
Jiwu SHU;Youmin CHEN;Qing WANG;Jing WANG;Junru LI;Xiaojian LIAO(Department of Computer Science and Technology,Tsinghua University,Beijing 100084,China)
出处
《中国科学：信息科学》
CSCD
北大核心
2023年第8期1503-1528,共26页
Scientia Sinica(Informationis)
基金
国家重点研发计划(批准号:2022YFB4500302)
国家自然科学基金(批准号:61832011,62202255)
中国博士后创新人才支持计划(批准号:BX2021154)资助项目。
关键词
分离式数据中心
分离式内存
分离式存储
存算分离
disaggregated datacenter
disaggregated memory
disaggregated storage
separation of compute and storage
