摘要
步入大数据时代之后,致力于解决大规模科学计算问题的高性能计算技术,得到了越来越广泛的关注与应用。随着高性能计算机制造产业的蓬勃发展,具有每秒上亿亿次浮点运算速度的高性能计算集群对高性能计算环境中间件的性能提出了更高的要求。现有的高性能计算环境中间件中,资源信息服务无法满足海量信息快速更新的需求。为了提高高性能计算环境中间件的性能,通过借鉴ETL技术,将资源信息传输方式优化为信息同步模式。优化后的信息同步模式在处理2 000条作业状态更新时,延迟时间缩短90%、系统负载降低98%、网络连接数减少90%,为系统维护人员、环境用户带来更好的用户体验。
Ever since the arrival of big data era,high performance computing technology which committed to solving largescale scientific computing problems,has been more and more extensively focused and widely applied. As the booming of high performance computer manufacturing industry,high performance computer cluster with float computing speed up to several quintillion times per second requires further optimization of the high performance computing environment middleware. In current high-performance computing environment middleware,the information transmission mode of resource information service cannot meet the requirement of rapid updating of massive information. In order to improve the performance of high performance computing environment middleware,this paper used ETL technology to optimize the information transmission mode to information synchronization mode. After optimizing the processing of 2 000 pieces of resource information,it reduced the latency by90%,reduced the system load by 98%,and reduced the number of network connections by 90%,which provided enhanced user experience to the system maintenance personnel and users.
作者
吴璨
王小宁
肖海力
曹荣强
赵一宁
迟学斌
Wu Can;Wang Xiaoning;Xiao Haili;Cao Rongqiang;Zhao Yining;Chi Xuebin(Dept.of High Performance Computing Technology & Application Development,Computer Network Information Center,Chinese Academy of Sciences,beijing 100190;University of Chinese Academy of Sciences,beijing 100049,china)
出处
《计算机应用研究》
CSCD
北大核心
2019年第1期163-167,共5页
Application Research of Computers
基金
中国科学院战略性先导科技专项项目(A类)(XDA19020101)
中国科学院青年创新促进会资助项目(2017216)
中国科学院信息化专项项目(XXH13503-04)
关键词
高性能计算环境中间件
资源信息服务
信息传输方式
信息同步模式
high performance computing environment
resource information service
information transmission mode
information synchronization mode
