摘要
为提高海量告警数据的处理效率,设计并实现一种网络管理中面向海量告警数据的并行处理系统,由采集任务更新模块、采集任务调度模块、采集任务处理模块和系统管理模块构成。系统核心为采集任务调度模块,通过采用带宽资源目标和/或计算资源目标计算的双目标任务调度模式,利用采集机的带宽资源和计算资源,提高海量告警数据的采集效率。该系统可广泛适用于网络数据采集及其它领域。
A mass alarm data oriented parallel processing system for network management was designed and implemented.The system was composed of four modules including acquisition task update module,acquisition task scheduling module,acquisition task processing module,and system management module.The core of the system was the task scheduling module,which used both bandwidth resources and computing resources as targets for scheduling.The number of acquisition tasks that could be processed in parallel in a single acquisition trigger cycle was computed.The acquisition tasks were mapped to the physical processing unit of the data acquisition equipment waiting for processing.The bandwidth resources and the computing resources of the data acquisition equipment were utilized,and the efficiency of data acquisition for mass alarm data was improved.The system can be widely used for network data acquisition and other related areas.
作者
张海阔
陆忠华
刘芳
李井泉
孙辰军
王珏
ZHANG Hai-kuo;LU Zhong-hua;LIU Fang;LI Jing-quan;SUN Chen-jun;WANG Jue(Computer Network Information Center,Chinese Academy of Science,Beijing 100190,China;University of Chinese Academy of Sciences,Beijing 100049,China;China Internet Network Information Center,Beijing 100190,China;Hebei Electric Power Company,State Grid,Shijiazhuang 050022,China)
出处
《计算机工程与设计》
北大核心
2018年第2期407-413,共7页
Computer Engineering and Design
基金
国家863高技术研究发展计划基金项目(2015AA01A303)
国家电网公司科技基金项目(SGHEXT00YJJS1700217)
中国科学院青年创新促进会基金项目(2015375)
关键词
海量告警数据
网络管理
数据采集
并行处理
任务调度
mass alarm data
network management
data acquisition
parallel processing system
task scheduling