期刊文献+

基于Prometheus的油田数据泄漏防护大数据系统运维方法 被引量:8

Operation and Maintenance Method of Big Data System for Oilfield Data Leakage Prevention based on Prometheus
下载PDF
导出
摘要 数据泄漏防护系统可以阻止企业的重要数据从网络出口违规外发。针对油田数据泄漏防护大数据平台对各个区域、不同类型的数据采集和设备、业务监测问题,本文首先提出依托大数据Flume(数据采集系统)组件,采用抓取外泄事件日志JSON(一种轻量级的数据交换格式)和解析后的违规外发文件txt文本的方法,实现数据采集;其次依托Prometheus服务监管系统Flume_exporter、Node_exporter组件和Grafana(一个跨平台的、开源的度量分析和可视化工具),实现对数据泄漏防护设备信息和应用数据的监管;最后指出搭建采集系统和监管平台对数据泄漏防护系统运维的作用。 Data leakage protection system can prevent important data of enterprises from being illegally exported from networks.This paper aims to solve problems of acquiring data of different types in different regions,and monitoring equipment and business on big data system for oilfield data leakage prevention.First,based on big data Flume(data acquisition system)component,this paper proposes to adopt the method of capturing JSON(JavaScript Object Notation,a lightweight data exchange format)of the leakage event log and the parsed illegally exported TXT file to achieve data acquisition.Second,Flume_exporter(Prometheus service supervision system),Node_exporter component and Grafana(a cross-platform open source measurement analysis and visualization tool)are used to supervise equipment information and application data of data leakage prevention.Finally,this paper points out the effect of building an acquisition system and supervision platform in operation and maintenance of data leakage prevention system.
作者 王晓锋 马丽丽 WANG Xiaofeng;MA Lili(Daqing Oilfield Information Technology Company,Daqing 163000,China)
出处 《软件工程》 2021年第4期43-46,共4页 Software Engineering
关键词 FLUME PROMETHEUS 数据采集 监管平台 Flume Prometheus data acquisition supervision platform
  • 相关文献

参考文献3

二级参考文献13

共引文献12

同被引文献48

引证文献8

二级引证文献11

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部