摘要
数据仓库建设作为信息社会中人们提取信息的关键技术,已经相当成熟。但是传统数据仓库单独建设ETL调度子系统、数据质量管理子系统和元数据管理子系统的数据仓库体系,容易导致配套子系统描述的不一致。文章阐述了一种基于统一管控体系的数据仓库建设思路及其架构,通过构建新的管控体系改变传统的数据处理和管理方式,实现数据“统一采集、统一存储、统一管理、统一运营、统一服务”,解决了传统数据仓库各子功能系统之间无法良好协同、描述不一致的问题。该系统在实际应用中取得了较好的效果,具有较高的应用价值。
The construction of data warehouse, as a key technology for people to extract information in the information society, has been quite matured. However, traditional data warehouse can lead to the inconsistency of supporting subsystems, because subsystem of ETL scheduling, subsystem of data quality management and subsystem of metadata management are built separately. So a method of establishing data warehouse based on uniform data management and control system is introduced in this paper. The aim of "unified collection, unified storage, unified management, unified operation and unified service" can be achieved by the new management and control system, which substitutes the traditional data processing and management methods, and solves the problem that the sub-function systems of traditional data warehouse can not cooperate well and describe inconsistently. This system has achieved good effects, and has good practicability and high application value.
作者
王小红
周炳
Wang Xiaohong;Zhou Bing(Shanghai Credit Information Services Co.,Ltd,Shanghai 200002,China;The Credit Reference Center,the People’s Bank of China)
出处
《计算机时代》
2019年第8期40-43,共4页
Computer Era
关键词
数据仓库
ETL
元数据
统一管控体系
数据生产线
data warehouse
ETL
metadata
uniform data management and control system
data assembly line
