摘要
大数据一旦进入更多的企业,我们就会对大数据提出更多期望,除了数据统计,大数据时代还需要智能化分析,打破IT的约束,需要探索最高效的方式,快速抢占数据制高点。本文通过对某公司的分布式并行计算下数据自助分析平台中的应用方案进行研究与应用,提出在自助分析系统中对海量数据处理的思路,对分布式并行计算和分布式通信进行了重点分析,同时结合自助分析系统的功能特点,给出系统部署的应用建议。研究内容对于分布式计算在大数据决策分析系统的落地具有一定的实用价值。
Once big data enters more enterprises, we will put forward more expectations for big data. In addition to data statistics, the era of big data requires intelligent analysis, breaking the constraints of IT, and exploring the most efficient way to quickly seize the commanding heights of data. Based on the research and application of the application scheme of the data self-help analysis platform under the distributed parallel computing of a company, this paper puts forward the idea of massive data processing in the self-help analysis system, and focuses on the analysis of distributed parallel computing and distributed communication. At the same time, combining with the functional characteristics of the self-help analysis system, the paper gives the following suggestions: Put forward the application suggestion of system deployment. The research content has certain practical value for the landing of distributed computing in large data decision analysis system.
作者
翁业林
蒋道霞
俞新华
WENG Ye-lin;JIANG Dao-xia;YU Xin-hua(Jiangsu Vocational and Technical College of Finance and Economics,Huai'an 223001,China;Jiangsu Mobile Corporation,Nanjing 210001,China)
出处
《软件》
2018年第12期83-86,共4页
Software
关键词
分布式并行计算
大数据
自助分析
Distributed parallel computing
Big data
Self help analysis
