摘要
面对海量Web数据的高效率搜索问题的需求,并行、分布式的体系结构可以构建大规模搜索系统。该文利用多级分布式并行构架,运用网格理论技术,挖掘Internet上空闲的计算资源,提出了一个Web数据并行搜索驱动模型,描述了模型的主要部件、体系结构、搜索过程及并行驱动机制。分析和实验表明,该模型具有良好的可扩展性,适合Internet网络数据的大规模搜索应用。
Facing the demand of more efficient searching for the massive Web data, the parallel and distributed architecture is the possible method for constructing the large scale searching system. By using of multi-level structure, parallel method, and distributed framework, this paper mines the idle computing resources of Internet, proposes a Web data searching driving model, describes main components, model architecture, searching process, and parallel driving mechanism. The experimental results show that the model has good scalability and it can be fit for the applications of large scale Web searching system in Internet.
出处
《计算机工程》
CAS
CSCD
北大核心
2007年第21期31-33,共3页
Computer Engineering
基金
国家自然科学基金资助项目(60573108)
上海市重点学科建设基金资助项目(T0502)
上海市教委发展基金资助项目(06QZ002
07ZZ92)
