摘要
针对论坛型网站的特性,包括标签的重复出现和文本内容的特定模式等,提出一种基于DOM树与模板的自适应信息抽取算法。以拥有共同父节点的邻近结构的相似子树为基础,提出生成候选集以及候选集过滤细分的抽取规则生成方法。该算法能很好地适应论坛网页结构的变化,当网页结构改变后自动生成新的抽取规则。实验结果表明,在多个不同论坛型网站页面及相应改版页面上,该方法能够有效生成抽取规则以实现Web论坛信息抽取,并获得比现有信息抽取方法更好的性能。
Aiming at the characteristics of forum pages,including the repeated tags and specific patterns of text,we propose an adaptive information extraction algorithm based on DOM trees and templates.Based on similar subtrees with common parent nodes,we proposed an extraction rule generation method that could generate,filter,and segment candidate sets.The algorithm adapted to the changes in the structure of forum pages,and automatically generated new extraction rules when the structure change.The results prove that this method can effectively generate extraction rules for the information extraction of forums and achieve better performance than traditional ones on different forums pages and corresponding revised pages.
作者
柏志安
廖健
曾剑平
Bai Zhian;Liao Jian;Zeng Jianping(Computer Center,Ruijin Hospital Shanghai Jiao Tong University School of Medicine,Shanghai 200025,China;School of Computer Science,Fudan University,Shanghai 200433,China)
出处
《计算机应用与软件》
北大核心
2022年第8期15-20,81,共7页
Computer Applications and Software
关键词
信息抽取
自适应
DOM树
模板
Information extraction
Adaptive
DOM tree
Template
