摘要
提出一种汉语叠词的自动获取方法。首先利用结构合理的五元组模型对分词后的语料进行统计以获得各类叠词候选集;在此基础上,通过叠词度的运算判断实现"AAB"式、"ABB"式、"ABA"式、"ABAB"式、"AABB"式叠词的自动获取;在叠词度判断的基础上,通过左、右邻接熵的运算判断实现"AA"式叠词的自动获取。该方法根据结构合理的五元组模型获得的统计信息,结合叠词度和信息熵的判断,实现了叠词的量化判断和自动获取。实验结果证明:该方法能有效实现汉语叠词的自动获取,且准确率高。
We proposed a Chinese reduplicated words automatic acquisition method. Firstly, the structure reasonable five-tuple model obtained various kinds of reduplicated words from corpus after segmentation. And on this basis, reduplicated words in forms of ＂AAB＂ and ＂ABB＂, ＂ABA＂, ＂ABAB＂, ＂AABB＂ would be automatically acquired according to combination degree. In order to obtain ＂ AA ＂ type of reduplicated words, this method calculated left adjacent entropy and rightadjacent entropy. According to the statistical information obtained by the structure reasonable five-tuple model, combination degree and entropy, these methods can automatically acquire Chinese reduplication. Experiments show that this method can effectively achieve the automatic acquisition of Chinese reduplication, and the accuracy rate is high.
出处
《重庆理工大学学报（自然科学）》
CAS
2016年第7期123-128,共6页
Journal of Chongqing University of Technology：Natural Science
关键词
汉语叠词
五元组模型
叠词度
左、右邻接熵
Chinese reduplicated words
five-element model
combinative degree of reduplicated woeds
left and right adjoined entropy
