摘要
针对人工神经网络(ANN)对面向知识图谱(KG)的知识推理的记忆能力有限以及KG无法处理不确定知识的问题,提出一种可微神经计算机(DNC)和贝叶斯网络(BN)相结合的推理方法DNC-BN。首先,将长短时记忆(LSTM)网络作为控制器,在每个时刻对输入向量和从记忆体获取的读向量进行处理,得到网络输出向量和交互向量;其次,通过读写头实现控制器与记忆体的交互,使用读取权重计算数据的加权平均以得到读向量,并用写入权重结合擦除向量及写入向量进行写操作,对存储矩阵进行修改;最后,基于概率推理机制,使用BN对数据节点之间存在的推理关系进行判断,对KG进行补全。在数据集WN18RR上的推理中,DNC-BN的Mean Rank为2615,Hits@10为0.528;在数据集FB15k-237上的推理中,DNC-BN的Mean Rank为202,Hits@10为0.519。实验结果表明,DNC-BN方法对面向KG的知识推理具有良好的应用效果。
Aiming at the problem that Artificial Neural Network(ANN)has limited memory capability for knowledge reasoning oriented to Knowledge Graph(KG)and the KG cannot deal with uncertain knowledge,a reasoning method named DNC-BN was propsed based on Differentiable Neural Computer(DNC)and Bayesian Network.Firstly,using Long Short-Term Memory(LSTM)network as the controller,the output vector and the interface vector of network were obtained by processing the input vector and the read vector obtained from the memory at each moment.Then,the read and write heads were used to realize the interaction between the controller with the memory,the read weights were used to calculate the weighted average of data to obtain the read vector,and the write operation was performed by combining the erase vector and write vector with the write weights,so as to modify the memory matrix.Finally,based on the probabilistic inference mechanism,the BN was used to judge the inference relationship between the nodes,and the KG was completed.In the experiments,on the WN18RR dataset,DNC-BN has the Mean Rank of 2615 and the Hits@10 of 0.528;on the FB15k-237 dataset,DNC-BN has the Mean Rank of 202,and the Hits@10 of 0.519.Experimental results show that the proposed method has good application effect on knowledge reasoning oriented to KG.
作者
孙建强
许少华
SUN Jianqiang;XU Shaohua(College of Computer Science and Engineering,Shandong University of Science and Technology,Qingdao Shandong 266590,China)
出处
《计算机应用》
CSCD
北大核心
2021年第2期337-342,共6页
journal of Computer Applications
基金
国家重点研发计划项目(2018YFC1406203)。
关键词
知识图谱
知识推理
可微神经计算机
贝叶斯网络
长期记忆
Knowledge Graph(KG)
knowledge reasoning
differentiable neural computer
Bayesian network
longterm memory
