In recent years,with the continuous development of deep learning and knowledge graph reasoning methods,more and more researchers have shown great interest in improving knowledge graph reasoning methods by inferring mi...In recent years,with the continuous development of deep learning and knowledge graph reasoning methods,more and more researchers have shown great interest in improving knowledge graph reasoning methods by inferring missing facts through reasoning.By searching paths on the knowledge graph and making fact and link predictions based on these paths,deep learning-based Reinforcement Learning(RL)agents can demonstrate good performance and interpretability.Therefore,deep reinforcement learning-based knowledge reasoning methods have rapidly emerged in recent years and have become a hot research topic.However,even in a small and fixed knowledge graph reasoning action space,there are still a large number of invalid actions.It often leads to the interruption of RL agents’wandering due to the selection of invalid actions,resulting in a significant decrease in the success rate of path mining.In order to improve the success rate of RL agents in the early stages of path search,this article proposes a knowledge reasoning method based on Deep Transfer Reinforcement Learning path(DTRLpath).Before supervised pre-training and retraining,a pre-task of searching for effective actions in a single step is added.The RL agent is first trained in the pre-task to improve its ability to search for effective actions.Then,the trained agent is transferred to the target reasoning task for path search training,which improves its success rate in searching for target task paths.Finally,based on the comparative experimental results on the FB15K-237 and NELL-995 datasets,it can be concluded that the proposed method significantly improves the success rate of path search and outperforms similar methods in most reasoning tasks.展开更多
Wireless Power Transfer(WPT)technology can provide real-time power for many terminal devices in Internet of Things(IoT)through millimeterWave(mmWave)to support applications with large capacity and low latency.Although...Wireless Power Transfer(WPT)technology can provide real-time power for many terminal devices in Internet of Things(IoT)through millimeterWave(mmWave)to support applications with large capacity and low latency.Although the intelligent reflecting surface(IRS)can be adopted to create effective virtual links to address the mmWave blockage problem,the conventional solutions only adopt IRS in the downlink from the Base Station(BS)to the users to enhance the received signal strength.In practice,the reflection of IRS is also applicable to the uplink to improve the spectral efficiency.It is a challenging to jointly optimize IRS beamforming and system resource allocation for wireless energy acquisition and information transmission.In this paper,we first design a Low-Energy Adaptive Clustering Hierarchy(LEACH)clustering protocol for clustering and data collection.Then,the problem of maximizing the minimum system spectral efficiency is constructed by jointly optimizing the transmit power of sensor devices,the uplink and downlink transmission times,the active beamforming at the BS,and the IRS dynamic beamforming.To solve this non-convex optimization problem,we propose an alternating optimization(AO)-based joint solution algorithm.Simulation results show that the use of IRS dynamic beamforming can significantly improve the spectral efficiency of the system,and ensure the reliability of equipment communication and the sustainability of energy supply under NLOS link.展开更多
基金supported by Key Laboratory of Information System Requirement,No.LHZZ202202Natural Science Foundation of Xinjiang Uyghur Autonomous Region(2023D01C55)Scientific Research Program of the Higher Education Institution of Xinjiang(XJEDU2023P127).
文摘In recent years,with the continuous development of deep learning and knowledge graph reasoning methods,more and more researchers have shown great interest in improving knowledge graph reasoning methods by inferring missing facts through reasoning.By searching paths on the knowledge graph and making fact and link predictions based on these paths,deep learning-based Reinforcement Learning(RL)agents can demonstrate good performance and interpretability.Therefore,deep reinforcement learning-based knowledge reasoning methods have rapidly emerged in recent years and have become a hot research topic.However,even in a small and fixed knowledge graph reasoning action space,there are still a large number of invalid actions.It often leads to the interruption of RL agents’wandering due to the selection of invalid actions,resulting in a significant decrease in the success rate of path mining.In order to improve the success rate of RL agents in the early stages of path search,this article proposes a knowledge reasoning method based on Deep Transfer Reinforcement Learning path(DTRLpath).Before supervised pre-training and retraining,a pre-task of searching for effective actions in a single step is added.The RL agent is first trained in the pre-task to improve its ability to search for effective actions.Then,the trained agent is transferred to the target reasoning task for path search training,which improves its success rate in searching for target task paths.Finally,based on the comparative experimental results on the FB15K-237 and NELL-995 datasets,it can be concluded that the proposed method significantly improves the success rate of path search and outperforms similar methods in most reasoning tasks.
基金supported by the National Natural Science Foundation of China 62001051.
文摘Wireless Power Transfer(WPT)technology can provide real-time power for many terminal devices in Internet of Things(IoT)through millimeterWave(mmWave)to support applications with large capacity and low latency.Although the intelligent reflecting surface(IRS)can be adopted to create effective virtual links to address the mmWave blockage problem,the conventional solutions only adopt IRS in the downlink from the Base Station(BS)to the users to enhance the received signal strength.In practice,the reflection of IRS is also applicable to the uplink to improve the spectral efficiency.It is a challenging to jointly optimize IRS beamforming and system resource allocation for wireless energy acquisition and information transmission.In this paper,we first design a Low-Energy Adaptive Clustering Hierarchy(LEACH)clustering protocol for clustering and data collection.Then,the problem of maximizing the minimum system spectral efficiency is constructed by jointly optimizing the transmit power of sensor devices,the uplink and downlink transmission times,the active beamforming at the BS,and the IRS dynamic beamforming.To solve this non-convex optimization problem,we propose an alternating optimization(AO)-based joint solution algorithm.Simulation results show that the use of IRS dynamic beamforming can significantly improve the spectral efficiency of the system,and ensure the reliability of equipment communication and the sustainability of energy supply under NLOS link.
