摘要
针对认知无线电网络中多个异质用户具有不同的服务质量(QoS)要求,提出一种基于多智能体强化学习的动态频谱分配方法。该方法从用户满意度角度出发,以用户体验质量(QoE)作为系统的评价指标,构建多个虚拟智能体,模拟多个用户以合作方式与环境进行交互学习,融合各个用户的学习和频谱决策结果,实现频谱资源优化分配。仿真结果表明,在未知主要用户使用规律和信道动态特性条件下,相比基于传统强化学习的动态频谱分配方法,提出的方法能有效提高次用户的QoE,降低用户间的冲突概率。
Multiple heterogeneous spectrum users require different Quality of Service(QoS)in cognitive radio networks.A dynamic spectrum allocation method is proposed based on multi-agent reinforcement learning.In order to improve the satisfaction of spectrum users,the proposed method is evaluated by the Quality of Experience(QoE)of spectrum users instead of QoS.Multiple virtual agents are established to simulate spectrum users to learn interactively with environment in a cooperative way,and the optimal spectrum allocation can be obtained by integrating their learning and spectrum decision results.Simulation results show that the proposed method can obtain higher QoE performance of secondary users than those methods based on the traditional reinforcement learning.The probability of collision between spectrum users also can be reduced in the proposed method with out any information about the usage rules of primary users and dynamic characteristics of channels.
作者
童乐
梁涛
张余
钱鹏智
TONG Le;LIANG Tao;ZHANG Yu;QIAN Pengzhi(The 63rd Research Institute,National University of Defense Technology,Nanjing Jiangsu 210007,China)
出处
《太赫兹科学与电子信息学报》
2021年第4期573-580,共8页
Journal of Terahertz Science and Electronic Information Technology
基金
国家自然科学基金青年基金资助项目(61801497)
基础加强计划技术领域基金资助项目(2019-JCJQ-JJ-221)
关键词
动态频谱分配
体验质量
多智能体强化学习
冲突概率
dynamic spectrum allocation
Quality of Experience
multi-agent reinforcement learning
collision probability
