标题:
基于分布式Q学习的Femtocell两层网络功率控制方法Power Control for Femtocell Two-Tier Networks Based on Distributed Q-Learning
作者:
宁海芹, 潘沛生
关键字:
功率控制, Femtocell, 干扰, IQL, CQLPower Control; Femtocell;Interference; Independent Q-Learning; Cooperative Q-Learning
期刊名称:
《Hans Journal of Wireless Communications》, Vol.3 No.1, 2013-02-27
摘要:
随着下一代无线通信技术的发展，Femtocell的概念应运而生。Femtocell是一种可以改善室内覆盖的家庭基站，其主要致力于增加室内覆盖，改善系统性能，减少Macrocell网络通信负担。然而，在Femtocell与Macrocell共存的双层网络中存在同信道干扰问题，这会降低系统性能。本文首先分析了分布式Q学习算法在Femtocell与Macrocell构成的两层网络下行链路功率控制中的应用，在此基础上仿真并分析了独立Q学习(Independent Q-learning，IQL)算法和合作Q学习(Cooperation Q-learning，CQL)算法，并对CQL进行了改进，保证在满足基站发射功率和容量性能的情况下回报函数值是正值，其他情况下是负值，经matlab仿真验证，这可提高系统容量效率和公平性。
With the development of the next generation wireless communications technology, the concept of Femtocell came into being. Femtocell is a kind of home base station which can expand coverage indoor, improve system performance and decrease macrocell communication overhead. However, the existing co-channel interference of the network between macrocells and femtocells can dramatically degrade the overall performance of the network. For this reason, we did a research and wrote the paper. First we analyze a two-tier network of distributed Q-learning algorithm in Femtocell and Macrocell downlink power control, then simulate and analyze the independent Q-learning algorithm and cooperation Q-learning algorithm based on that. In addition, we optimize the cooperation Q-learning algorithm so that it can ensure that the value of return function is positive in the case of satisfying the base station transmit power and capacity performance, and is negative in other cases. This improvement can indeed increase the efficiency and fairness of the system capacity after the confirmation of matlab simulation.