New Q-learning based heterogeneous network selection algorithm
ZHAO Yan-qing1,2,ZHU Qi1,2
1. Jiangsu Key Laboratory of Wireless Communications, Nanjing University of Posts and Telecommunications, Nanjing Jiangsu 210003, China 2. Key Laboratory on Wideband Wireless Communications and Sensor Network Technology of Ministry of Education,
Nanjing University of Posts and Telecommunications, Nanjing Jiangsu 210003, China
Abstract:To meet the diverse service requirements in heterogeneous network and adapt to the dynamic changes in the network environment, choose the most suitable network for every session and realize network load balance, a new algorithm based on Q-learning for the selection of wireless access network in the heterogeneous network composed of HSDPA and WiMax was proposed. By this algorithm, the most suitable network for each session can be selected according to network load conditions, service attribute, mobility and different locations of terminal. At last, the simulation results show that the algorithm can lower system blocking probability, increase spectrum utility and realize the autonomy of network selection.