Improved particle swarm optimization algorithm based on hierarchical autonomous learning

doi:10.11772/j.issn.1001-9081.2018061342

Abstract

Abstract: Focusing on the shortages of easily falling into local optimal, low convergence accuracy and slow convergence speed in Particle Swarm Optimization (PSO) algorithm, an improved Particle Swarm Optimization based on HierarChical autonomous learning (HCPSO) algorithm was proposed. Firstly, according to the particle fitness value and the number of iterations, the population was dynamically divided into three different classes. Then, according to characteristics of different classes of particles, local learning model, standard learning model and global learning model were respectively adopted to increase particle diversity and reflect the effect of individual difference cognition on performance of algorithm and improve the convergence speed and convergence precision of algorithm. Finally, HCPSO algorithm was compared with PSO algorithm, Self-adaptive Multi-Swarm PSO algorithm (PSO-SMS) and Dynamic Multi-Swarm PSO (DMS-PSO) algorithm on 6 typical test functions respectively. The simulation results show that the convergence speed and convergence accuracy of HCPSO algorithm are obviously higher than these of the given algorithms, and the execution time difference of the proposed algorithm and basic PSO algorithm is within 0.001 orders of magnitude. The performance of the proposed algorithm is improved without increasing complexity.

Key words: group intelligence, Particle Swarm Optimization (PSO) algorithm, particle difference, population diversity, autonomous learning

摘要： 针对粒子群优化（PSO）算法容易陷入局部最优、收敛精度不高、收敛速度较慢的问题，提出一种基于分层自主学习的改进粒子群优化（HCPSO）算法。首先，根据粒子适应度值和迭代次数将种群动态地划分为三个不同阶层；然后，根据不同阶层粒子特性，分别采用局部学习模型、标准学习模型以及全局学习模型，增加粒子多样性，反映出个体差异的认知对算法性能的影响，提高算法的收敛速度和收敛精度；最后，将HCPSO算法与PSO算法、自适应多子群粒子群优化（PSO-SMS）算法以及动态多子群粒子群优化（DMS-PSO）算法分别在6个典型的测试函数上进行对比仿真实验。仿真结果表明，HCPSO算法的收敛速度和收敛精度相对给出的对比算法均有明显提升，并且算法执行时间和基本PSO算法执行时间差距在0.001量级内，在不增加算法复杂度的情况下算法性能更高。

关键词: 群体智能, 粒子群优化算法, 粒子差异性, 种群多样性, 自主学习

CLC Number:

TP301.6
TP18

YUAN Xiaoping, JIANG Shuo. Improved particle swarm optimization algorithm based on hierarchical autonomous learning[J]. Journal of Computer Applications, 2019, 39(1): 148-153.

袁小平, 蒋硕. 基于分层自主学习的改进粒子群优化算法[J]. 计算机应用, 2019, 39(1): 148-153.

References

[1] KENNEDY J, EBERHART R. Particle swarm optimization[C]//Proceedings of the 1995 IEEE International Conference on Neural Networks. Piscataway, NJ:IEEE, 1995:1942-1948.
[2] LIU Z H, WEI H L, LI X H, et al. Global identification of electrical and mechanical parameters in PMSM drive based on dynamic self-learning PSO[J]. IEEE Transactions on Power Electronics, 2018, 33(12):10858-10871.
[3] LIU Z H, WEI H L, ZHONG Q C, et al. Parameter estimation for VSI-Fed PMSM based on a dynamic PSO with learning strategies[J]. IEEE Transactions on Power Electronics, 2017, 32(4):3154-3165.
[4] MISTRY K, ZHANG L, NEOH S C, et al. A micro-GA embedded PSO feature selection approach to intelligent facial emotion recognition[J]. IEEE Transactions on Cybernetics, 2017, 47(6):1496-1509.
[5] GHAMRY K A, KAMEL M A, ZHANG Y. Multiple UAVs in forest fire fighting mission using particle swarm optimization[C]//Proceedings of the 2017 International Conference on Unmanned Aircraft Systems. Piscataway, NJ:IEEE, 2017:1404-1409.
[6] TURGUT O E. Hybrid chaotic quantum behaved particle swarm optimization algorithm for thermal design of plate fin heat exchangers[J]. Applied Mathematical Modelling, 2016, 40(1):50-69.
[7] 李俊,汪冲,李波,等.基于多策略协同作用的粒子群优化算法[J].计算机应用,2016,36(3):681-686.(LI J, WANG C, LI B, et al. Particle swarm optimization algorithm based on multi-strategy cooperation[J]. Journal of Computer Applications, 2016, 36(3):681-686.)
[8] ZHANG L, TANG Y, HUA C, et al. A new particle swarm optimization algorithm with adaptive inertia weight based on Bayesian techniques[J]. Applied Soft Computing, 2015, 28(C):138-149.
[9] GUPTA I K, CHOUBEY A, CHOUBEY S. Particle swarm optimization with selective multiple inertia weights[C]//Proceedings of the 2017 International Conference on Computing, Communication and Networking Technologies. Washington, DC:IEEE Computer Society, 2017:1-6.
[10] ZHOU Z, JIAO B. The improvement of particle swarm optimization[C]//Proceedings of the 2017 International Conference on Systems and Informatics. Piscataway, NJ:IEEE, 2017:373-377.
[11] LIU J, MEI Y, LI X. An analysis of the inertia weight parameter for binary particle swarm optimization[J]. IEEE Transactions on Evolutionary Computation, 2016, 20(5):666-681.
[12] 周伟,罗建军,靳锴,等.基于模糊高斯学习策略的粒子群进化融合算法[J].计算机应用,2017,37(9):2536-2540.(ZHOU W, LUO J J, JIN K, et al. Evolutionary algorithm for particle swarm optimization based on fuzzy Gauss learning strategy[J]. Journal of Computer Applications, 2017, 37(9):2536-2540.)
[13] WANG H, LI Y. Hybrid teaching-learning-based PSO for trajectory optimization[J]. Electronics Letters, 2017, 53(12):777-779.
[14] LOVBJERG M, RASMUSSEN T K, KRINK T. Hybrid particle swarm optimiser with breeding and subpopulations[C]//GECCO'01:Proceedings of the 3rd Annual Conference on Genetic and Evolutionary Computation. San Francisco:Morgan Kaufmann, 2001:469-476.
[15] LIANG J J, SUGANTHAN P N. Dynamic multi-swarm particle swarm optimizer[C]//Proceedings of the 2005 IEEE International Swarm Intelligence Symposium. Piscataway, NJ:IEEE, 2005:124-129.
[16] 姜海燕,王芳芳,郭小清,等.基于自主学习和精英群的多子群粒子群算法[J].控制与决策,2014,29(11):2034-2040.(JIANG H Y, WANG F F, GUO X Q, et al. Multi-swarm particle swarm optimization based on autonomic learning and elite swarm[J]. Control and Decision, 2014,29(11):2034-2040.)
[17] 金敏,鲁华祥.一种遗传算法与粒子群优化的多子群分层混合算法[J].控制理论与应用,2013,30(10):1231-1238. (JIN M, LU H X. A multi-subgroup hierarchical hybrid of genetic algorithm and particle swarm optimization[J]. Control Theory and Applications, 2013,30(10):1231-1238.)
[18] 郭文忠.离散粒子群优化算法及其应用[M].北京:清华大学出版社,2012:46-46.(GUO W Z. Discrete Particle Swarm Optimization Algorithm and Its Application[M]. Beijing:Tsinghua University Press, 2012:46-46.)
[19] 曾辉,王倩,夏学文,等.基于自适应多种群的粒子群优化算法[J].计算机工程与应用,2018,54(10):59-65.(ZENG H, WANG Q, XIA X W, et al. Particle swarm optimization algorithm based on self-adaptive multi-swarm[J]. Computer Engineering and Applications, 2018,54(10):59-65.)