Robust optimal control of single conveyor-serviced production station with uncertain service rate

doi:10.11772/j.issn.1001-9081.2015.07.2067

Journal of Computer Applications ›› 2015, Vol. 35 ›› Issue (7): 2067-2072.DOI: 10.11772/j.issn.1001-9081.2015.07.2067

Previous Articles Next Articles

Robust optimal control of single conveyor-serviced production station with uncertain service rate

HUANG Hao¹, TANG Hao^1,2, ZHOU Lei¹, CHENG Wenjuan¹

1. School of Computer and Information, Hefei University of Technology, Hefei Anhui 230009, China;
2. School of Electrical Engineering and Automation, Hefei University of Technology, Hefei Anhui 230009, China

Received:2014-12-29 Revised:2015-04-01 Online:2015-07-10 Published:2015-07-17

服务率不确定的单站点传送带给料加工站系统鲁棒优化控制

黄浩¹, 唐昊^1,2, 周雷¹, 程文娟¹

1. 合肥工业大学计算机与信息学院, 合肥 230009;
2. 合肥工业大学电气与自动化工程学院, 合肥 230009

通讯作者: 唐昊(1972-),男,安徽庐江人,教授,博士生导师,博士,主要研究方向:离散事件动态系统、强化学习,htang@hfut.edu.cn
作者简介:黄浩(1990-),男,安徽六安人,硕士研究生,主要研究方向:离散事件动态系统、强化学习; 周雷(1981-),男,安徽淮北人,博士,主要研究方向:离散事件动态系统、强化学习、计算机网络; 程文娟(1970-),女,安徽淮南人,副教授, 硕士,主要研究方向:离散时间动态系统、强化学习。
基金资助:
国家自然科学基金资助项目(61174186, 61374158, 51274078);教育部新世纪优秀人才计划项目(NCET-11-0626);高等学校博士学科点专项科研基金资助项目(20130111110007)。

Abstract

Abstract:

The robust optimal control of single Conveyor-Serviced Production Station (CSPS) with uncertain service rate was researched. Under the cases where only the interval of service rate was given and the look-ahead range was controllable, the optimal robust control problem could be described as a mini-max problem by using Semi-Markov Decision Process (SMDP) with uncertain parameters. Global optimization method was adopted to derive the optimal robust control policy when states were dependent. Firstly, the worst performance value was obtained under fixed policy by genetic algorithm. Secondly, according to the obtained worst performance value, the optimal robust control policy was achieved with simulated annealing algorithm. The simulation results show that there is little difference between optimal performance cost of the system whose service rate is fixed as the mean of interval and optimal robust performance cost of the CSPS system with uncertain service rate. Moreover, the difference is getting smaller when the uncertain interval narrows and it means that the global optimization algorithm works effectively.

Key words: conveyor-serviced production station, Semi-Markov Decision Process (SMDP), uncertain service rate, global optimization, robust control policy

摘要：

研究了服务率不确定情况下的单站点传送带给料加工站(CSPS)系统的鲁棒优化控制问题。在仅知服务率区间的条件下,以CSPS系统的前视距离作为控制变量,将鲁棒优化控制问题建模成不确定参数的半马尔可夫决策过程(SMDP)的极大极小优化问题,在状态相关的情况下,给出全局优化算法进行鲁棒控制策略求解。首先,运用遗传算法求解固定策略下的最差性能值;其次,根据求解得到的最差性能值,运用模拟退火算法求解最优鲁棒控制策略。仿真结果表明,服务率不确定的CSPS系统的最优鲁棒性能代价与服务率固定为区间中值系统的最优性能代价相差不大,并且随着不确定区间的缩小,两者的差值越小,说明了全局优化算法的有效性。

关键词: 传送带给料加工站, 半马尔可夫决策过程, 不确定服务率, 全局优化, 鲁棒控制策略

CLC Number:

HUANG Hao, TANG Hao, ZHOU Lei, CHENG Wenjuan. Robust optimal control of single conveyor-serviced production station with uncertain service rate[J]. Journal of Computer Applications, 2015, 35(7): 2067-2072.

黄浩, 唐昊, 周雷, 程文娟. 服务率不确定的单站点传送带给料加工站系统鲁棒优化控制[J]. 计算机应用, 2015, 35(7): 2067-2072.

References

[1] MATSUI M. A generalized model of Convey-Serviced Production Station (CSPS) [J]. Journal of Japan Industrial Management Association, 1993, 44(1): 25-32.
[2] MATSUI M. CSPS model: look-ahead controls and physics [J]. International Journal of Production Research, 2005, 43 (10): 2001-2025.
[3] CHEN Y J, TANG H, PEI R, et al. Event-based optimization control of conveyor-serviced production station [C]// Proceedings of the 2012 31st Chinese Control Conference. Piscataway: IEEE, 2012: 2167-2171.
[4] TANG H, ARAI T. Look-ahead control of conveyor-serviced production station by using potential-based online policy iteration [J]. International Journal of Control, 2009, 82(10): 1917-1928.
[5] QING Q, TANG H, ZHOU L, et al. The optimization control of single conveyor-serviced production station with variable service rate [C]// Proceedings of the 2013 32nd Chinese Control Conference, Piscataway: IEEE, 2013: 2180-2184.
[6] ZHEN Y, ZHANG M, LI L, et al. Robust mixed-model assembly line rebalancing with uncertain demand structure [J]. Modern Manufacturing Engineering, 2014 (2): 70-76.(郑永前, 张明明, 力立安, 等. 不确定需求下混流装配生产线鲁棒再平衡 [J]. 现代制造工程, 2014 (2): 70-76.)
[7] AHMED A, VARAKANTHAM P, ADULYASAKK Y, et al. Regret based robust solutions for uncertain Markov decision processes [EB/OL]. [2014-12-02]. http://ares.lids.mit.edu/fm/documents/regret_2.pdf.
[8] TANG H, LIANG X J, GAO J, et al. Roust control policy for semi-Markov decision processes with dependent uncertain parameters [C]// WCICA 2004: Proceedings of the 5th World Congress on Intelligent Control and Automation. Piscataway: IEEE, 2004, 1(1): 515-518.
[9] CAO X-R. Semi-Markov decision problems and performance sensitivity analysis [J]. IEEE Transactions on Automatic Control, 2003, 48(5): 758-769.
[10] TANG H, LIU C CHENG W. Robust decision problems based on global optimization for uncertain SMDPs [J]. Journal of System Simulation, 2005, 17(11): 2704-2707. (唐昊, 刘春, 程文娟. 不确定SMDP基于全局优化的鲁棒决策问题 [J].系统仿真学报, 2005, 17(11): 2704-2707.)
[11] YANG X, DUAN C K, LIAO X X. A note on mathematical aspects of drive-response type synchronization [J]. Chaos, Solitons & Fractals, 1999, 10(9): 1457-1462.
[12] CHENG Y, TANG H, MA X. Solution of the robust control policy for SMDPs based on the genetic algorithm and policy iteration [J]. Journal of Hefei University of Technology:Nature Science, 2008, 30(11): 1404-1407.(程燕,唐昊,马学森.基于策略迭代和遗传算法的SMDP鲁棒控制策略求解[J].合肥工业大学学报:自然科学版,2008,30(11):1404-1407.)
[13] TANG H, XI H, HAN J, et al. Robust control policy for closed queuing networks with uncertain routing probabilities [J]. Acta Automatica Sinica, 2005, 31(3): 446-450.
[14] TANG H, XI H, YIN B. The optimal robust control policy for uncertain semi-Markov control processes [J]. International Journal of Systems Science, 2005, 36(13): 791-800.
[15] LIM S H, XU H, MANNOR S. Reinforcement learning in robust markov decision processes [EB/OL]. [2014-12-06]. http://machinelearning.wustl.edu/mlpapers/paper_files/NIPS2013_5183.pdf.

Robust optimal control of single conveyor-serviced production station with uncertain service rate

服务率不确定的单站点传送带给料加工站系统鲁棒优化控制

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	XIE Benming, HAN Mingming, ZHANG Pan, ZHANG Wei. Optimization algorithm of dynamic time warping for speech recognition of aircraft towing vehicle [J]. Journal of Computer Applications, 2018, 38(6): 1771-1776.
[2]	WANG Xiaojing, PENG Hu, DENG Changshou, HUANG Haiyan, ZHANG Yan, TAN Xujie. Firefly algorithm based on uniform local search and variable step size [J]. Journal of Computer Applications, 2018, 38(3): 715-721.
[3]	LI Wei, LYU Naiguang, DONG Mingli, LOU Xiaoping. Robot hand-eye calibration by convex relaxation global optimization [J]. Journal of Computer Applications, 2017, 37(5): 1451-1455.
[4]	XU Dayu, LIU Renping. Improved self-organized criticality optimized gray wolf optimizer metaheuristic algorithm [J]. Journal of Computer Applications, 2016, 36(6): 1588-1593.
[5]	YANG Binhua, ZHAO Gaopeng, LIU Lujiang, BO Yuming. Global point cloud registration algorithm based on translation domain estimating [J]. Journal of Computer Applications, 2016, 36(6): 1664-1667.
[6]	LIU Jie, WANG Ling, WANG Shan, FENG Wei, LI Wen. Minimum MPR set selection algorithm based on OLSR protocol [J]. Journal of Computer Applications, 2015, 35(2): 305-308.
[7]	HE Ye, LI Guangyao, XIAO Mang, XIE Li, PENG Lei, TANG Ke. Image completion algorithm based on depth information [J]. Journal of Computer Applications, 2015, 35(10): 2955-2958.
[8]	WANG Lei CHEN Jindong PAN Feng. Applications of gravitational search algorithm in parameters estimation of penicillin fermentation process model [J]. Journal of Computer Applications, 2013, 33(11): 3296-3299.
[9]	LI Guozhu. Real-coded quantum evolutionary algorithm based on cloud model [J]. Journal of Computer Applications, 2013, 33(09): 2550-2552.
[10]	PENG Shuo OUYANG Aijia YUE Guangxue HE Minghua ZHOU Xu. Improved glowworm swarm optimization algorithm for high-dimensional functions [J]. Journal of Computer Applications, 2013, 33(08): 2253-2256.
[11]	LIN Xiao-jun YE Dong-yi. Artificial bee colony algorithm based on cloud mutation [J]. Journal of Computer Applications, 2012, 32(09): 2538-2541.
[12]	XU Xue-song WANG Si-chun. Multi-modal function optimization based on immune quantum genetic algorithm [J]. Journal of Computer Applications, 2012, 32(06): 1674-1677.
[13]	LIU Xiao-long ZHAO Kui-ling. Bacteria foraging optimization algorithm based on immune algorithm [J]. Journal of Computer Applications, 2012, 32(03): 634-637.
[14]	YUAN Liang LV Bo-quan ZHANG Chen LIANG Wei. Improved global optimization algorithm of intelligence control system with filled function [J]. Journal of Computer Applications, 2012, 32(02): 452-464.
[15]	QU Fu-heng HU Ya-ting YANG Yong SUN Shuang-zi YUAN Li-hong. Differential evolution algorithm with different strategies and control parameters [J]. Journal of Computer Applications, 2011, 31(11): 3097-3100.