服务率不确定的单站点传送带给料加工站系统鲁棒优化控制

doi:10.11772/j.issn.1001-9081.2015.07.2067

计算机应用 ›› 2015, Vol. 35 ›› Issue (7): 2067-2072.DOI: 10.11772/j.issn.1001-9081.2015.07.2067

服务率不确定的单站点传送带给料加工站系统鲁棒优化控制

黄浩¹, 唐昊^1,2, 周雷¹, 程文娟¹

1. 合肥工业大学计算机与信息学院, 合肥 230009;
2. 合肥工业大学电气与自动化工程学院, 合肥 230009

收稿日期:2014-12-29 修回日期:2015-04-01 出版日期:2015-07-10 发布日期:2015-07-17
通讯作者: 唐昊(1972-),男,安徽庐江人,教授,博士生导师,博士,主要研究方向:离散事件动态系统、强化学习,htang@hfut.edu.cn
作者简介:黄浩(1990-),男,安徽六安人,硕士研究生,主要研究方向:离散事件动态系统、强化学习; 周雷(1981-),男,安徽淮北人,博士,主要研究方向:离散事件动态系统、强化学习、计算机网络; 程文娟(1970-),女,安徽淮南人,副教授, 硕士,主要研究方向:离散时间动态系统、强化学习。
基金资助:
国家自然科学基金资助项目(61174186, 61374158, 51274078);教育部新世纪优秀人才计划项目(NCET-11-0626);高等学校博士学科点专项科研基金资助项目(20130111110007)。

Robust optimal control of single conveyor-serviced production station with uncertain service rate

HUANG Hao¹, TANG Hao^1,2, ZHOU Lei¹, CHENG Wenjuan¹

1. School of Computer and Information, Hefei University of Technology, Hefei Anhui 230009, China;
2. School of Electrical Engineering and Automation, Hefei University of Technology, Hefei Anhui 230009, China

Received:2014-12-29 Revised:2015-04-01 Online:2015-07-10 Published:2015-07-17

摘要/Abstract

摘要：

研究了服务率不确定情况下的单站点传送带给料加工站(CSPS)系统的鲁棒优化控制问题。在仅知服务率区间的条件下,以CSPS系统的前视距离作为控制变量,将鲁棒优化控制问题建模成不确定参数的半马尔可夫决策过程(SMDP)的极大极小优化问题,在状态相关的情况下,给出全局优化算法进行鲁棒控制策略求解。首先,运用遗传算法求解固定策略下的最差性能值;其次,根据求解得到的最差性能值,运用模拟退火算法求解最优鲁棒控制策略。仿真结果表明,服务率不确定的CSPS系统的最优鲁棒性能代价与服务率固定为区间中值系统的最优性能代价相差不大,并且随着不确定区间的缩小,两者的差值越小,说明了全局优化算法的有效性。

关键词: 传送带给料加工站, 半马尔可夫决策过程, 不确定服务率, 全局优化, 鲁棒控制策略

Abstract:

The robust optimal control of single Conveyor-Serviced Production Station (CSPS) with uncertain service rate was researched. Under the cases where only the interval of service rate was given and the look-ahead range was controllable, the optimal robust control problem could be described as a mini-max problem by using Semi-Markov Decision Process (SMDP) with uncertain parameters. Global optimization method was adopted to derive the optimal robust control policy when states were dependent. Firstly, the worst performance value was obtained under fixed policy by genetic algorithm. Secondly, according to the obtained worst performance value, the optimal robust control policy was achieved with simulated annealing algorithm. The simulation results show that there is little difference between optimal performance cost of the system whose service rate is fixed as the mean of interval and optimal robust performance cost of the CSPS system with uncertain service rate. Moreover, the difference is getting smaller when the uncertain interval narrows and it means that the global optimization algorithm works effectively.

Key words: conveyor-serviced production station, Semi-Markov Decision Process (SMDP), uncertain service rate, global optimization, robust control policy

中图分类号:

黄浩, 唐昊, 周雷, 程文娟. 服务率不确定的单站点传送带给料加工站系统鲁棒优化控制[J]. 计算机应用, 2015, 35(7): 2067-2072.

HUANG Hao, TANG Hao, ZHOU Lei, CHENG Wenjuan. Robust optimal control of single conveyor-serviced production station with uncertain service rate[J]. Journal of Computer Applications, 2015, 35(7): 2067-2072.

参考文献

[1] MATSUI M. A generalized model of Convey-Serviced Production Station (CSPS) [J]. Journal of Japan Industrial Management Association, 1993, 44(1): 25-32.
[2] MATSUI M. CSPS model: look-ahead controls and physics [J]. International Journal of Production Research, 2005, 43 (10): 2001-2025.
[3] CHEN Y J, TANG H, PEI R, et al. Event-based optimization control of conveyor-serviced production station [C]// Proceedings of the 2012 31st Chinese Control Conference. Piscataway: IEEE, 2012: 2167-2171.
[4] TANG H, ARAI T. Look-ahead control of conveyor-serviced production station by using potential-based online policy iteration [J]. International Journal of Control, 2009, 82(10): 1917-1928.
[5] QING Q, TANG H, ZHOU L, et al. The optimization control of single conveyor-serviced production station with variable service rate [C]// Proceedings of the 2013 32nd Chinese Control Conference, Piscataway: IEEE, 2013: 2180-2184.
[6] ZHEN Y, ZHANG M, LI L, et al. Robust mixed-model assembly line rebalancing with uncertain demand structure [J]. Modern Manufacturing Engineering, 2014 (2): 70-76.(郑永前, 张明明, 力立安, 等. 不确定需求下混流装配生产线鲁棒再平衡 [J]. 现代制造工程, 2014 (2): 70-76.)
[7] AHMED A, VARAKANTHAM P, ADULYASAKK Y, et al. Regret based robust solutions for uncertain Markov decision processes [EB/OL]. [2014-12-02]. http://ares.lids.mit.edu/fm/documents/regret_2.pdf.
[8] TANG H, LIANG X J, GAO J, et al. Roust control policy for semi-Markov decision processes with dependent uncertain parameters [C]// WCICA 2004: Proceedings of the 5th World Congress on Intelligent Control and Automation. Piscataway: IEEE, 2004, 1(1): 515-518.
[9] CAO X-R. Semi-Markov decision problems and performance sensitivity analysis [J]. IEEE Transactions on Automatic Control, 2003, 48(5): 758-769.
[10] TANG H, LIU C CHENG W. Robust decision problems based on global optimization for uncertain SMDPs [J]. Journal of System Simulation, 2005, 17(11): 2704-2707. (唐昊, 刘春, 程文娟. 不确定SMDP基于全局优化的鲁棒决策问题 [J].系统仿真学报, 2005, 17(11): 2704-2707.)
[11] YANG X, DUAN C K, LIAO X X. A note on mathematical aspects of drive-response type synchronization [J]. Chaos, Solitons & Fractals, 1999, 10(9): 1457-1462.
[12] CHENG Y, TANG H, MA X. Solution of the robust control policy for SMDPs based on the genetic algorithm and policy iteration [J]. Journal of Hefei University of Technology:Nature Science, 2008, 30(11): 1404-1407.(程燕,唐昊,马学森.基于策略迭代和遗传算法的SMDP鲁棒控制策略求解[J].合肥工业大学学报:自然科学版,2008,30(11):1404-1407.)
[13] TANG H, XI H, HAN J, et al. Robust control policy for closed queuing networks with uncertain routing probabilities [J]. Acta Automatica Sinica, 2005, 31(3): 446-450.
[14] TANG H, XI H, YIN B. The optimal robust control policy for uncertain semi-Markov control processes [J]. International Journal of Systems Science, 2005, 36(13): 791-800.
[15] LIM S H, XU H, MANNOR S. Reinforcement learning in robust markov decision processes [EB/OL]. [2014-12-06]. http://machinelearning.wustl.edu/mlpapers/paper_files/NIPS2013_5183.pdf.

服务率不确定的单站点传送带给料加工站系统鲁棒优化控制

Robust optimal control of single conveyor-serviced production station with uncertain service rate

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	解本铭, 韩明明, 张攀, 张威. 飞机牵引车语音识别的动态时间规整优化算法[J]. 计算机应用, 2018, 38(6): 1771-1776.
[2]	王晓静, 彭虎, 邓长寿, 黄海燕, 张艳, 谭旭杰. 基于均匀局部搜索和可变步长的萤火虫算法[J]. 计算机应用, 2018, 38(3): 715-721.
[3]	李巍, 吕乃光, 董明利, 娄小平. 凸松弛全局优化机器人手眼标定[J]. 计算机应用, 2017, 37(5): 1451-1455.
[4]	杨滨华, 赵高鹏, 刘鲁江, 薄煜明. 基于平移域估计的点云全局配准算法[J]. 计算机应用, 2016, 36(6): 1664-1667.
[5]	刘杰, 王玲, 王杉, 冯微, 李文. 基于OLSR协议的最小MPR集选择算法[J]. 计算机应用, 2015, 35(2): 305-308.
[6]	何埜, 李光耀, 肖莽, 谢力, 彭磊, 唐可. 基于深度信息的图像修复算法[J]. 计算机应用, 2015, 35(10): 2955-2958.
[7]	李国柱. 基于云模型的实数编码量子进化算法[J]. 计算机应用, 2013, 33(09): 2550-2552.
[8]	彭硕欧阳艾嘉乐光学贺明华周旭. 求解高维函数的改进萤火虫群优化算法[J]. 计算机应用, 2013, 33(08): 2253-2256.
[9]	林小军叶东毅. 云变异人工蜂群算法[J]. 计算机应用, 2012, 32(09): 2538-2541.
[10]	徐雪松王四春. 基于免疫量子遗传算法的多峰函数寻优[J]. 计算机应用, 2012, 32(06): 1674-1677.
[11]	刘小龙赵奎领. 基于免疫算法的细菌觅食优化算法[J]. 计算机应用, 2012, 32(03): 634-637.
[12]	袁亮吕柏权张晨梁伟. 用填充函数改进的智能控制系统全局优化算法[J]. 计算机应用, 2012, 32(02): 452-464.
[13]	曲福恒胡雅婷杨勇孙爽滋苑丽红. 多策略多参数并行差分进化算法[J]. 计算机应用, 2011, 31(11): 3097-3100.
[14]	杨军石传奎党建武. 基于序列图像的鲁棒三维重建方法[J]. 计算机应用, 2011, 31(06): 1566-1568.
[15]	尚云何雪妮雷虹. 求全局最优的类电磁机制算法[J]. 计算机应用, 2010, 30(11): 2914-2916.