Journal of Computer Applications ›› 2015, Vol. 35 ›› Issue (7): 2067-2072.DOI: 10.11772/j.issn.1001-9081.2015.07.2067

Previous Articles     Next Articles

Robust optimal control of single conveyor-serviced production station with uncertain service rate

HUANG Hao1, TANG Hao1,2, ZHOU Lei1, CHENG Wenjuan1   

  1. 1. School of Computer and Information, Hefei University of Technology, Hefei Anhui 230009, China;
    2. School of Electrical Engineering and Automation, Hefei University of Technology, Hefei Anhui 230009, China
  • Received:2014-12-29 Revised:2015-04-01 Online:2015-07-10 Published:2015-07-17

服务率不确定的单站点传送带给料加工站系统鲁棒优化控制

黄浩1, 唐昊1,2, 周雷1, 程文娟1   

  1. 1. 合肥工业大学 计算机与信息学院, 合肥 230009;
    2. 合肥工业大学 电气与自动化工程学院, 合肥 230009
  • 通讯作者: 唐昊(1972-),男,安徽庐江人,教授,博士生导师,博士,主要研究方向:离散事件动态系统、强化学习,htang@hfut.edu.cn
  • 作者简介:黄浩(1990-),男,安徽六安人,硕士研究生,主要研究方向:离散事件动态系统、强化学习; 周雷(1981-),男,安徽淮北人,博士,主要研究方向:离散事件动态系统、强化学习、计算机网络; 程文娟(1970-),女,安徽淮南人,副教授, 硕士,主要研究方向:离散时间动态系统、强化学习。
  • 基金资助:

    国家自然科学基金资助项目(61174186, 61374158, 51274078);教育部新世纪优秀人才计划项目(NCET-11-0626);高等学校博士学科点专项科研基金资助项目(20130111110007)。

Abstract:

The robust optimal control of single Conveyor-Serviced Production Station (CSPS) with uncertain service rate was researched. Under the cases where only the interval of service rate was given and the look-ahead range was controllable, the optimal robust control problem could be described as a mini-max problem by using Semi-Markov Decision Process (SMDP) with uncertain parameters. Global optimization method was adopted to derive the optimal robust control policy when states were dependent. Firstly, the worst performance value was obtained under fixed policy by genetic algorithm. Secondly, according to the obtained worst performance value, the optimal robust control policy was achieved with simulated annealing algorithm. The simulation results show that there is little difference between optimal performance cost of the system whose service rate is fixed as the mean of interval and optimal robust performance cost of the CSPS system with uncertain service rate. Moreover, the difference is getting smaller when the uncertain interval narrows and it means that the global optimization algorithm works effectively.

Key words: conveyor-serviced production station, Semi-Markov Decision Process (SMDP), uncertain service rate, global optimization, robust control policy

摘要:

研究了服务率不确定情况下的单站点传送带给料加工站(CSPS)系统的鲁棒优化控制问题。在仅知服务率区间的条件下,以CSPS系统的前视距离作为控制变量,将鲁棒优化控制问题建模成不确定参数的半马尔可夫决策过程(SMDP)的极大极小优化问题,在状态相关的情况下,给出全局优化算法进行鲁棒控制策略求解。首先,运用遗传算法求解固定策略下的最差性能值;其次,根据求解得到的最差性能值,运用模拟退火算法求解最优鲁棒控制策略。仿真结果表明,服务率不确定的CSPS系统的最优鲁棒性能代价与服务率固定为区间中值系统的最优性能代价相差不大,并且随着不确定区间的缩小,两者的差值越小,说明了全局优化算法的有效性。

关键词: 传送带给料加工站, 半马尔可夫决策过程, 不确定服务率, 全局优化, 鲁棒控制策略

CLC Number: