Data-Based Adaptive Critic Designs for Nonlinear Robust Optimal Control With Uncertain Dynamics

doi:10.1109/TSMC.2015.2492941

CORC > 自动化研究所 > 中国科学院自动化研究所 > 复杂系统管理与控制国家重点实验室 > 深度强化学习

	Data-Based Adaptive Critic Designs for Nonlinear Robust Optimal Control With Uncertain Dynamics
	Wang, Ding1 ; Liu, Derong 2; Zhang, Qichao1 ; Zhao, Dongbin1
刊名	IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS
	2016-11-01
卷号	46 期号:11 页码:1544-1555
关键词	Adaptive Critic Designs Adaptive Dynamic Programming Intelligent Control Neural Networks Policy Iteration Robust Optimal Control System Identification Uncertain Nonlinear Systems
DOI	10.1109/TSMC.2015.2492941
文献子类	Article
英文摘要	In this paper, the infinite-horizon robust optimal control problem for a class of continuous-time uncertain non-linear systems is investigated by using data-based adaptive critic designs. The neural network identification scheme is combined with the traditional adaptive critic technique, in order to design the nonlinear robust optimal control under uncertain environment. First, the robust optimal controller of the original uncertain system with a specified cost function is established by adding a feedback gain to the optimal controller of the nominal system. Then, a neural network identifier is employed to reconstruct the unknown dynamics of the nominal system with stability analysis. Hence, the data-based adaptive critic designs can be developed to solve the Hamilton-Jacobi-Bellman equation corresponding to the transformed optimal control problem. The uniform ultimate boundedness of the closed-loop system is also proved by using the Lyapunov approach. Finally, two simulation examples are presented to illustrate the effectiveness of the developed control strategy.
WOS关键词	ONLINE OPTIMAL-CONTROL ; DISCRETE-TIME-SYSTEMS ; POLICY ITERATION ; DECENTRALIZED STABILIZATION ; INPUT CONSTRAINTS ; UNKNOWN DYNAMICS ; HJB SOLUTION ; ALGORITHM
WOS研究方向	Automation & Control Systems ; Computer Science
语种	英语
WOS记录号	WOS:000386225800006
资助机构	National Natural Science Foundation of China(61233001 ; State Key Laboratory of Management and Control for Complex Systems ; 61273136 ; 61273140 ; 61304086 ; 61374105 ; 61533017 ; 61573353)
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/13326]
专题	复杂系统管理与控制国家重点实验室_深度强化学习
作者单位	1.Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China 2.Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Beijing 100083, Peoples R China
推荐引用方式 GB/T 7714	Wang, Ding,Liu, Derong,Zhang, Qichao,et al. Data-Based Adaptive Critic Designs for Nonlinear Robust Optimal Control With Uncertain Dynamics[J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS,2016,46(11):1544-1555.
APA	Wang, Ding,Liu, Derong,Zhang, Qichao,&Zhao, Dongbin.(2016).Data-Based Adaptive Critic Designs for Nonlinear Robust Optimal Control With Uncertain Dynamics.IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS,46(11),1544-1555.
MLA	Wang, Ding,et al."Data-Based Adaptive Critic Designs for Nonlinear Robust Optimal Control With Uncertain Dynamics".IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS 46.11(2016):1544-1555.