Adaptive Critic Designs for Optimal Event-Driven Control of a CSTR System

doi:10.1109/TII.2020.2972383

CORC > 自动化研究所 > 中国科学院自动化研究所 > 复杂系统管理与控制国家重点实验室 > 智能化团队

	Adaptive Critic Designs for Optimal Event-Driven Control of a CSTR System
	Yang, Xiong 1; Wei, Qinglai 2
刊名	IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS
	2021
卷号	17 期号:1 页码:484-493
关键词	Chemical reactors Optimal control Nonlinear systems Adaptive systems Cost function Informatics Closed loop systems Adaptive critic designs (ACDs) continuous stirred tank reactor (CSTR) discounted cost event-driven control reinforcement learning (RL)
ISSN号	1551-3203
DOI	10.1109/TII.2020.2972383
通讯作者	Yang, Xiong(xiong.yang@tju.edu.cn)
英文摘要	This article presents an optimal event-driven control scheme for a continuous stirred tank reactor (CSTR) system. The CSTR system differs from most of studied plants in that its equilibrium point is nonzero. In order to obtain the optimal event-driven control without coordinate transformations, we first introduce a discounted cost for such a system. Then, under the framework of adaptive critic designs, we use a single critic network to solve the Hamilton Jacobi Bellman equation related to the discounted-cost optimal event-driven control problem. To update the critic network weights, we employ the gradient descent method together with the experience replay technique. An advantage of the experience replay technique is that it brings about an easy-checked persistency of excitation-like condition. The stability analysis of all the signals in the closed-loop system is conducted via the Lyapunov approach. Finally, we validate the present optimal event-driven control strategy through simulations of the CSTR system.
资助项目	National Natural Science Foundation of China[61973228] ; National Natural Science Foundation of China[61722312] ; National Natural Science Foundation of China[TII-19-5501]
WOS关键词	APPROXIMATE OPTIMAL-CONTROL
WOS研究方向	Automation & Control Systems ; Computer Science ; Engineering
语种	英语
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
WOS记录号	WOS:000587719200045
资助机构	National Natural Science Foundation of China
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/41784]
专题	自动化研究所_复杂系统管理与控制国家重点实验室_智能化团队
通讯作者	Yang, Xiong
作者单位	1.Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China 2.Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
推荐引用方式 GB/T 7714	Yang, Xiong,Wei, Qinglai. Adaptive Critic Designs for Optimal Event-Driven Control of a CSTR System[J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS,2021,17(1):484-493.
APA	Yang, Xiong,&Wei, Qinglai.(2021).Adaptive Critic Designs for Optimal Event-Driven Control of a CSTR System.IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS,17(1),484-493.
MLA	Yang, Xiong,et al."Adaptive Critic Designs for Optimal Event-Driven Control of a CSTR System".IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS 17.1(2021):484-493.