Fuzzy-Based Goal Representation Adaptive Dynamic Programming

doi:10.1109/TFUZZ.2015.2505327

CORC > 自动化研究所 > 中国科学院自动化研究所 > 复杂系统管理与控制国家重点实验室 > 深度强化学习

	Fuzzy-Based Goal Representation Adaptive Dynamic Programming
	Tang, Yufei 1; He, Haibo 1; Ni, Zhen 2; Zhong, Xiangnan 1; Zhao, Dongbin3,4 ; Xu, Xin 5
刊名	IEEE TRANSACTIONS ON FUZZY SYSTEMS
	2016-10-01
卷号	24 期号:5 页码:1159-1175
关键词	Adaptive Dynamic Programming (Adp) Fuzzy Hyperbolic Model (Fhm) Goal Representation Adaptive Dynamic Programming (Gradp) Internal Goal Representation Multimachine Power Systems Stability Analysis
DOI	10.1109/TFUZZ.2015.2505327
文献子类	Article
英文摘要	In this paper, a novel nonlinear learning controller called fuzzy-based goal representation adaptive dynamic programming (Fuzzy-GrADP) is proposed. In the proposed GrADP method, a goal representation network is introduced to generate an adaptive internal reinforcement signal to the critic network to help the controller provide a general mapping between the input and output actions. Moreover, in the proposed architecture, the action network in the GrADP is improved by using the fuzzy hyperbolic model, which combines the merits of the fuzzy model and the neural network model. Based on the back-propagation technique, the parameters in the membership functions and the fuzzy rules are all undergo training and online adapting. The proposed controller is tested on two numerical benchmarks, and the simulation results show that the proposed controller outperforms the original adaptive dynamic fuzzy controller and the pure neural network-based GrADP controller. In addition, the proposed controller is further applied on a large multimachine power system for static var compensator damping control, where simulation results demonstrate the effectiveness of the proposed approach on real applications. Furthermore, in order to demonstrate the theoretical guarantee of the proposed method, Lyapunov stability analysis to support the proposed Fuzzy-GrADP approach has also been carried out.
WOS关键词	AREA DAMPING CONTROLLER ; POWER-SYSTEM STABILITY ; TIME-VARYING DELAYS ; NONLINEAR-SYSTEMS ; NEURAL-NETWORK ; INTERAREA OSCILLATIONS ; TRACKING CONTROL ; CRITIC DESIGNS ; LOGIC ; IDENTIFICATION
WOS研究方向	Computer Science ; Engineering
语种	英语
WOS记录号	WOS:000386076600013
资助机构	National Science Foundation(ECCS 1053717 ; National Natural Science Foundation of China(51529701 ; IIS 1526835) ; 61520106009 ; U1564214 ; 61273136 ; 61573353)
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/13333]
专题	复杂系统管理与控制国家重点实验室_深度强化学习
作者单位	1.Univ Rhode Isl, Dept Elect Comp & Biomed Engn, Kingston, RI 02881 USA 2.South Dakota State Univ, Dept Elect Engn & Comp Sci, Brookings, SD 57007 USA 3.Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China 4.Univ Chinese Acad Sci, Beijing 100049, Peoples R China 5.Natl Univ Def Technol, Coll Mechatron & Automat, Changsha 410073, Hunan, Peoples R China
推荐引用方式 GB/T 7714	Tang, Yufei,He, Haibo,Ni, Zhen,et al. Fuzzy-Based Goal Representation Adaptive Dynamic Programming[J]. IEEE TRANSACTIONS ON FUZZY SYSTEMS,2016,24(5):1159-1175.
APA	Tang, Yufei,He, Haibo,Ni, Zhen,Zhong, Xiangnan,Zhao, Dongbin,&Xu, Xin.(2016).Fuzzy-Based Goal Representation Adaptive Dynamic Programming.IEEE TRANSACTIONS ON FUZZY SYSTEMS,24(5),1159-1175.
MLA	Tang, Yufei,et al."Fuzzy-Based Goal Representation Adaptive Dynamic Programming".IEEE TRANSACTIONS ON FUZZY SYSTEMS 24.5(2016):1159-1175.