Coordinated Ramp Metering with Equity Consideration Using Reinforcement Learning

doi:10.1061/JTEPBS.0000036

	Coordinated Ramp Metering with Equity Consideration Using Reinforcement Learning
	Lu, Chao 1,2; Huang, Jie 2,3; Deng, Lianbo 4; Gong, Jianwei 1
刊名	JOURNAL OF TRANSPORTATION ENGINEERING PART A-SYSTEMS
	2017-07-01
卷号	143 期号:7 页码:11
关键词	Ramp metering Reinforcement learning Asymmetric cell transmission model ALINEA
ISSN号	2473-2907
DOI	10.1061/JTEPBS.0000036
通讯作者	Lu, Chao(chaolu@bit.edu.cn)
英文摘要	Reinforcement learning (RL) has been applied to solve ramp-metering problems and attracted increasing attention in recent studies. However, improving traffic efficiency is the main concern of these applications, and the issue relating to user equity has not been well considered. A new RL-based system is developed in this paper to deal with equity-related problems. With the definition of three RL elements, including reward, action, and state, this system can capture the information of user equity and balance it with traffic efficiency. Simulation experiments using real traffic data collected from a real-world motorway stretch are designed to test the performance of the new system. Compared with a widely used ramp-metering algorithm ALINEA, the new system shows superior performance on improving both traffic efficiency and user equity. Specifically, with suitable parameter settings, the new system can reduce the total time spent (TTS) by motorway users by 18.5% and maintain an equally distributed total waiting time (TWT) with a low standard deviation for TWT across on-ramps close to 0. (C) 2017 American Society of Civil Engineers.
资助项目	China Scholarship Council and University of Leeds (CSC-University of Leeds scholarship) ; National Natural Science Foundation of China[91420203] ; National Natural Science Foundation of China[51275041] ; Beijing Institute of Technology Research Fund Program for Young Scholars
WOS关键词	FREEWAY ; CONGESTION ; NETWORK ; DESIGN
WOS研究方向	Engineering ; Transportation
语种	英语
出版者	ASCE-AMER SOC CIVIL ENGINEERS
WOS记录号	WOS:000401978300001
资助机构	China Scholarship Council and University of Leeds (CSC-University of Leeds scholarship) ; National Natural Science Foundation of China ; Beijing Institute of Technology Research Fund Program for Young Scholars
内容类型	期刊论文
源URL	[http://ir.igsnrr.ac.cn/handle/311030/64492]
专题	中国科学院地理科学与资源研究所
通讯作者	Lu, Chao
作者单位	1.Beijing Inst Technol, Sch Mech Engn, Beijing 100081, Peoples R China 2.Univ Leeds, Inst Transport Studies, Leeds LS2 9JT, W Yorkshire, England 3.Chinese Acad Sci, Inst Geog Sci & Nat Resources Res, Key Lab Reg Sustainable Dev Modeling, Beijing 100101, Peoples R China 4.Cent S Univ, Sch Traff & Transportat Engn, Changsha 410075, Hunan, Peoples R China
推荐引用方式 GB/T 7714	Lu, Chao,Huang, Jie,Deng, Lianbo,et al. Coordinated Ramp Metering with Equity Consideration Using Reinforcement Learning[J]. JOURNAL OF TRANSPORTATION ENGINEERING PART A-SYSTEMS,2017,143(7):11.
APA	Lu, Chao,Huang, Jie,Deng, Lianbo,&Gong, Jianwei.(2017).Coordinated Ramp Metering with Equity Consideration Using Reinforcement Learning.JOURNAL OF TRANSPORTATION ENGINEERING PART A-SYSTEMS,143(7),11.
MLA	Lu, Chao,et al."Coordinated Ramp Metering with Equity Consideration Using Reinforcement Learning".JOURNAL OF TRANSPORTATION ENGINEERING PART A-SYSTEMS 143.7(2017):11.