Safe Decision-making for Lane-change of Autonomous Vehicles via Human Demonstration-aided Reinforcement Learning
- Resource Type
- Conference
- Authors
- Wu, Jingda; Huang, Wenhui; de Boer, Niels; Mo, Yanghui; He, Xiangkun; Lv, Chen
- Source
- 2022 IEEE 25th International Conference on Intelligent Transportation Systems (ITSC) Intelligent Transportation Systems (ITSC), 2022 IEEE 25th International Conference on. :1228-1233 Oct, 2022
- Subject
- Communication, Networking and Broadcast Technologies
Components, Circuits, Devices and Systems
Computing and Processing
Engineering Profession
Power, Energy and Industry Applications
Robotics and Control Systems
Signal Processing and Analysis
Transportation
Training
Measurement
Runtime
Simulation
Decision making
Reinforcement learning
Safety
- Language
Decision-making is critical for lane change in autonomous driving. Reinforcement learning (RL) algorithms aim to identify the values of behaviors in various situations and thus they become a promising pathway to address the decision- making problem. However, poor runtime safety hinders RL- based decision-making strategies from complex driving tasks in practice. To address this problem, human demonstrations are incorporated into the RL-based decision-making strategy in this paper. Decisions made by human subjects in a driving simulator are treated as safe demonstrations, which are stored into the replay buffer and then utilized to enhance the training process of RL. A complex lane change task in an off-ramp scenario is established to examine the performance of the developed strategy. Simulation results suggest that human demonstrations can effectively improve the safety of decisions of RL. And the proposed strategy surpasses other existing learning-based decision-making strategies with respect to multiple driving performances.