Receding Horizon Markov Game Autonomous Driving Strategy
- Resource Type
- Conference
- Authors
- Coskun, Serdar; Zhang, Qingyu; Langari, Reza
- Source
- 2019 American Control Conference (ACC) Control Conference (ACC), 2019 American. :1367-1374 Jul, 2019
- Subject
- Aerospace
Robotics and Control Systems
- Language
- ISSN
- 2378-5861
This paper presents a novel human-like autonomous driving algorithms for lane-changing problem. To this end, we present a multi-agent decision-making scheme by blending game theory with the Markov decision process, forming a Markov game (MG). In this decision-making process, interaction of a subject vehicle (SV) and traffic vehicles (TVs) are captured in a mathematically tractable manner via both a cooperative game (max - max) where vehicles perform their decisions for collective objectives and a noncooperative game (max - min) where vehicles perform their decisions for individual objectives. Strategies of the players are computed via a Receding Horizon (RH) approach where optimal solutions are found through an optimization strategy by taking into account current and future constraints. The proposed approach is evaluated in a human-in-the-Ioop (HIL) environment built around a MATLAB/SimulinkldSPACE realtime simulator where the Markov game-guided SV controller interacts with programmed TV s and one human-driven vehicle (HV). Experimental results show that the Markov game driving strategy is capable of finding a safe gap in multi-move traffic that is consistent with human drivers' behaviours in mandatory lane-changing.