Adaptive Dynamic Programming for Finite-Horizon Networked Control System with Packet Loss and Delay
- Resource Type
- Conference
- Authors
- Xiao, Lanqi; Zhang, Liangyin; Xu, Huakai; Chen, Michael Z. Q.
- Source
- 2023 IEEE 6th International Conference on Electronic Information and Communication Technology (ICEICT) Electronic Information and Communication Technology (ICEICT), 2023 IEEE 6th International Conference on. :750-755 Jul, 2023
- Subject
- Communication, Networking and Broadcast Technologies
Computing and Processing
Fields, Waves and Electromagnetics
Signal Processing and Analysis
Adaptive systems
Networked control systems
Riccati equations
Packet loss
Optimal control
Data collection
Dynamic programming
Networked control system
Adaptive dynamic programming
Off-policy strategy
- Language
- ISSN
- 2836-7782
This paper presents a novel approach to adaptive optimal control of networked control systems with packet loss and delay using adaptive dynamic programming. The impact of stochastic packet loss and delay is first considered. The relationship between the stochastic Riccati equation and the deterministic Riccati equations is established via simulations that result from sampling the original system. It enables the implementation of stochastic approximate optimal control by means of an off-policy iterative strategy. The effectiveness of proposed procedures is finally demonstrated through an example.