The Performance of Q-Learning within SDN Controlled Static and Dynamic Mesh Networks
- Resource Type
- Conference
- Authors
- Harewood-Gill, Douglas; Martin, Trevor; Nejabati, Reza
- Source
- 2020 6th IEEE Conference on Network Softwarization (NetSoft) Network Softwarization (NetSoft), 2020 6th IEEE Conference on. :185-189 Jun, 2020
- Subject
- Communication, Networking and Broadcast Technologies
Bandwidth
Topology
Network topology
Mesh networks
Measurement
Quality of service
Heuristic algorithms
SDN
Mesh Network
Reinforcement Learning
Q-Routing
K-Shortest Path
- Language
Current infrastructures are reaching the point where existing networking methods are unable to cope with the exponential growth of traffic and Quality of Service (QoS) requirements. New techniques are necessary to keep pace. One such technique, Software-Defined Networking (SDN) uses a central controller to program many individual network devices. However, SDN uses heuristic algorithms that do not always select the optimal path. This paper looked at creating three Q-Routing algorithms leveraging SDN and Mesh network topologies. Two algorithms used one network metric each (Latency and Bandwidth) and the third used multiple metrics. Results showed that the single metric Q-Routing algorithms on average performed as well as the K-Shortest Path versions while Q-Routing with multiple network metrics failed to match K-Shortest Path (different combination of metrics means these algorithms are not comparable). Results also showed that Q-Routing was able to calculate paths faster than K-Shortest Path in both static and dynamic networks.