Design and performance analysis of inductive QoS scheduling for dynamic network routing
- Resource Type
- Conference
- Authors
- Zouaidi, S.; Mellouk, A.; Bourennane, M.; Hoceini, S.
- Source
- 2008 16th International Conference on Software, Telecommunications and Computer Networks Software, Telecommunications and Computer Networks, 2008. SoftCOM 2008. 16th International Conference on. :140-146 Sep, 2008
- Subject
- Computing and Processing
Communication, Networking and Broadcast Technologies
Performance analysis
Dynamic scheduling
Routing
Quality of service
Delay
Multiagent systems
Mobile communication
Adaptive algorithm
Learning
Cost function
- Language
In the last decade, due to emerging real-time and multimedia applications, there has been much interest for developing mechanisms to take into account the quality of service required by these applications. We have proposed earlier an approach used an adaptive algorithm for packet routing using reinforcement learning called K-Optimal path Q-Routing Algorithm (KOQRA) which optimizes simultaneously two additive QoS criteria: cumulative cost path and end-to-end delay. The approach developed here adds a new module to KOQRA dealing with the packet scheduling topic in order to achieve QoS differentiation and to optimize the queuing delay in a dynamically wireless changing environment. This module uses a multi-agent system in which each agent tries to optimize its own behaviour and communicate with other agents to make global coordination possible. This communication is done by mobile agents. In this paper, we adopt the framework of Markov Decision Process applied to multi-agent system and present a pheromone-Q learning approach which combines the standard Q-learning technique with a synthetic pheromone that acts as a communication medium speeding up the learning process of cooperating agents. Numerical results obtained with OPNET simulator for different levels of traffic’s load show that Adaptive Scheduling improves clearly performances of our earlier KOQRA.