This paper defines a Reinforcement Learning (RL) approach to call control algorithms in links with variable capacity supporting multiple classes of service. The novelties of the document are the following: i) the problem is modeled as a constrained Markov Decision Process (MDP); ii) the constrained MDP is solved via a RL algorithm by using the Lagrangian approach and state aggregation. The proposed approach is capable of controlling class-level quality of service in terms of both blocking and dropping probabilities. Numerical simulations show the effectiveness of the approach.

Reinforcement Learning Call Control in Variable Capacity Links / Pietrabissa, Antonio. - (2010), pp. 933-938. (Intervento presentato al convegno 18th Annual International Mediterranean Conference on Control and Automation (MED) tenutosi a Marrakech, MOROCCO nel JUN 23-25, 2010) [10.1109/med.2010.5547750].

Reinforcement Learning Call Control in Variable Capacity Links

PIETRABISSA, Antonio
2010

Abstract

This paper defines a Reinforcement Learning (RL) approach to call control algorithms in links with variable capacity supporting multiple classes of service. The novelties of the document are the following: i) the problem is modeled as a constrained Markov Decision Process (MDP); ii) the constrained MDP is solved via a RL algorithm by using the Lagrangian approach and state aggregation. The proposed approach is capable of controlling class-level quality of service in terms of both blocking and dropping probabilities. Numerical simulations show the effectiveness of the approach.
2010
18th Annual International Mediterranean Conference on Control and Automation (MED)
call control; communication networks; reinforcement learning; markov decision processes
04 Pubblicazione in atti di convegno::04b Atto di convegno in volume
Reinforcement Learning Call Control in Variable Capacity Links / Pietrabissa, Antonio. - (2010), pp. 933-938. (Intervento presentato al convegno 18th Annual International Mediterranean Conference on Control and Automation (MED) tenutosi a Marrakech, MOROCCO nel JUN 23-25, 2010) [10.1109/med.2010.5547750].
File allegati a questo prodotto
File Dimensione Formato  
VE_2010_11573-219167.pdf

solo gestori archivio

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 468.09 kB
Formato Adobe PDF
468.09 kB Adobe PDF   Contatta l'autore

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/219167
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? 1
social impact