This paper proposes a reinforcement learning-based lexicographic approach to the call admission control problem in communication networks. The admission control problem is modelled as a multiconstrained Markov decision process. To overcome the problems of the standard approaches to the solution of constrained Markov decision processes, based on the linear programming formulation or on a Lagrangian approach, a multi-constraint lexicographic approach is defined, and an online implementation based on reinforcement learning techniques is proposed. Simulations validate the proposed approach.

A Lexicographic Approach to Constrained MDP Admission Control / Panfili, Martina; Pietrabissa, Antonio; Oddi, G.; Suraci, V.. - In: INTERNATIONAL JOURNAL OF CONTROL. - ISSN 0020-7179. - STAMPA. - 89:2(2016), pp. 235-247. [10.1080/00207179.2015.1068955]

A Lexicographic Approach to Constrained MDP Admission Control

PANFILI, MARTINA;PIETRABISSA, Antonio
;
2016

Abstract

This paper proposes a reinforcement learning-based lexicographic approach to the call admission control problem in communication networks. The admission control problem is modelled as a multiconstrained Markov decision process. To overcome the problems of the standard approaches to the solution of constrained Markov decision processes, based on the linear programming formulation or on a Lagrangian approach, a multi-constraint lexicographic approach is defined, and an online implementation based on reinforcement learning techniques is proposed. Simulations validate the proposed approach.
2016
Stochastic control; Markov decision processes; reinforcement learning; communication networks; call admission control;
01 Pubblicazione su rivista::01a Articolo in rivista
A Lexicographic Approach to Constrained MDP Admission Control / Panfili, Martina; Pietrabissa, Antonio; Oddi, G.; Suraci, V.. - In: INTERNATIONAL JOURNAL OF CONTROL. - ISSN 0020-7179. - STAMPA. - 89:2(2016), pp. 235-247. [10.1080/00207179.2015.1068955]
File allegati a questo prodotto
File Dimensione Formato  
Panfili_A-lexicographic-approach_2016.pdf

solo gestori archivio

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 918.43 kB
Formato Adobe PDF
918.43 kB Adobe PDF   Contatta l'autore
Panfili_postprint_A-lexicographic-approach_2016.pdf

accesso aperto

Note: https://doi.org/10.1080/00207179.2015.1068955
Tipologia: Documento in Post-print (versione successiva alla peer review e accettata per la pubblicazione)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 492.77 kB
Formato Adobe PDF
492.77 kB Adobe PDF

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/787478
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 5
  • ???jsp.display-item.citation.isi??? 4
social impact