This paper proposes a deep-Q-network (DQN) controller for network selection and adaptive resource allocation in heterogeneous networks, developed on the ground of a Markov decision process (MDP) model of the problem. Network selection is an enabling technology for multi-connectivity, one of the core functionalities of 5G. For this reason, the present work considers a realistic network model that takes into account path-loss models and intra-RAT (radio access technology) interference. Numerical simulations validate the proposed approach and show the improvements achieved in terms of connection acceptance, resource allocation, and load balancing. In particular, the DQN algorithm has been tested against classic reinforcement learning one and other baseline approaches.
Satellite Integration into 5G: Deep Reinforcement Learning for Network Selection / De Santis, Emanuele; Giuseppi, Alessandro; Pietrabissa, Antonio; Capponi, Michael; Delli Priscoli, Francesco. - In: MACHINE INTELLIGENCE RESEARCH. - ISSN 2731-5398. - 19:2(2022), pp. 127-137. [10.1007/s11633-022-1326-3]
Satellite Integration into 5G: Deep Reinforcement Learning for Network Selection
De Santis, Emanuele
;Giuseppi, Alessandro;Pietrabissa, Antonio;Delli Priscoli, Francesco
2022
Abstract
This paper proposes a deep-Q-network (DQN) controller for network selection and adaptive resource allocation in heterogeneous networks, developed on the ground of a Markov decision process (MDP) model of the problem. Network selection is an enabling technology for multi-connectivity, one of the core functionalities of 5G. For this reason, the present work considers a realistic network model that takes into account path-loss models and intra-RAT (radio access technology) interference. Numerical simulations validate the proposed approach and show the improvements achieved in terms of connection acceptance, resource allocation, and load balancing. In particular, the DQN algorithm has been tested against classic reinforcement learning one and other baseline approaches.File | Dimensione | Formato | |
---|---|---|---|
DeSantis_Satellite_2022.pdf
solo gestori archivio
Tipologia:
Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza:
Tutti i diritti riservati (All rights reserved)
Dimensione
919.78 kB
Formato
Adobe PDF
|
919.78 kB | Adobe PDF | Contatta l'autore |
DeSantis_preprint_Satellite_2022.pdf
accesso aperto
Note: https://link.springer.com/article/10.1007/s11633-022-1326-3
Tipologia:
Documento in Pre-print (manoscritto inviato all'editore, precedente alla peer review)
Licenza:
Tutti i diritti riservati (All rights reserved)
Dimensione
633.33 kB
Formato
Adobe PDF
|
633.33 kB | Adobe PDF |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.