Whenever communication takes place to fulfill a goal, an effective way to encode the source data to be transmitted is to use an encoding rule that allows the receiver to meet the requirements of the goal. A formal way to identify the relevant information with respect to a goal can be obtained exploiting the information bottleneck (IB) principle. In this paper, we propose a goal-oriented communication system, based on the combination of IB and stochastic optimization. The IB principle is used to design the encoder in order to find an optimal balance between representation complexity and relevance of the encoded data with respect to the goal. Stochastic optimization is then used to adapt the parameters of the IB to find an efficient resource allocation of communication and computation resources. Our goal is to minimize the average energy consumption under constraints on average service delay and accuracy of the learning task applied to the received data in a dynamic scenario. Numerical results assess the performance of the proposed strategy in two cases: regression from Gaussian random variables, where we can exploit closed-form solutions, and image classification using deep neural networks, with adaptive network splitting between transmit and receive sides.

Goal-Oriented Communication for Edge Learning Based On the Information Bottleneck / Pezone, F; Barbarossa, S; Di Lorenzo, P. - (2022), pp. 8832-8836. (Intervento presentato al convegno IEEE ICASSP 2022 tenutosi a Singapore) [10.1109/ICASSP43922.2022.9746468].

Goal-Oriented Communication for Edge Learning Based On the Information Bottleneck

Pezone, F;Barbarossa, S;Di Lorenzo, P
2022

Abstract

Whenever communication takes place to fulfill a goal, an effective way to encode the source data to be transmitted is to use an encoding rule that allows the receiver to meet the requirements of the goal. A formal way to identify the relevant information with respect to a goal can be obtained exploiting the information bottleneck (IB) principle. In this paper, we propose a goal-oriented communication system, based on the combination of IB and stochastic optimization. The IB principle is used to design the encoder in order to find an optimal balance between representation complexity and relevance of the encoded data with respect to the goal. Stochastic optimization is then used to adapt the parameters of the IB to find an efficient resource allocation of communication and computation resources. Our goal is to minimize the average energy consumption under constraints on average service delay and accuracy of the learning task applied to the received data in a dynamic scenario. Numerical results assess the performance of the proposed strategy in two cases: regression from Gaussian random variables, where we can exploit closed-form solutions, and image classification using deep neural networks, with adaptive network splitting between transmit and receive sides.
2022
IEEE ICASSP 2022
information bottleneck; wireless edge learning; stochastic optimization; resource allocation
04 Pubblicazione in atti di convegno::04b Atto di convegno in volume
Goal-Oriented Communication for Edge Learning Based On the Information Bottleneck / Pezone, F; Barbarossa, S; Di Lorenzo, P. - (2022), pp. 8832-8836. (Intervento presentato al convegno IEEE ICASSP 2022 tenutosi a Singapore) [10.1109/ICASSP43922.2022.9746468].
File allegati a questo prodotto
File Dimensione Formato  
Pezone_Goal-Oriented_2022.pdf

accesso aperto

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 1.09 MB
Formato Adobe PDF
1.09 MB Adobe PDF

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1687901
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 11
  • ???jsp.display-item.citation.isi??? 4
social impact