Semantic communication, rather than on a bit-by-bit recovery of the transmitted messages, focuses on the meaning and the goal of the communication itself. In this paper, we propose a novel semantic image coding scheme that preserves the semantic content of an image, while ensuring a good trade-off between coding rate and image quality. The proposed Semantic-Preserving Image Coding based on Conditional Diffusion Models (SPIC) transmitter encodes a Semantic Segmentation Map (SSM) and a low-resolution version of the image to be transmitted. The receiver then reconstructs a high-resolution image using a Denoising Diffusion Probabilistic Models (DDPM) doubly conditioned to the SSM and the low-resolution image. As shown by the numerical examples, compared to state-of-the-art (SOTA) approaches, the proposed SPIC exhibits a better balance between the conventional rate-distortion trade-off and the preservation of semantically-relevant features.

Semantic-preserving image coding based on conditional diffusion models / Pezone, Francesco; Musa, Osman; Caire, Giuseppe; Barbarossa, Sergio. - (2024), pp. 13501-13505. (Intervento presentato al convegno IEEE ICASSP 2024 tenutosi a Seoul; South Korea) [10.1109/ICASSP48485.2024.10447279].

Semantic-preserving image coding based on conditional diffusion models

Francesco Pezone
Primo
Methodology
;
Sergio Barbarossa
Ultimo
Supervision
2024

Abstract

Semantic communication, rather than on a bit-by-bit recovery of the transmitted messages, focuses on the meaning and the goal of the communication itself. In this paper, we propose a novel semantic image coding scheme that preserves the semantic content of an image, while ensuring a good trade-off between coding rate and image quality. The proposed Semantic-Preserving Image Coding based on Conditional Diffusion Models (SPIC) transmitter encodes a Semantic Segmentation Map (SSM) and a low-resolution version of the image to be transmitted. The receiver then reconstructs a high-resolution image using a Denoising Diffusion Probabilistic Models (DDPM) doubly conditioned to the SSM and the low-resolution image. As shown by the numerical examples, compared to state-of-the-art (SOTA) approaches, the proposed SPIC exhibits a better balance between the conventional rate-distortion trade-off and the preservation of semantically-relevant features.
2024
IEEE ICASSP 2024
semantic communications; image segmentation; denoising diffusion probabilistic models; super-resolution diffusion models
04 Pubblicazione in atti di convegno::04b Atto di convegno in volume
Semantic-preserving image coding based on conditional diffusion models / Pezone, Francesco; Musa, Osman; Caire, Giuseppe; Barbarossa, Sergio. - (2024), pp. 13501-13505. (Intervento presentato al convegno IEEE ICASSP 2024 tenutosi a Seoul; South Korea) [10.1109/ICASSP48485.2024.10447279].
File allegati a questo prodotto
File Dimensione Formato  
Pezone_Semantic-preserving_2024.pdf

accesso aperto

Tipologia: Documento in Post-print (versione successiva alla peer review e accettata per la pubblicazione)
Licenza: Creative commons
Dimensione 1.56 MB
Formato Adobe PDF
1.56 MB Adobe PDF

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1726376
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact