Identification of the source social network based on the downloaded images is an important multimedia forensic task with significant cybersecurity implications in light of the sheer volume of images and videos shared across various social media platforms. Such a task has been proved possible by exploiting distinctive traces embedded in image content by social networks (SNs). To further advance the development of this area, we propose a novel framework, called FusionNET, that integrates two established convolutional neural networks (CNNs), with the former (named 1D-CNN) learning discriminative features from the histogram of discrete cosine transform coefficients and the latter (named 2D-CNN) inferring unique attributes from the sensor-related noise residual of the images in question. The separately learned features are then fused by the FusionNET to inform the ensuing source identification or source-oriented image classification component. A series of experiments were conducted on a number of image datasets across various SNs and instant messaging apps to validate the feasibility of the FusionNET also in comparison with the performance of the 1D-CNN and 2D-CNN. The encouraging results were observed.

Social Network Identification Through Image Classification with CNN / Amerini, I.; Li, C. -T.; Caldelli, R.. - In: IEEE ACCESS. - ISSN 2169-3536. - 7:(2019), pp. 35264-35273. [10.1109/ACCESS.2019.2903876]

Social Network Identification Through Image Classification with CNN

Amerini I.
;
2019

Abstract

Identification of the source social network based on the downloaded images is an important multimedia forensic task with significant cybersecurity implications in light of the sheer volume of images and videos shared across various social media platforms. Such a task has been proved possible by exploiting distinctive traces embedded in image content by social networks (SNs). To further advance the development of this area, we propose a novel framework, called FusionNET, that integrates two established convolutional neural networks (CNNs), with the former (named 1D-CNN) learning discriminative features from the histogram of discrete cosine transform coefficients and the latter (named 2D-CNN) inferring unique attributes from the sensor-related noise residual of the images in question. The separately learned features are then fused by the FusionNET to inform the ensuing source identification or source-oriented image classification component. A series of experiments were conducted on a number of image datasets across various SNs and instant messaging apps to validate the feasibility of the FusionNET also in comparison with the performance of the 1D-CNN and 2D-CNN. The encouraging results were observed.
2019
CNN; cybersecurity; image provenance; multimedia forensics; noise residual; Source identification
01 Pubblicazione su rivista::01a Articolo in rivista
Social Network Identification Through Image Classification with CNN / Amerini, I.; Li, C. -T.; Caldelli, R.. - In: IEEE ACCESS. - ISSN 2169-3536. - 7:(2019), pp. 35264-35273. [10.1109/ACCESS.2019.2903876]
File allegati a questo prodotto
File Dimensione Formato  
Amerini_Social-Network-Identification_2019.pdf

accesso aperto

Note: https://ieeexplore.ieee.org/document/8668410
Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Creative commons
Dimensione 6.13 MB
Formato Adobe PDF
6.13 MB Adobe PDF

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1326309
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 41
  • ???jsp.display-item.citation.isi??? 28
social impact