Videos have become a powerful tool for spreading illegal content such as military propa-ganda, revenge porn, or bullying through social networks. To counter these illegal activities, it has become essential to try new methods to verify the origin of videos from these platforms. However, collecting datasets large enough to train neural networks for this task has become difficult because of the privacy regulations that have been enacted in recent years. To mitigate this limitation, in this work we propose two different solutions based on transfer learning and multitask learning to determine whether a video has been uploaded from or downloaded to a specific social platform through the use of shared features with images trained on the same task. By transferring features from the shallowest to the deepest levels of the network from the image task to videos, we measure the amount of information shared between these two tasks. Then, we introduce a model based on multitask learning, which learns from both tasks simultaneously. The promising experimental results show, in particular, the effectiveness of the multitask approach. According to our knowledge, this is the first work that addresses the problem of social media platform identification of videos through the use of shared features.

Identification of social-media platform of videos through the use of shared features / Maiano, L.; Amerini, I.; Ricciardi Celsi, L.; Anagnostopoulos, A.. - In: JOURNAL OF IMAGING. - ISSN 2313-433X. - 7:8(2021), pp. 1-16. [10.3390/jimaging7080140]

Identification of social-media platform of videos through the use of shared features

Maiano L.
;
Amerini I.;Ricciardi Celsi L.
;
Anagnostopoulos A.
2021

Abstract

Videos have become a powerful tool for spreading illegal content such as military propa-ganda, revenge porn, or bullying through social networks. To counter these illegal activities, it has become essential to try new methods to verify the origin of videos from these platforms. However, collecting datasets large enough to train neural networks for this task has become difficult because of the privacy regulations that have been enacted in recent years. To mitigate this limitation, in this work we propose two different solutions based on transfer learning and multitask learning to determine whether a video has been uploaded from or downloaded to a specific social platform through the use of shared features with images trained on the same task. By transferring features from the shallowest to the deepest levels of the network from the image task to videos, we measure the amount of information shared between these two tasks. Then, we introduce a model based on multitask learning, which learns from both tasks simultaneously. The promising experimental results show, in particular, the effectiveness of the multitask approach. According to our knowledge, this is the first work that addresses the problem of social media platform identification of videos through the use of shared features.
2021
Media forensics; Social media platform identification; Video forensics
01 Pubblicazione su rivista::01a Articolo in rivista
Identification of social-media platform of videos through the use of shared features / Maiano, L.; Amerini, I.; Ricciardi Celsi, L.; Anagnostopoulos, A.. - In: JOURNAL OF IMAGING. - ISSN 2313-433X. - 7:8(2021), pp. 1-16. [10.3390/jimaging7080140]
File allegati a questo prodotto
File Dimensione Formato  
Maiano_Identification_2021.pdf

accesso aperto

Note: https://doi.org/10.3390/jimaging7080140
Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Creative commons
Dimensione 507.3 kB
Formato Adobe PDF
507.3 kB Adobe PDF

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1622915
Citazioni
  • ???jsp.display-item.citation.pmc??? 2
  • Scopus 14
  • ???jsp.display-item.citation.isi??? 7
social impact