While Deep Learning methods have been successfully applied to tackle a wide variety of prediction problems, their application has been mostly limited to data structured in a grid-like fashion. However, the study of the human brain connectome involves the representation of the brain as a graph with interacting nodes. In this paper, we extend the Graph Attention Network (GAT), a novel neural network (NN) architecture acting on the features of the nodes of a binary graph, to handle a set of graphs provided with node features and non-binary edge weights. We demonstrate the effectiveness of our architecture by training it multimodal data collected from a large homogeneous fMRI dataset (n=1003 individuals with multiple fMRI sessions per subject) made publicly available by the Human Connectome Project (HCP), demonstrating good performance and seamless integration of multimodal neuroimaging data. Our adaptation provides a powerful and flexible deep learning tool to integrate multimodal neuroimaging connectomics data in a predictive context.

A novel Graph Attention Network Architecture for modeling multimodal brain connectivity / Filip, A. -C.; Azevedo, T.; Passamonti, L.; Toschi, N.; Lio, P.. - 2020-:(2020), pp. 1071-1074. (Intervento presentato al convegno 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society, EMBC 2020 tenutosi a Montreal; Canada) [10.1109/EMBC44109.2020.9176613].

A novel Graph Attention Network Architecture for modeling multimodal brain connectivity

Lio P.
2020

Abstract

While Deep Learning methods have been successfully applied to tackle a wide variety of prediction problems, their application has been mostly limited to data structured in a grid-like fashion. However, the study of the human brain connectome involves the representation of the brain as a graph with interacting nodes. In this paper, we extend the Graph Attention Network (GAT), a novel neural network (NN) architecture acting on the features of the nodes of a binary graph, to handle a set of graphs provided with node features and non-binary edge weights. We demonstrate the effectiveness of our architecture by training it multimodal data collected from a large homogeneous fMRI dataset (n=1003 individuals with multiple fMRI sessions per subject) made publicly available by the Human Connectome Project (HCP), demonstrating good performance and seamless integration of multimodal neuroimaging data. Our adaptation provides a powerful and flexible deep learning tool to integrate multimodal neuroimaging connectomics data in a predictive context.
2020
42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society, EMBC 2020
Deep learning; Graph structures; Graph theory; Large dataset; Learning systems; Neural networks; Neuroimaging
04 Pubblicazione in atti di convegno::04b Atto di convegno in volume
A novel Graph Attention Network Architecture for modeling multimodal brain connectivity / Filip, A. -C.; Azevedo, T.; Passamonti, L.; Toschi, N.; Lio, P.. - 2020-:(2020), pp. 1071-1074. (Intervento presentato al convegno 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society, EMBC 2020 tenutosi a Montreal; Canada) [10.1109/EMBC44109.2020.9176613].
File allegati a questo prodotto
File Dimensione Formato  
Filip_A-novel-Graph_2020.pdf

solo gestori archivio

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 599.6 kB
Formato Adobe PDF
599.6 kB Adobe PDF   Contatta l'autore

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1719914
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 5
  • ???jsp.display-item.citation.isi??? 5
social impact