In this paper, we aim at investigating some relevant computational issues, in particular the role of global vs local optimizers, the role of the choice of the starting point, as well as of the optimization hyper-parameters setting on classification performances of deep networks. We carry out extensive computational experiments using nine different open-source optimization algorithms to train a deep CNN on an image classification task. Eventually, we also assess the role of wideness and depth on the computational optimization performance, carrying out additional tests with wider and deeper neural architecture.

Computational issues in Optimization for Deep networks / Coppola, Corrado; Papa, Lorenzo; Boresta, Marco; Amerini, Irene; Palagi, Laura. - (2022).

Computational issues in Optimization for Deep networks

Corrado Coppola
;
Lorenzo Papa;Marco Boresta;Irene Amerini;Laura Palagi
2022

Abstract

In this paper, we aim at investigating some relevant computational issues, in particular the role of global vs local optimizers, the role of the choice of the starting point, as well as of the optimization hyper-parameters setting on classification performances of deep networks. We carry out extensive computational experiments using nine different open-source optimization algorithms to train a deep CNN on an image classification task. Eventually, we also assess the role of wideness and depth on the computational optimization performance, carrying out additional tests with wider and deeper neural architecture.
2022
File allegati a questo prodotto
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1670122
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact