Modern machine-learning applications require huge artificial networks demanding computational power and memory. Light-based platforms promise ultrafast and energy-efficient hardware, which may help realize next -generation data processing devices. However, current photonic networks are limited by the number of input-output nodes that can be processed in a single shot. This restricted network capacity prevents their application to relevant large-scale problems such as natural language processing. Here, we realize a photonic processor for supervised learning with a capacity exceeding 1.5 x 1010 optical nodes, more than one order of magnitude larger than any previous implementation, which enables photonic large-scale text encoding and classification. By exploiting the full three-dimensional structure of the optical field propagating in free space, we overcome the interpolation threshold and reach the over-parameterized region of machine learning, a condition that allows high-performance sentiment analysis with a minimal fraction of training points. Our results provide a novel sol-ution to scale up light-driven computing and open the route to photonic natural language processing

Large-scale photonic natural language processing / Valensise, Carlo M.; Grecco, Ivana; Pierangeli, Davide; Conti, Claudio. - In: PHOTONICS RESEARCH. - ISSN 2327-9125. - 10:12(2022), pp. 2846-2853. [10.1364/PRJ.472932]

Large-scale photonic natural language processing

Carlo M. Valensise;Davide Pierangeli;Claudio Conti
Ultimo
Writing – Original Draft Preparation
2022

Abstract

Modern machine-learning applications require huge artificial networks demanding computational power and memory. Light-based platforms promise ultrafast and energy-efficient hardware, which may help realize next -generation data processing devices. However, current photonic networks are limited by the number of input-output nodes that can be processed in a single shot. This restricted network capacity prevents their application to relevant large-scale problems such as natural language processing. Here, we realize a photonic processor for supervised learning with a capacity exceeding 1.5 x 1010 optical nodes, more than one order of magnitude larger than any previous implementation, which enables photonic large-scale text encoding and classification. By exploiting the full three-dimensional structure of the optical field propagating in free space, we overcome the interpolation threshold and reach the over-parameterized region of machine learning, a condition that allows high-performance sentiment analysis with a minimal fraction of training points. Our results provide a novel sol-ution to scale up light-driven computing and open the route to photonic natural language processing
2022
machine learning, photonic computing, natural language processing
01 Pubblicazione su rivista::01a Articolo in rivista
Large-scale photonic natural language processing / Valensise, Carlo M.; Grecco, Ivana; Pierangeli, Davide; Conti, Claudio. - In: PHOTONICS RESEARCH. - ISSN 2327-9125. - 10:12(2022), pp. 2846-2853. [10.1364/PRJ.472932]
File allegati a questo prodotto
File Dimensione Formato  
NaturalLanguageProcessing2022.pdf

accesso aperto

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 1.21 MB
Formato Adobe PDF
1.21 MB Adobe PDF

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1678350
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 9
  • ???jsp.display-item.citation.isi??? 6
social impact