Multi-agent systems recently gained a lot of attention for solving machine learning and data mining problems. Furthermore, their peculiar divide-and-conquer approach is appealing when large datasets have to be analyzed. In this paper, we propose a multi-agent classification system able to tackle large datasets where each agent independently explores a random small portion of the overall dataset, searching for meaningful clusters in proper subspaces where they are well-formed (i.e., compact and populated). This search is orchestrated by means of a genetic algorithm able to act in a multi-modal fashion, since meaningful clusters might lie in different subspaces. Furthermore, since agents operate independently one another, their execution is parallelized across different computational units. Tests show that the proposed algorithm, E-ABC2, is able to deal with large datasets, returning satisfactory results in terms of scalability and performances, especially when compared with our previous baseline versions.

Facing Big Data by an agent-based multimodal evolutionary approach to classification / Giampieri, Mauro; Baldini, Luca; DE SANTIS, Enrico; Rizzi, Antonello. - (2020), pp. 1-8. (Intervento presentato al convegno 2020 International Joint Conference on Neural Networks, IJCNN 2020 tenutosi a Glasgow (UK)) [10.1109/IJCNN48605.2020.9206966].

Facing Big Data by an agent-based multimodal evolutionary approach to classification

Mauro Giampieri;Luca Baldini;Enrico De Santis;Antonello Rizzi
2020

Abstract

Multi-agent systems recently gained a lot of attention for solving machine learning and data mining problems. Furthermore, their peculiar divide-and-conquer approach is appealing when large datasets have to be analyzed. In this paper, we propose a multi-agent classification system able to tackle large datasets where each agent independently explores a random small portion of the overall dataset, searching for meaningful clusters in proper subspaces where they are well-formed (i.e., compact and populated). This search is orchestrated by means of a genetic algorithm able to act in a multi-modal fashion, since meaningful clusters might lie in different subspaces. Furthermore, since agents operate independently one another, their execution is parallelized across different computational units. Tests show that the proposed algorithm, E-ABC2, is able to deal with large datasets, returning satisfactory results in terms of scalability and performances, especially when compared with our previous baseline versions.
2020
2020 International Joint Conference on Neural Networks, IJCNN 2020
Big Data; data mining; multi-agent systems; clustering; machine learning; classification systems; evolutionary computation; genetic algorithms
04 Pubblicazione in atti di convegno::04b Atto di convegno in volume
Facing Big Data by an agent-based multimodal evolutionary approach to classification / Giampieri, Mauro; Baldini, Luca; DE SANTIS, Enrico; Rizzi, Antonello. - (2020), pp. 1-8. (Intervento presentato al convegno 2020 International Joint Conference on Neural Networks, IJCNN 2020 tenutosi a Glasgow (UK)) [10.1109/IJCNN48605.2020.9206966].
File allegati a questo prodotto
File Dimensione Formato  
Giampieri_Copertina-Indice_Facing-Big-Data_2020.pdf

accesso aperto

Tipologia: Altro materiale allegato
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 607.48 kB
Formato Adobe PDF
607.48 kB Adobe PDF
Giampieri_Facing-Big-Data_2020.pdf

solo gestori archivio

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 827.79 kB
Formato Adobe PDF
827.79 kB Adobe PDF   Contatta l'autore

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1453658
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 2
  • ???jsp.display-item.citation.isi??? 0
social impact