Co-clustering in text mining has been proposed to partition words and documents simultaneously. Although the main advantage of this approach may improve interpretation of clusters on the data, there are still few proposals on these methods; while one-way partition is even now widely utilized for information retrieval. In contrast to structured information, textual data suffer of high dimensionality and sparse matrices, so it is strictly necessary to pre-process texts for applying clustering techniques. In this paper, we propose a new procedure to reduce high dimensionality of corpora and to remove the noises from the unstructured data. We test two different processes to treat data applying two co-clustering algorithms; based on the results we present the procedure that provides the best interpretation of the data.

Multi-mode partitioning for text clustering to reduce dimensionality and noises / Celardo, Livia; Fioredistella Iezzi, Domenica; Vichi, Maurizio. - STAMPA. - 1:(2016), pp. 181-192. (Intervento presentato al convegno 13th International Conference on Statistical Analysis of Textual Data tenutosi a Nice, France nel 7-10 June 2016).

Multi-mode partitioning for text clustering to reduce dimensionality and noises

Livia Celardo;Maurizio Vichi
2016

Abstract

Co-clustering in text mining has been proposed to partition words and documents simultaneously. Although the main advantage of this approach may improve interpretation of clusters on the data, there are still few proposals on these methods; while one-way partition is even now widely utilized for information retrieval. In contrast to structured information, textual data suffer of high dimensionality and sparse matrices, so it is strictly necessary to pre-process texts for applying clustering techniques. In this paper, we propose a new procedure to reduce high dimensionality of corpora and to remove the noises from the unstructured data. We test two different processes to treat data applying two co-clustering algorithms; based on the results we present the procedure that provides the best interpretation of the data.
2016
13th International Conference on Statistical Analysis of Textual Data
ADT; statistical analysis; textual data; lexicometry; logometry; textometry; statistique textuelle; logométrie; textométrie; lexicométrie
04 Pubblicazione in atti di convegno::04b Atto di convegno in volume
Multi-mode partitioning for text clustering to reduce dimensionality and noises / Celardo, Livia; Fioredistella Iezzi, Domenica; Vichi, Maurizio. - STAMPA. - 1:(2016), pp. 181-192. (Intervento presentato al convegno 13th International Conference on Statistical Analysis of Textual Data tenutosi a Nice, France nel 7-10 June 2016).
File allegati a questo prodotto
File Dimensione Formato  
Celardo, Iezzi & Vichi (2016).pdf

accesso aperto

Tipologia: Documento in Post-print (versione successiva alla peer review e accettata per la pubblicazione)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 410 kB
Formato Adobe PDF
410 kB Adobe PDF

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1054532
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact