This paper focuses on the innovative visual analytics approach realized by the Visual Analytics Tool for Experimental Evaluation (VATE2) system, which eases and makes more effective the experimental evaluation process by introducing the what-if analysis. The what-if analysis is aimed at estimating the possible effects of a modification to an Information Retrieval (IR) system, in order to select the most promising fixes before implementing them, thus saving a considerable amount of effort. VATE2 builds on an analytical framework which models the behavior of the systems in order to make estimations, and integrates this analytical framework into a visual part which, via proper interaction and animations, receives input and provides feedback to the user. We conducted an experimental evaluation to assess the numerical performances of the analytical model and a validation of the visual analytics prototype with domain experts. Both the numerical evaluation and the user validation have shown that VATE2 is effective, innovative, and useful.

What-if analysis: A visual analytics approach to Information Retrieval evaluation / Angelini, Marco; Ferro, NICOLA MARIA; Santucci, Giuseppe; Silvello, Gianmaria. - STAMPA. - 1653:(2016). (Intervento presentato al convegno 7th Italian Information Retrieval Workshop, IIR 2016 tenutosi a Venezia; Italy nel 2016).

What-if analysis: A visual analytics approach to Information Retrieval evaluation

ANGELINI, MARCO
;
FERRO, NICOLA MARIA;SANTUCCI, Giuseppe;
2016

Abstract

This paper focuses on the innovative visual analytics approach realized by the Visual Analytics Tool for Experimental Evaluation (VATE2) system, which eases and makes more effective the experimental evaluation process by introducing the what-if analysis. The what-if analysis is aimed at estimating the possible effects of a modification to an Information Retrieval (IR) system, in order to select the most promising fixes before implementing them, thus saving a considerable amount of effort. VATE2 builds on an analytical framework which models the behavior of the systems in order to make estimations, and integrates this analytical framework into a visual part which, via proper interaction and animations, receives input and provides feedback to the user. We conducted an experimental evaluation to assess the numerical performances of the analytical model and a validation of the visual analytics prototype with domain experts. Both the numerical evaluation and the user validation have shown that VATE2 is effective, innovative, and useful.
2016
7th Italian Information Retrieval Workshop, IIR 2016
Estimation; IIR filters; Information retrieval; Visualization
04 Pubblicazione in atti di convegno::04b Atto di convegno in volume
What-if analysis: A visual analytics approach to Information Retrieval evaluation / Angelini, Marco; Ferro, NICOLA MARIA; Santucci, Giuseppe; Silvello, Gianmaria. - STAMPA. - 1653:(2016). (Intervento presentato al convegno 7th Italian Information Retrieval Workshop, IIR 2016 tenutosi a Venezia; Italy nel 2016).
File allegati a questo prodotto
File Dimensione Formato  
Angelini_What-if-analysis_2016.pdf

accesso aperto

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Creative commons
Dimensione 526.63 kB
Formato Adobe PDF
526.63 kB Adobe PDF

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/895742
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? ND
social impact