Evaluation initiatives have been widely credited with contributing highly to the development and advancement of information access systems, by providing a sustainable platform for conducting the very demanding activity of comparable experimental evaluation in a large scale. Measuring the impact of such benchmarking activities is crucial for assessing which of their aspects have been successful, which activities should be continued, enforced or suspended and which research paths should be further pursued in the future. This work introduces a framework for modeling the data produced by evaluation campaigns, a methodology for measuring their scholarly impact, and tools exploiting visual analytics to analyze the outcomes.
Measuring and Analyzing the Scholarly Impact of Experimental Evaluation Initiatives / Angelini, Marco; N., Ferro; B., Larsen; H., Müller; Santucci, Giuseppe; G., Silvello; T., Tsikrika. - 28:(2014), pp. 133-137. (Intervento presentato al convegno 10th Italian Research Conference on Digital Libraries tenutosi a Padova nel 30-31/01/2014) [10.1016/j.procs.2014.10.022].
Measuring and Analyzing the Scholarly Impact of Experimental Evaluation Initiatives
ANGELINI, MARCO;SANTUCCI, Giuseppe;
2014
Abstract
Evaluation initiatives have been widely credited with contributing highly to the development and advancement of information access systems, by providing a sustainable platform for conducting the very demanding activity of comparable experimental evaluation in a large scale. Measuring the impact of such benchmarking activities is crucial for assessing which of their aspects have been successful, which activities should be continued, enforced or suspended and which research paths should be further pursued in the future. This work introduces a framework for modeling the data produced by evaluation campaigns, a methodology for measuring their scholarly impact, and tools exploiting visual analytics to analyze the outcomes.| File | Dimensione | Formato | |
|---|---|---|---|
|
VE_2014_11573-763128.pdf
solo gestori archivio
Tipologia:
Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza:
Tutti i diritti riservati (All rights reserved)
Dimensione
715.17 kB
Formato
Adobe PDF
|
715.17 kB | Adobe PDF | Contatta l'autore |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
