The evaluation of an information visualization system is a complex activity, involving the understanding of both the visualization itself and the process that it is meant to support. Moreover, if the evaluation activity includes a task based user study, it requires a considerable effort, involving both conceptual (e.g., the definition of user tasks) and technical (e.g., logging of the relevant user actions while using the system) aspects. The solution presented in this paper, STEIN (Seamless Testing Environment INtegrator), allows integrating the system under evaluation with the questions that have been designed for the user study, tracing the user's activities and automatically collecting the user's answers using the events that are generated while interacting with the system. This results in a substantial reduction of the effort associated with technical activities, thus allowing the evaluation designer to focus mainly on the conceptual aspects. A prototype of the system is available for download at awareserver.dis.uniroma1.it:8080/stein.

STEIN: Speeding up evaluation activities with a seamless testing environment integrator / Angelini, Marco; Blasilli, Graziano; Lenti, Simone; Santucci, Giuseppe. - ELETTRONICO. - (2018). ((Intervento presentato al convegno EuroVis 2018 - 20th EG/VGTC Conference on Visualization tenutosi a Brno, Czech Republic [10.2312/eurovisshort.20181083].

STEIN: Speeding up evaluation activities with a seamless testing environment integrator

Marco Angelini
;
Graziano Blasilli
;
Simone Lenti
;
Giuseppe Santucci
2018

Abstract

The evaluation of an information visualization system is a complex activity, involving the understanding of both the visualization itself and the process that it is meant to support. Moreover, if the evaluation activity includes a task based user study, it requires a considerable effort, involving both conceptual (e.g., the definition of user tasks) and technical (e.g., logging of the relevant user actions while using the system) aspects. The solution presented in this paper, STEIN (Seamless Testing Environment INtegrator), allows integrating the system under evaluation with the questions that have been designed for the user study, tracing the user's activities and automatically collecting the user's answers using the events that are generated while interacting with the system. This results in a substantial reduction of the effort associated with technical activities, thus allowing the evaluation designer to focus mainly on the conceptual aspects. A prototype of the system is available for download at awareserver.dis.uniroma1.it:8080/stein.
2018
EuroVis 2018 - 20th EG/VGTC Conference on Visualization
user study; user traces; evaluation; information visualization
04 Pubblicazione in atti di convegno::04b Atto di convegno in volume
STEIN: Speeding up evaluation activities with a seamless testing environment integrator / Angelini, Marco; Blasilli, Graziano; Lenti, Simone; Santucci, Giuseppe. - ELETTRONICO. - (2018). ((Intervento presentato al convegno EuroVis 2018 - 20th EG/VGTC Conference on Visualization tenutosi a Brno, Czech Republic [10.2312/eurovisshort.20181083].
File allegati a questo prodotto
File Dimensione Formato  
Angelini_STEIN-speeding-evaluation_2018.pdf

solo gestori archivio

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 2.35 MB
Formato Adobe PDF
2.35 MB Adobe PDF   Visualizza/Apri   Richiedi una copia
EuroVis2018_Frontespizio-indice_2018.pdf

solo gestori archivio

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 2.2 MB
Formato Adobe PDF
2.2 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1119480
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact