The aim of this paper is to show how to use the Efficiency, a brain-computer interface (BCI) performance indicator, to evaluate the performances of a wide range of BCI systems. Unlike the most used metrics in the BCI research field, the Efficiency takes into account the penalties and the strategies to recover errors and this makes it a reliable instrument to describe the behavior of real BCIs. The Efficiency is compared with the accuracy and the information transfer rate, both in the Wolpaw and Nykopp definitions. The comparison covers four widely used classifiers and different stimulation sequences. Results show that the Efficiency is able to predict if the communication will not be possible, because the time spent to correct mistakes is longer than the time needed to generate a correct selection, and therefore it provides a much more realistic evaluation of a system. It can also be easily adapted to evaluate different applications, so it reveals a more general and versatile indicator for BCI systems. © 2011 Elsevier B.V.
Evaluation of the performances of different P300 based brain-computer interfaces by means of the efficiency metric / L. R., Quitadamo; M., Abbafati; G. C., Cardarilli; D., Mattia; Cincotti, Febo; Babiloni, Fabio; M. G., Marciani; L., Bianchi. - In: JOURNAL OF NEUROSCIENCE METHODS. - ISSN 0165-0270. - STAMPA. - 203:2(2012), pp. 361-368. [10.1016/j.jneumeth.2011.10.010]
Evaluation of the performances of different P300 based brain-computer interfaces by means of the efficiency metric
CINCOTTI, FEBO;BABILONI, Fabio;
2012
Abstract
The aim of this paper is to show how to use the Efficiency, a brain-computer interface (BCI) performance indicator, to evaluate the performances of a wide range of BCI systems. Unlike the most used metrics in the BCI research field, the Efficiency takes into account the penalties and the strategies to recover errors and this makes it a reliable instrument to describe the behavior of real BCIs. The Efficiency is compared with the accuracy and the information transfer rate, both in the Wolpaw and Nykopp definitions. The comparison covers four widely used classifiers and different stimulation sequences. Results show that the Efficiency is able to predict if the communication will not be possible, because the time spent to correct mistakes is longer than the time needed to generate a correct selection, and therefore it provides a much more realistic evaluation of a system. It can also be easily adapted to evaluate different applications, so it reveals a more general and versatile indicator for BCI systems. © 2011 Elsevier B.V.File | Dimensione | Formato | |
---|---|---|---|
VE_2012_11573-425859.pdf
solo gestori archivio
Tipologia:
Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza:
Tutti i diritti riservati (All rights reserved)
Dimensione
1.24 MB
Formato
Adobe PDF
|
1.24 MB | Adobe PDF | Contatta l'autore |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.