In the coherence theory of attention, introduced by Rensink, O'Regan, and Clark (2000), a coherence field is defined by a hierarchy of structures supporting the activities taking place across the different stages of visual attention. At the interface between low level and mid-level attention processing stages are the proto-objects; these are generated in parallel and collect features of the scene at specific location and time. These structures fade away if the region is no further attended by attention. We introduce a method to computationally model these structures. Our model is based experimentally on data collected in dynamic 3D environments via the Gaze Machine, a gaze measurement framework. This framework allows to record pupil motion at the required speed and projects the point of regard in the 3D space (Pirri, Pizzoli, & Rudi, 2011; Pizzoli, Rigato, Shabani, & Pirri, 2011). To generate proto-objects the model is extended to vibrating circular membranes whose initial displacement is generated by the features that have been selected by classification. The energy of the vibrating membranes is used to predict saliency in visual search tasks. © 2013 Elsevier B.V.

Saliency prediction in the coherence theory of attention / Ntouskos, Valsamis; PIRRI ARDIZZONE, Maria Fiora; Pizzoli, Matia; Sinha, Arnab; Cafaro, Bruno. - In: BIOLOGICALLY INSPIRED COGNITIVE ARCHITECTURES. - ISSN 2212-683X. - STAMPA. - 5:(2013), pp. 10-28. (Intervento presentato al convegno 3rd Annual International Conference on Biologically Inspired Cognitive Architectures, BICA 2012 tenutosi a Palermo nel 31 October 2012 through 3 November 2012) [10.1016/j.bica.2013.05.012].

Saliency prediction in the coherence theory of attention

NTOUSKOS, VALSAMIS;PIRRI ARDIZZONE, Maria Fiora;PIZZOLI, MATIA;SINHA, ARNAB;CAFARO, BRUNO
2013

Abstract

In the coherence theory of attention, introduced by Rensink, O'Regan, and Clark (2000), a coherence field is defined by a hierarchy of structures supporting the activities taking place across the different stages of visual attention. At the interface between low level and mid-level attention processing stages are the proto-objects; these are generated in parallel and collect features of the scene at specific location and time. These structures fade away if the region is no further attended by attention. We introduce a method to computationally model these structures. Our model is based experimentally on data collected in dynamic 3D environments via the Gaze Machine, a gaze measurement framework. This framework allows to record pupil motion at the required speed and projects the point of regard in the 3D space (Pirri, Pizzoli, & Rudi, 2011; Pizzoli, Rigato, Shabani, & Pirri, 2011). To generate proto-objects the model is extended to vibrating circular membranes whose initial displacement is generated by the features that have been selected by classification. The energy of the vibrating membranes is used to predict saliency in visual search tasks. © 2013 Elsevier B.V.
2013
cognitive robotics; cognitive vision; proto-objects; saliency prediction; visual attention; visual search
01 Pubblicazione su rivista::01a Articolo in rivista
Saliency prediction in the coherence theory of attention / Ntouskos, Valsamis; PIRRI ARDIZZONE, Maria Fiora; Pizzoli, Matia; Sinha, Arnab; Cafaro, Bruno. - In: BIOLOGICALLY INSPIRED COGNITIVE ARCHITECTURES. - ISSN 2212-683X. - STAMPA. - 5:(2013), pp. 10-28. (Intervento presentato al convegno 3rd Annual International Conference on Biologically Inspired Cognitive Architectures, BICA 2012 tenutosi a Palermo nel 31 October 2012 through 3 November 2012) [10.1016/j.bica.2013.05.012].
File allegati a questo prodotto
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/524383
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 10
  • ???jsp.display-item.citation.isi??? 8
social impact