The space of multimodal interaction is richer than the one for direct manipulation of WIMP interfaces. Yet, it is possible to identify a common structure, and define abstract notions of actions, gestures, events, presentations. We propose to characterise the interaction space in terms of a simple algebraic structure, realised by a basic architecture, and introduce a classification of actions. Interaction design, as well as personalisation, becomes the problem of mapping configurations of sensors to actions, and these to system's responses. This abstract setting is shown at work in two fields: direct manipulation of an iconic interface and recognition of emotional moods from posture analysis.

Articulating actions in multimodal interaction / N., BIANCHI BERTHOUZE; Bottoni, Paolo Gaspare. - In: JOURNAL OF THREE DIMENSIONAL IMAGES. - ISSN 1342-2189. - STAMPA. - 16:(2002), pp. 220-225.

Articulating actions in multimodal interaction

BOTTONI, Paolo Gaspare
2002

Abstract

The space of multimodal interaction is richer than the one for direct manipulation of WIMP interfaces. Yet, it is possible to identify a common structure, and define abstract notions of actions, gestures, events, presentations. We propose to characterise the interaction space in terms of a simple algebraic structure, realised by a basic architecture, and introduce a classification of actions. Interaction design, as well as personalisation, becomes the problem of mapping configurations of sensors to actions, and these to system's responses. This abstract setting is shown at work in two fields: direct manipulation of an iconic interface and recognition of emotional moods from posture analysis.
2002
01 Pubblicazione su rivista::01a Articolo in rivista
Articulating actions in multimodal interaction / N., BIANCHI BERTHOUZE; Bottoni, Paolo Gaspare. - In: JOURNAL OF THREE DIMENSIONAL IMAGES. - ISSN 1342-2189. - STAMPA. - 16:(2002), pp. 220-225.
File allegati a questo prodotto
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/47709
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact