The space of multimodal interaction is richer than the one for direct manipulation of WIMP interfaces. Yet, it is possible to identify a common structure, and define abstract notions of actions, gestures, events, presentations. We propose to characterise the interaction space in terms of a simple algebraic structure, realised by a basic architecture, and introduce a classification of actions. Interaction design, as well as personalisation, becomes the problem of mapping configurations of sensors to actions, and these to system's responses. This abstract setting is shown at work in two fields: direct manipulation of an iconic interface and recognition of emotional moods from posture analysis.
Articulating actions in multimodal interaction / N., BIANCHI BERTHOUZE; Bottoni, Paolo Gaspare. - In: JOURNAL OF THREE DIMENSIONAL IMAGES. - ISSN 1342-2189. - STAMPA. - 16:(2002), pp. 220-225.
Articulating actions in multimodal interaction
BOTTONI, Paolo Gaspare
2002
Abstract
The space of multimodal interaction is richer than the one for direct manipulation of WIMP interfaces. Yet, it is possible to identify a common structure, and define abstract notions of actions, gestures, events, presentations. We propose to characterise the interaction space in terms of a simple algebraic structure, realised by a basic architecture, and introduce a classification of actions. Interaction design, as well as personalisation, becomes the problem of mapping configurations of sensors to actions, and these to system's responses. This abstract setting is shown at work in two fields: direct manipulation of an iconic interface and recognition of emotional moods from posture analysis.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.