Short Term Fellowship presso il DataBase Lab dell'Università di Aizu, su

Maggio 2002

The space of multimodal interaction is richer than the one for direct manipulation of WIMP inter- faces. Yet, it is possible to identify a common structure, and dene abstract notions of actions, gestures, events, presentations. We propose to characterise the interaction space in terms of a simple algebraic structure, realised by a basic ar- chitecture, and introduce a classication of ac- tions. Interaction design, as well as personalisa- tion, becomes the problem of mapping congura- tions of sensors to actions, and these to system's responses. This abstract setting is shown at work in two elds: direct manipulation of an iconic in- terface and recognition of emotional moods from posture analysis.