A Framework for Designing and Recognizing Sketch-Based Libraries for Pervasive Systems

Sketch-based interfaces enable users to eortless and powerfully communication way to represent concepts and/or commands, in dierent application domains, on dierent devices. Developing of a sketch-based interface for recognizing each specic do- main is a time-consuming operation that requires the re-engineering and/or the re-designing of the whole recognizer framework. The sketch-based interaction can be exploit in order to have a suitable modality to interact, in pervasive and ubiquitous way, with mobile infor- mation systems. Moreover, sketch-based interaction can be particularly protable if used together with other modalities (such as: speech, gesture, text, and so on). In this paper we propose a general framework to dene and to recognize each kind of 2D symbols library, besides the proposed approach allow us to add, by text and speech modalities, an additional semantic meaning to each symbol contained in the built library.