A Novel Recognition Approach for Sketch-Based Interfaces

Multimodal interfaces can be profitably used to support the more and more complex applications and services which support human activities in everyday life. In particular, sketch-based interfaces offer users an effortless and powerful communication way to represent concepts and/or commands on different devices. Developing a sketch-based interface for a specific application or service is a time-consuming operation that requires the re-engineering and/or the re-designing of the whole recognizer framework. This paper describes a definitive framework that allows users to define each kind of sketch-based interface, using freehand drawing only. The definition of the interface and its recognition process are performed using our developed Sketch Modeling Language (SketchML). © 2009 Springer Berlin Heidelberg.