SketchML a Representation Language for Novel Sketch Recognition Approach

Multimodal interfaces can be profitably used to support increasingly complex services in assistive environments. In particular, sketch-based interfaces o®er users an e®ortless and powerful communication way to represent concepts and commands on di®erent devices. Unlike other modalities, sketch-based interaction can be easily fitted according to heterogeneous services. Moreover it can be quickly personalized according to the user needs. Developing a sketch-based interface for a specific service is a time-consuming operation that requires the re-engineering and/or the re-designing of the whole recognizer framework. This paper describes a definitive framework by which the user, simply by using freehand drawing, can define every kind of sketch-based interface. The definition of the interface and its recognition process are performed by using our developed Sketch Modeling Language (SketchML). Copyright 2009 ACM.