We propose a formalisation of visual languages which allows a uniform approach to satisfying the needs of pattern recognition, image generation, and visual reasoning faced in visual human-computer communication. Such needs comprise managing the full screen image as seen on the computer display, handling interpretation of icons even when ambiguous, or generating multiple representations to convey one same meaning as required by different users for diverse tasks. We also formalise the way the machine associates a computational meaning with an image (including the whole screen image), and conversely, the way it generates an image on the screen from a computation. A definition of visual sentence as interpreted image is proposed, and the visual language is viewed as a set of visual sentences in a user-computer dialogue. Examples of how the proposed formalism is suitable for ambiguity control and multiple representations of meanings are provided
Most influential paper in the category 20 years / Bottoni, Paolo Gaspare; M. F., Costabile; LEVIALDI GHIRON, Stefano; P., Mussio. - (2014).
Most influential paper in the category 20 years
BOTTONI, Paolo Gaspare;LEVIALDI GHIRON, Stefano;
2014
Abstract
We propose a formalisation of visual languages which allows a uniform approach to satisfying the needs of pattern recognition, image generation, and visual reasoning faced in visual human-computer communication. Such needs comprise managing the full screen image as seen on the computer display, handling interpretation of icons even when ambiguous, or generating multiple representations to convey one same meaning as required by different users for diverse tasks. We also formalise the way the machine associates a computational meaning with an image (including the whole screen image), and conversely, the way it generates an image on the screen from a computation. A definition of visual sentence as interpreted image is proposed, and the visual language is viewed as a set of visual sentences in a user-computer dialogue. Examples of how the proposed formalism is suitable for ambiguity control and multiple representations of meanings are providedI documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.