The digital world is becoming more and more part of our everyday life. Research groups and industries have been working for years to find innovative and natural interaction ways to improve users’ satisfaction with the approach to the technology. In particular, Human-Computer Interaction (HCI) made a great evolutionary leap with accurate sensors and high-computational devices. Moreover, the miniaturization of circuits made modern systems portable and affordable. Also, advanced algorithmic approaches, e.g., Machine and Deep Learning (ML and DL), strongly support achieving noticeable results at the price of potentially long training times and considerable resource requirements. In this context, we propose a novel system for playing a virtual musical keyboard exploiting an RGB and a dual-Infrared (IR) sensor. It is designed for musicians and enthusiasts for multi-purposes, e.g., training or music production. After a calibration phase, the software can be executed in real-time with responsive feedback. The main focuses of the proposal are the portability and the low-computational resources requirement. Quantitative and qualitative results highlight the system’s overall effectiveness, proving that the proposed pipeline could be promising.

Keyrtual: A Lightweight Virtual Musical Keyboard Based on RGB-D and Sensors Fusion / Avola, D.; Cinque, L.; Marini, M. R.; Princic, A.; Venanzi, V.. - 14185:(2023), pp. 182-191. (Intervento presentato al convegno 20th International Conference on Computer Analysis of Images and Patterns, CAIP 2023 tenutosi a cyp) [10.1007/978-3-031-44240-7_18].

Keyrtual: A Lightweight Virtual Musical Keyboard Based on RGB-D and Sensors Fusion

Avola D.;Cinque L.;Marini M. R.;
2023

Abstract

The digital world is becoming more and more part of our everyday life. Research groups and industries have been working for years to find innovative and natural interaction ways to improve users’ satisfaction with the approach to the technology. In particular, Human-Computer Interaction (HCI) made a great evolutionary leap with accurate sensors and high-computational devices. Moreover, the miniaturization of circuits made modern systems portable and affordable. Also, advanced algorithmic approaches, e.g., Machine and Deep Learning (ML and DL), strongly support achieving noticeable results at the price of potentially long training times and considerable resource requirements. In this context, we propose a novel system for playing a virtual musical keyboard exploiting an RGB and a dual-Infrared (IR) sensor. It is designed for musicians and enthusiasts for multi-purposes, e.g., training or music production. After a calibration phase, the software can be executed in real-time with responsive feedback. The main focuses of the proposal are the portability and the low-computational resources requirement. Quantitative and qualitative results highlight the system’s overall effectiveness, proving that the proposed pipeline could be promising.
2023
20th International Conference on Computer Analysis of Images and Patterns, CAIP 2023
Computer Vision; Hand gesture; Hand tracking; Human-Computer Interaction; Virtual musical instrument
04 Pubblicazione in atti di convegno::04b Atto di convegno in volume
Keyrtual: A Lightweight Virtual Musical Keyboard Based on RGB-D and Sensors Fusion / Avola, D.; Cinque, L.; Marini, M. R.; Princic, A.; Venanzi, V.. - 14185:(2023), pp. 182-191. (Intervento presentato al convegno 20th International Conference on Computer Analysis of Images and Patterns, CAIP 2023 tenutosi a cyp) [10.1007/978-3-031-44240-7_18].
File allegati a questo prodotto
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1696641
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact