Human-Robot Interaction (HRI) has grown increasingly important with the integration of various types of robots into industrial and daily life aspects. Non-verbal communication plays a vital role in HRI and heavily relies on gesture recognition. The ability of robot’s interpretation of human gestures is essential for enhancing the overall user experience. To achieve precision and effectiveness of gesture recognition in HRI, the incorporation of Virtual Reality (VR) technology offers promising avenues. In this article, we describe the development of a gesture recognition pipeline tailored to HRI in Precision Agriculture scenarios. Its key feature is the use of Virtual characters and Machine learning techniques to allow agricultural robots to recognize gestures performed by both digital agents and humans. We address challenges by presenting a set of gesture definitions, data generation, and system evaluation using varies combinations of real and virtual simulated data. Our results demonstrate how the adoption of virtual simulations can significantly increase the system’s accuracy and efficiency.

Gesture Recognition for Human-Robot Interaction Through Virtual Characters / Sabbella, S. R.; Kaszuba, S.; Leotta, F.; Nardi, D.. - 14454:(2023), pp. 160-170. (Intervento presentato al convegno 15th International Conference on Social Robotics, ICSR 2023 tenutosi a Doha; Qatar) [10.1007/978-981-99-8718-4_14].

Gesture Recognition for Human-Robot Interaction Through Virtual Characters

Sabbella S. R.
Primo
;
Kaszuba S.
Secondo
;
Leotta F.
Penultimo
;
Nardi D.
Ultimo
2023

Abstract

Human-Robot Interaction (HRI) has grown increasingly important with the integration of various types of robots into industrial and daily life aspects. Non-verbal communication plays a vital role in HRI and heavily relies on gesture recognition. The ability of robot’s interpretation of human gestures is essential for enhancing the overall user experience. To achieve precision and effectiveness of gesture recognition in HRI, the incorporation of Virtual Reality (VR) technology offers promising avenues. In this article, we describe the development of a gesture recognition pipeline tailored to HRI in Precision Agriculture scenarios. Its key feature is the use of Virtual characters and Machine learning techniques to allow agricultural robots to recognize gestures performed by both digital agents and humans. We address challenges by presenting a set of gesture definitions, data generation, and system evaluation using varies combinations of real and virtual simulated data. Our results demonstrate how the adoption of virtual simulations can significantly increase the system’s accuracy and efficiency.
2023
15th International Conference on Social Robotics, ICSR 2023
Gesture Recognition; Human-Robot Interaction; Precision Agriculture; Virtual Human Avatars; Virtual Simulations
04 Pubblicazione in atti di convegno::04b Atto di convegno in volume
Gesture Recognition for Human-Robot Interaction Through Virtual Characters / Sabbella, S. R.; Kaszuba, S.; Leotta, F.; Nardi, D.. - 14454:(2023), pp. 160-170. (Intervento presentato al convegno 15th International Conference on Social Robotics, ICSR 2023 tenutosi a Doha; Qatar) [10.1007/978-981-99-8718-4_14].
File allegati a questo prodotto
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1699069
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact