Human-Robot Interaction (HRI) has grown increasingly important with the integration of various types of robots into industrial and daily life aspects. Non-verbal communication plays a vital role in HRI and heavily relies on gesture recognition. The ability of robot’s interpretation of human gestures is essential for enhancing the overall user experience. To achieve precision and effectiveness of gesture recognition in HRI, the incorporation of Virtual Reality (VR) technology offers promising avenues. In this article, we describe the development of a gesture recognition pipeline tailored to HRI in Precision Agriculture scenarios. Its key feature is the use of Virtual characters and Machine learning techniques to allow agricultural robots to recognize gestures performed by both digital agents and humans. We address challenges by presenting a set of gesture definitions, data generation, and system evaluation using varies combinations of real and virtual simulated data. Our results demonstrate how the adoption of virtual simulations can significantly increase the system’s accuracy and efficiency.
Gesture Recognition for Human-Robot Interaction Through Virtual Characters / Sabbella, S. R.; Kaszuba, S.; Leotta, F.; Nardi, D.. - 14454:(2023), pp. 160-170. (Intervento presentato al convegno 15th International Conference on Social Robotics, ICSR 2023 tenutosi a Doha; Qatar) [10.1007/978-981-99-8718-4_14].
Gesture Recognition for Human-Robot Interaction Through Virtual Characters
Sabbella S. R.Primo
;Kaszuba S.Secondo
;Leotta F.Penultimo
;Nardi D.Ultimo
2023
Abstract
Human-Robot Interaction (HRI) has grown increasingly important with the integration of various types of robots into industrial and daily life aspects. Non-verbal communication plays a vital role in HRI and heavily relies on gesture recognition. The ability of robot’s interpretation of human gestures is essential for enhancing the overall user experience. To achieve precision and effectiveness of gesture recognition in HRI, the incorporation of Virtual Reality (VR) technology offers promising avenues. In this article, we describe the development of a gesture recognition pipeline tailored to HRI in Precision Agriculture scenarios. Its key feature is the use of Virtual characters and Machine learning techniques to allow agricultural robots to recognize gestures performed by both digital agents and humans. We address challenges by presenting a set of gesture definitions, data generation, and system evaluation using varies combinations of real and virtual simulated data. Our results demonstrate how the adoption of virtual simulations can significantly increase the system’s accuracy and efficiency.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.