In this paper, we present the first implementation of a social robot acting as a companion for individuals eating alone. Our system can engage in multimodal interactions with the user during meals. It conducts conversations on various topics, complemented by gestures and other nonverbal behaviors. The system comprises a NAO robot, human activity recognition modules, a speech recognition module, and a dialog management system integrated with an LLM model. In the paper, we present a technical description of the system and the interaction flow, as well as discuss the possible applications and planned validation.
A Social Robot Companion for Individuals Eating Alone / Soufargi, S.; Niewiadomski, R.; Fong, H.; Mancini, M.. - (2025), pp. 5-8. ( 30th International Conference on Intelligent User Interfaces Companion, IUI 2025 Cagliari, Italy ) [10.1145/3708557.3716340].
A Social Robot Companion for Individuals Eating Alone
Soufargi S.;Mancini M.
2025
Abstract
In this paper, we present the first implementation of a social robot acting as a companion for individuals eating alone. Our system can engage in multimodal interactions with the user during meals. It conducts conversations on various topics, complemented by gestures and other nonverbal behaviors. The system comprises a NAO robot, human activity recognition modules, a speech recognition module, and a dialog management system integrated with an LLM model. In the paper, we present a technical description of the system and the interaction flow, as well as discuss the possible applications and planned validation.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
