Microsoft Kinect motion sensor can capture information of different nature and it originated several applications in the field of human-computer interaction. To achieve natural interaction, an application to detect and follow the user’s movements and simultaneously track his voice is proposed when more than one person is in front of the sensor. Using gesture recognition to identify the active speaker, the microphone array is virtually pointed to him through a beamforming technique to follow his movements. Consequently, the user can speak without the necessity of being close to the sensor. Excellent results are obtained regarding accuracy and execution speed.
Real-time Identification and Tracking Using Kinect. Multimodal Interaction and Performance Analysis / Barbato, Marco; Orlandi, Gianni; Panella, Massimo. - STAMPA. - 2:(2014), pp. 1-37.
Real-time Identification and Tracking Using Kinect. Multimodal Interaction and Performance Analysis
BARBATO, MARCO;ORLANDI, Gianni;PANELLA, Massimo
2014
Abstract
Microsoft Kinect motion sensor can capture information of different nature and it originated several applications in the field of human-computer interaction. To achieve natural interaction, an application to detect and follow the user’s movements and simultaneously track his voice is proposed when more than one person is in front of the sensor. Using gesture recognition to identify the active speaker, the microphone array is virtually pointed to him through a beamforming technique to follow his movements. Consequently, the user can speak without the necessity of being close to the sensor. Excellent results are obtained regarding accuracy and execution speed.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.