This paper presents a solution to this challenge by introducing interactive feedback derived from brain signals to train robots using deep reinforcement learning, particularly in the context of indoor maze navigation. Our objective is to enhance the learning process in a human-robot interaction scenario by incorporating human emotion or attention feedback. To accomplish this, we empowered the robot to learn new tasks through a dynamic policy network based on human feedback, and we augmented this input with other sensor data, including LIDAR. Various experiments are conducted to compare the efficacy of manual feedback, brain signal feedback, and no brain signal feedback, employing diverse Reinforcement Learning models. Additionally, we explore different models for emotion classification, employing Graph Neural Network models and traditional deep learning models, and subsequently compare the outcomes.

Semi-mind controlled robots based on Reinforcement Learning for Indoor Application / Naidji, I.; Tibermacine, A.; Guettala, W.; Tibermacine, I. E.. - 3684:(2023), pp. 51-59. (Intervento presentato al convegno 8th International Conference of Yearly Reports on Informatics, Mathematics, and Engineering, ICYRIME 2023 tenutosi a Naples; Italy).

Semi-mind controlled robots based on Reinforcement Learning for Indoor Application

Tibermacine I. E.
2023

Abstract

This paper presents a solution to this challenge by introducing interactive feedback derived from brain signals to train robots using deep reinforcement learning, particularly in the context of indoor maze navigation. Our objective is to enhance the learning process in a human-robot interaction scenario by incorporating human emotion or attention feedback. To accomplish this, we empowered the robot to learn new tasks through a dynamic policy network based on human feedback, and we augmented this input with other sensor data, including LIDAR. Various experiments are conducted to compare the efficacy of manual feedback, brain signal feedback, and no brain signal feedback, employing diverse Reinforcement Learning models. Additionally, we explore different models for emotion classification, employing Graph Neural Network models and traditional deep learning models, and subsequently compare the outcomes.
2023
8th International Conference of Yearly Reports on Informatics, Mathematics, and Engineering, ICYRIME 2023
Deep Learning; EEG; Graph Neural Networks; Human-Robot Interaction
04 Pubblicazione in atti di convegno::04b Atto di convegno in volume
Semi-mind controlled robots based on Reinforcement Learning for Indoor Application / Naidji, I.; Tibermacine, A.; Guettala, W.; Tibermacine, I. E.. - 3684:(2023), pp. 51-59. (Intervento presentato al convegno 8th International Conference of Yearly Reports on Informatics, Mathematics, and Engineering, ICYRIME 2023 tenutosi a Naples; Italy).
File allegati a questo prodotto
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1715639
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? ND
social impact