We consider a novel approach to high-level robot task execution for a robot assistive task. In this work we explore the problem of learning to predict the next subtask by introducing a deep model for both sequencing goals and for visually evaluating the state of a task. We show that deep learning for monitoring robot tasks execution very well supports the interconnection between task-level planning and robot operations. These solutions can also cope with the natural non-determinism of the execution monitor.We show that a deep execution monitor leverages robot performance. We measure the improvement taking into account some robot helping tasks performed at a warehouse.

Deep execution monitor for robot assistive tasks / Mauro, Lorenzo; Alati, Edoardo; Sanzari, Marta; Ntouskos, Valsamis; Gluca, Massimiani; Fiora, Pirri. - 11134:6(2018), pp. 158-175. (Intervento presentato al convegno 15th European Conference on Computer Vision, ECCV 2018 tenutosi a Munich; Germany) [10.1007/978-3-030-11024-6].

Deep execution monitor for robot assistive tasks

MAURO, LORENZO;Edoardo Alati;Marta Sanzari1;Valsamis Ntouskos;Fiora Pirri
2018

Abstract

We consider a novel approach to high-level robot task execution for a robot assistive task. In this work we explore the problem of learning to predict the next subtask by introducing a deep model for both sequencing goals and for visually evaluating the state of a task. We show that deep learning for monitoring robot tasks execution very well supports the interconnection between task-level planning and robot operations. These solutions can also cope with the natural non-determinism of the execution monitor.We show that a deep execution monitor leverages robot performance. We measure the improvement taking into account some robot helping tasks performed at a warehouse.
2018
15th European Conference on Computer Vision, ECCV 2018
Robot Vision; Deep Learning; Robot Visual Search; TAsk PLanning; Execution Monitor
04 Pubblicazione in atti di convegno::04b Atto di convegno in volume
Deep execution monitor for robot assistive tasks / Mauro, Lorenzo; Alati, Edoardo; Sanzari, Marta; Ntouskos, Valsamis; Gluca, Massimiani; Fiora, Pirri. - 11134:6(2018), pp. 158-175. (Intervento presentato al convegno 15th European Conference on Computer Vision, ECCV 2018 tenutosi a Munich; Germany) [10.1007/978-3-030-11024-6].
File allegati a questo prodotto
File Dimensione Formato  
Mauro_Postprint_Deep-execution-monitor_2018.pdf

accesso aperto

Note: https://link.springer.com/chapter/10.1007/978-3-030-11024-6_11
Tipologia: Documento in Post-print (versione successiva alla peer review e accettata per la pubblicazione)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 1.21 MB
Formato Adobe PDF
1.21 MB Adobe PDF
Mauro_Deep-execution-monitor_2018.pdf

solo gestori archivio

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 3.73 MB
Formato Adobe PDF
3.73 MB Adobe PDF   Contatta l'autore

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1264302
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 5
  • ???jsp.display-item.citation.isi??? 2
social impact