In this paper, we address the problem of creating an objective benchmark for evaluating SLAM approaches. We propose a framework for analyzing the results of a SLAM approach based on a metric for measuring the error of the corrected trajectory. This metric uses only relative relations between poses and does not rely on a global reference frame. This overcomes serious shortcomings of approaches using a global reference frame to compute the error. Our method furthermore allows us to compare SLAM approaches that use different estimation techniques or different sensor modalities since all computations are made based on the corrected trajectory of the robot. We provide sets of relative relations needed to compute our metric for an extensive set of datasets frequently used in the robotics community. The relations have been obtained by manually matching laser-range observations to avoid the errors caused by matching algorithms. Our benchmark framework allows the user to easily analyze and objectively compare different SLAM approaches.

On measuring the accuracy of SLAM algorithms / Kümmerle, Rainer; Steder, Bastian; Dornhege, Christian; Ruhnke, Michael; Grisetti, Giorgio; Stachniss, Cyrill; Kleiner, Alexander. - In: AUTONOMOUS ROBOTS. - ISSN 0929-5593. - STAMPA. - 27:4(2009), pp. 387-407. [10.1007/s10514-009-9155-6]

On measuring the accuracy of SLAM algorithms

GRISETTI, GIORGIO
;
2009

Abstract

In this paper, we address the problem of creating an objective benchmark for evaluating SLAM approaches. We propose a framework for analyzing the results of a SLAM approach based on a metric for measuring the error of the corrected trajectory. This metric uses only relative relations between poses and does not rely on a global reference frame. This overcomes serious shortcomings of approaches using a global reference frame to compute the error. Our method furthermore allows us to compare SLAM approaches that use different estimation techniques or different sensor modalities since all computations are made based on the corrected trajectory of the robot. We provide sets of relative relations needed to compute our metric for an extensive set of datasets frequently used in the robotics community. The relations have been obtained by manually matching laser-range observations to avoid the errors caused by matching algorithms. Our benchmark framework allows the user to easily analyze and objectively compare different SLAM approaches.
2009
Benchmarking; Mapping accuracy; SLAM; Artificial Intelligence
01 Pubblicazione su rivista::01a Articolo in rivista
On measuring the accuracy of SLAM algorithms / Kümmerle, Rainer; Steder, Bastian; Dornhege, Christian; Ruhnke, Michael; Grisetti, Giorgio; Stachniss, Cyrill; Kleiner, Alexander. - In: AUTONOMOUS ROBOTS. - ISSN 0929-5593. - STAMPA. - 27:4(2009), pp. 387-407. [10.1007/s10514-009-9155-6]
File allegati a questo prodotto
File Dimensione Formato  
Kümmerle_Preprint_On-measuring_2009.pdf

accesso aperto

Note: https://link.springer.com/article/10.1007/s10514-009-9155-6
Tipologia: Documento in Pre-print (manoscritto inviato all'editore, precedente alla peer review)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 2.28 MB
Formato Adobe PDF
2.28 MB Adobe PDF
Kümmerle_On-measuring_2009.pdf

solo gestori archivio

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 3.2 MB
Formato Adobe PDF
3.2 MB Adobe PDF   Contatta l'autore
VE_2009_11573-951040.pdf

solo gestori archivio

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 3.2 MB
Formato Adobe PDF
3.2 MB Adobe PDF   Contatta l'autore

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/951040
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 271
  • ???jsp.display-item.citation.isi??? 217
social impact