In this paper, we address the problem of creating an objective benchmark for evaluating SLAM approaches. We propose a framework for analyzing the results of a SLAM approach based on a metric for measuring the error of the corrected trajectory. This metric uses only relative relations between poses and does not rely on a global reference frame. This overcomes serious shortcomings of approaches using a global reference frame to compute the error. Our method furthermore allows us to compare SLAM approaches that use different estimation techniques or different sensor modalities since all computations are made based on the corrected trajectory of the robot. We provide sets of relative relations needed to compute our metric for an extensive set of datasets frequently used in the robotics community. The relations have been obtained by manually matching laser-range observations to avoid the errors caused by matching algorithms. Our benchmark framework allows the user to easily analyze and objectively compare different SLAM approaches.
On measuring the accuracy of SLAM algorithms / Kümmerle, Rainer; Steder, Bastian; Dornhege, Christian; Ruhnke, Michael; Grisetti, Giorgio; Stachniss, Cyrill; Kleiner, Alexander. - In: AUTONOMOUS ROBOTS. - ISSN 0929-5593. - STAMPA. - 27:4(2009), pp. 387-407. [10.1007/s10514-009-9155-6]
On measuring the accuracy of SLAM algorithms
GRISETTI, GIORGIO
;
2009
Abstract
In this paper, we address the problem of creating an objective benchmark for evaluating SLAM approaches. We propose a framework for analyzing the results of a SLAM approach based on a metric for measuring the error of the corrected trajectory. This metric uses only relative relations between poses and does not rely on a global reference frame. This overcomes serious shortcomings of approaches using a global reference frame to compute the error. Our method furthermore allows us to compare SLAM approaches that use different estimation techniques or different sensor modalities since all computations are made based on the corrected trajectory of the robot. We provide sets of relative relations needed to compute our metric for an extensive set of datasets frequently used in the robotics community. The relations have been obtained by manually matching laser-range observations to avoid the errors caused by matching algorithms. Our benchmark framework allows the user to easily analyze and objectively compare different SLAM approaches.File | Dimensione | Formato | |
---|---|---|---|
Kümmerle_Preprint_On-measuring_2009.pdf
accesso aperto
Note: https://link.springer.com/article/10.1007/s10514-009-9155-6
Tipologia:
Documento in Pre-print (manoscritto inviato all'editore, precedente alla peer review)
Licenza:
Tutti i diritti riservati (All rights reserved)
Dimensione
2.28 MB
Formato
Adobe PDF
|
2.28 MB | Adobe PDF | |
Kümmerle_On-measuring_2009.pdf
solo gestori archivio
Tipologia:
Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza:
Tutti i diritti riservati (All rights reserved)
Dimensione
3.2 MB
Formato
Adobe PDF
|
3.2 MB | Adobe PDF | Contatta l'autore |
VE_2009_11573-951040.pdf
solo gestori archivio
Tipologia:
Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza:
Tutti i diritti riservati (All rights reserved)
Dimensione
3.2 MB
Formato
Adobe PDF
|
3.2 MB | Adobe PDF | Contatta l'autore |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.