Pan–tilt–zoom (PTZ) cameras are well suited for object identification and recognition in far-field scenes. However, the effective use of PTZ cameras is complicated by the fact that a continuous online camera calibration is needed and the absolute pan, tilt and zoom values provided by the camera actuators cannot be used because they are not synchronized with the video stream. So, accurate calibration must be directly extracted from the visual content of the frames. Moreover, the large and abrupt scale changes, the scene background changes due to the camera operation and the need of camera motion compensation make target tracking with these cameras extremely challenging. In this paper, we present a solution that provides continuous online calibration of PTZ cameras which is robust to rapid camera motion, changes of the environment due to varying illumination or moving objects. The approach also scales beyond thousands of scene landmarks extracted with the SURF keypoint detector. The method directly derives the relationship between the position of a target in the ground plane and the corresponding scale and position in the image and allows real-time tracking of multiple targets with high and stable degree of accuracy even at far distances and any zoom level.

Continuous localization and mapping of a pan–tilt–zoom camera for wide area tracking / Lisanti, Giuseppe; Masi, Iacopo; Pernici, Federico; DEL BIMBO, Alberto. - In: MACHINE VISION AND APPLICATIONS. - ISSN 0932-8092. - 27:1(2016), pp. 1071-1085. [10.1007/s00138-016-0799-x]

Continuous localization and mapping of a pan–tilt–zoom camera for wide area tracking

MASI, IACOPO;DEL BIMBO, ALBERTO
2016

Abstract

Pan–tilt–zoom (PTZ) cameras are well suited for object identification and recognition in far-field scenes. However, the effective use of PTZ cameras is complicated by the fact that a continuous online camera calibration is needed and the absolute pan, tilt and zoom values provided by the camera actuators cannot be used because they are not synchronized with the video stream. So, accurate calibration must be directly extracted from the visual content of the frames. Moreover, the large and abrupt scale changes, the scene background changes due to the camera operation and the need of camera motion compensation make target tracking with these cameras extremely challenging. In this paper, we present a solution that provides continuous online calibration of PTZ cameras which is robust to rapid camera motion, changes of the environment due to varying illumination or moving objects. The approach also scales beyond thousands of scene landmarks extracted with the SURF keypoint detector. The method directly derives the relationship between the position of a target in the ground plane and the corresponding scale and position in the image and allows real-time tracking of multiple targets with high and stable degree of accuracy even at far distances and any zoom level.
2016
Localization and mapping; Multiple target tracking; PTZ sensor; Rotating and zooming camera; Hardware and Architecture; 1707; Software; Computer Science Applications1707 Computer Vision and Pattern Recognition
01 Pubblicazione su rivista::01a Articolo in rivista
Continuous localization and mapping of a pan–tilt–zoom camera for wide area tracking / Lisanti, Giuseppe; Masi, Iacopo; Pernici, Federico; DEL BIMBO, Alberto. - In: MACHINE VISION AND APPLICATIONS. - ISSN 0932-8092. - 27:1(2016), pp. 1071-1085. [10.1007/s00138-016-0799-x]
File allegati a questo prodotto
File Dimensione Formato  
Lisanti_Continuous-localization_2016.pdf

solo gestori archivio

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 4.6 MB
Formato Adobe PDF
4.6 MB Adobe PDF   Contatta l'autore

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1458905
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 13
  • ???jsp.display-item.citation.isi??? 10
social impact