This paper addresses the challenge of differentiable rendering, focusing on a novel implementation designed to integrate 3D objects seamlessly into reconstructed 3D environments, thereby creating entirely new perspectives of the scene. Our methodology leverages Neural Radiance Field (NeRF) models to reconstruct the 3D environments with high fidelity, alongside monocular depth estimation algorithms for deriving the 3D characteristics of objects from single images. The main goal of our approach lies in harmonizing the depth map output from the NeRF model with the depth data of the inserted object. This synergy enables the accurate and space-coherent placement of the object within the scene, ensuring a natural integration that enhances the overall realism of the virtual environment.

Enhancing Scene Realism through Neural Radiance Fields and Monocular Depth Estimation / De Magistris, G.; Rodriguez, J. D.; Napoli, C.. - 3684:(2023), pp. 70-76. (Intervento presentato al convegno 8th International Conference of Yearly Reports on Informatics, Mathematics, and Engineering, ICYRIME 2023 tenutosi a Napoli; Italia).

Enhancing Scene Realism through Neural Radiance Fields and Monocular Depth Estimation

De Magistris G.
Primo
Investigation
;
Napoli C.
Ultimo
Supervision
2023

Abstract

This paper addresses the challenge of differentiable rendering, focusing on a novel implementation designed to integrate 3D objects seamlessly into reconstructed 3D environments, thereby creating entirely new perspectives of the scene. Our methodology leverages Neural Radiance Field (NeRF) models to reconstruct the 3D environments with high fidelity, alongside monocular depth estimation algorithms for deriving the 3D characteristics of objects from single images. The main goal of our approach lies in harmonizing the depth map output from the NeRF model with the depth data of the inserted object. This synergy enables the accurate and space-coherent placement of the object within the scene, ensuring a natural integration that enhances the overall realism of the virtual environment.
2023
8th International Conference of Yearly Reports on Informatics, Mathematics, and Engineering, ICYRIME 2023
3D reconstruction; depth map; Differentiable rendering; NeRF model
04 Pubblicazione in atti di convegno::04b Atto di convegno in volume
Enhancing Scene Realism through Neural Radiance Fields and Monocular Depth Estimation / De Magistris, G.; Rodriguez, J. D.; Napoli, C.. - 3684:(2023), pp. 70-76. (Intervento presentato al convegno 8th International Conference of Yearly Reports on Informatics, Mathematics, and Engineering, ICYRIME 2023 tenutosi a Napoli; Italia).
File allegati a questo prodotto
File Dimensione Formato  
Magistris_Enhancing-Scene_2023.pdf

accesso aperto

Note: https://ceur-ws.org/Vol-3684/p11.pdf
Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Creative commons
Dimensione 5.04 MB
Formato Adobe PDF
5.04 MB Adobe PDF

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1714651
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact