This paper addresses the challenge of differentiable rendering, focusing on a novel implementation designed to integrate 3D objects seamlessly into reconstructed 3D environments, thereby creating entirely new perspectives of the scene. Our methodology leverages Neural Radiance Field (NeRF) models to reconstruct the 3D environments with high fidelity, alongside monocular depth estimation algorithms for deriving the 3D characteristics of objects from single images. The main goal of our approach lies in harmonizing the depth map output from the NeRF model with the depth data of the inserted object. This synergy enables the accurate and space-coherent placement of the object within the scene, ensuring a natural integration that enhances the overall realism of the virtual environment.
Enhancing Scene Realism through Neural Radiance Fields and Monocular Depth Estimation / De Magistris, G.; Rodriguez, J. D.; Napoli, C.. - 3684:(2023), pp. 70-76. (Intervento presentato al convegno 8th International Conference of Yearly Reports on Informatics, Mathematics, and Engineering, ICYRIME 2023 tenutosi a Napoli; Italia).
Enhancing Scene Realism through Neural Radiance Fields and Monocular Depth Estimation
De Magistris G.
Primo
Investigation
;Napoli C.Ultimo
Supervision
2023
Abstract
This paper addresses the challenge of differentiable rendering, focusing on a novel implementation designed to integrate 3D objects seamlessly into reconstructed 3D environments, thereby creating entirely new perspectives of the scene. Our methodology leverages Neural Radiance Field (NeRF) models to reconstruct the 3D environments with high fidelity, alongside monocular depth estimation algorithms for deriving the 3D characteristics of objects from single images. The main goal of our approach lies in harmonizing the depth map output from the NeRF model with the depth data of the inserted object. This synergy enables the accurate and space-coherent placement of the object within the scene, ensuring a natural integration that enhances the overall realism of the virtual environment.File | Dimensione | Formato | |
---|---|---|---|
Magistris_Enhancing-Scene_2023.pdf
accesso aperto
Note: https://ceur-ws.org/Vol-3684/p11.pdf
Tipologia:
Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza:
Creative commons
Dimensione
5.04 MB
Formato
Adobe PDF
|
5.04 MB | Adobe PDF |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.