Cinematic Gaussians: Real-Time HDR Radiance Fields with Depth of Field
dc.contributor.author | Wang, Chao | en_US |
dc.contributor.author | Wolski, Krzysztof | en_US |
dc.contributor.author | Kerbl, Bernhard | en_US |
dc.contributor.author | Serrano, Ana | en_US |
dc.contributor.author | Bemama, Mojtaba | en_US |
dc.contributor.author | Seidel, Hans-Peter | en_US |
dc.contributor.author | Myszkowski, Karol | en_US |
dc.contributor.author | Leimkühler, Thomas | en_US |
dc.contributor.editor | Chen, Renjie | en_US |
dc.contributor.editor | Ritschel, Tobias | en_US |
dc.contributor.editor | Whiting, Emily | en_US |
dc.date.accessioned | 2024-10-13T18:07:42Z | |
dc.date.available | 2024-10-13T18:07:42Z | |
dc.date.issued | 2024 | |
dc.description.abstract | Radiance field methods represent the state of the art in reconstructing complex scenes from multi-view photos. However, these reconstructions often suffer from one or both of the following limitations: First, they typically represent scenes in low dynamic range (LDR), which restricts their use to evenly lit environments and hinders immersive viewing experiences. Secondly, their reliance on a pinhole camera model, assuming all scene elements are in focus in the input images, presents practical challenges and complicates refocusing during novel-view synthesis. Addressing these limitations, we present a lightweight method based on 3D Gaussian Splatting that utilizes multi-view LDR images of a scene with varying exposure times, apertures, and focus distances as input to reconstruct a high-dynamic-range (HDR) radiance field. By incorporating analytical convolutions of Gaussians based on a thin-lens camera model as well as a tonemapping module, our reconstructions enable the rendering of HDR content with flexible refocusing capabilities. We demonstrate that our combined treatment of HDR and depth of field facilitates real-time cinematic rendering, outperforming the state of the art. | en_US |
dc.description.number | 7 | |
dc.description.sectionheaders | 3D Reconstruction and Novel View Synthesis II | |
dc.description.seriesinformation | Computer Graphics Forum | |
dc.description.volume | 43 | |
dc.identifier.doi | 10.1111/cgf.15214 | |
dc.identifier.issn | 1467-8659 | |
dc.identifier.pages | 13 pages | |
dc.identifier.uri | https://doi.org/10.1111/cgf.15214 | |
dc.identifier.uri | https://diglib.eg.org/handle/10.1111/cgf15214 | |
dc.publisher | The Eurographics Association and John Wiley & Sons Ltd. | en_US |
dc.rights | Attribution 4.0 International License | |
dc.rights.uri | https://creativecommons.org/licenses/by-nc-nd/4.0/ | |
dc.subject | CCS Concepts: Computing methodologies → Computational photography; Image-based rendering | |
dc.subject | Computing methodologies → Computational photography | |
dc.subject | Image | |
dc.subject | based rendering | |
dc.title | Cinematic Gaussians: Real-Time HDR Radiance Fields with Depth of Field | en_US |