VideoMat: Extracting PBR Materials from Video Diffusion Models
| dc.contributor.author | Munkberg, Jacob | en_US |
| dc.contributor.author | Wang, Zian | en_US |
| dc.contributor.author | Liang, Ruofan | en_US |
| dc.contributor.author | Shen, Tianchang | en_US |
| dc.contributor.author | Hasselgren, Jon | en_US |
| dc.contributor.editor | Wang, Beibei | en_US |
| dc.contributor.editor | Wilkie, Alexander | en_US |
| dc.date.accessioned | 2025-06-20T07:55:34Z | |
| dc.date.available | 2025-06-20T07:55:34Z | |
| dc.date.issued | 2025 | |
| dc.description.abstract | We leverage finetuned video diffusion models, intrinsic decomposition of videos, and physically-based differentiable rendering to generate high quality materials for 3D models given a text prompt or a single image. We condition a video diffusion model to respect the input geometry and lighting condition. This model produces multiple views of a given 3D model with coherent material properties. Secondly, we use a recent model to extract intrinsics (base color, roughness, metallic) from the generated video. Finally, we use the intrinsics alongside the generated video in a differentiable path tracer to robustly extract PBR materials directly compatible with common content creation tools. | en_US |
| dc.description.number | 4 | |
| dc.description.sectionheaders | Appearance Modelling | |
| dc.description.seriesinformation | Computer Graphics Forum | |
| dc.description.volume | 44 | |
| dc.identifier.doi | 10.1111/cgf.70180 | |
| dc.identifier.issn | 1467-8659 | |
| dc.identifier.pages | 10 pages | |
| dc.identifier.uri | https://doi.org/10.1111/cgf.70180 | |
| dc.identifier.uri | https://diglib.eg.org/handle/10.1111/cgf70180 | |
| dc.publisher | The Eurographics Association and John Wiley & Sons Ltd. | en_US |
| dc.rights | Attribution 4.0 International License | |
| dc.rights.uri | https://creativecommons.org/licenses/by/4.0/ | |
| dc.subject | CCS Concepts: Computing methodologies → Appearance and texture representations; Ray tracing; Reflectance modeling | |
| dc.subject | Computing methodologies → Appearance and texture representations | |
| dc.subject | Ray tracing | |
| dc.subject | Reflectance modeling | |
| dc.title | VideoMat: Extracting PBR Materials from Video Diffusion Models | en_US |