View-Consistent Virtual Try-on of Glasses using a Hybrid NeRF-Mesh Rendering Approach

Simple item page
dc.contributor.authorRak, Arneen_US
dc.contributor.authorWirth, Tristanen_US
dc.contributor.authorLindemeier, Thomasen_US
dc.contributor.authorKnauthe, Volkeren_US
dc.contributor.authorKuijper, Arjanen_US
dc.contributor.editorHunter, Daviden_US
dc.contributor.editorSlingsby, Aidanen_US
dc.date.accessioned2024-09-09T05:45:07Z
dc.date.available2024-09-09T05:45:07Z
dc.date.issued2024
dc.description.abstractIn recent times, an increasing fraction of global purchases is conducted via the world wide web. For individual accessories, such as glasses, a purchase commonly involves trying on multiple products to fit individual aesthetic preferences. The experience of the try-on process differs greatly between online and offline shopping. While there are real-time methods that facilitate virtual try-on of glasses, they usually project them onto a 2D image. This leads to inconsistent positioning of the glasses model between different views, negatively influencing the shopping experience. We propose a strategy, that enables the virtual try-on of glasses using a Neural Radiance Field as head avatar and a meshed glasses model, leading to consistent positioning of the spectacle frame through multiple views while maintaining real world like visual quality. We contribute an approach for placing and aligning the glasses in relation to the human head in the given NeRF context. Furthermore, we propose a framework for realtime hybrid rendering of meshes and Neural Radiance Fields in the same scene. The proposed method requires training times around one minute and produces a freely explorable 3D model that achieves interactive framerates on end-consumer hardware.en_US
dc.description.sectionheadersComputer Graphics
dc.description.seriesinformationComputer Graphics and Visual Computing (CGVC)
dc.identifier.doi10.2312/cgvc.20241223
dc.identifier.isbn978-3-03868-249-3
dc.identifier.pages5 pages
dc.identifier.urihttps://doi.org/10.2312/cgvc.20241223
dc.identifier.urihttps://diglib.eg.org/handle/10.2312/cgvc20241223
dc.publisherThe Eurographics Associationen_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.titleView-Consistent Virtual Try-on of Glasses using a Hybrid NeRF-Mesh Rendering Approachen_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
cgvc20241223.pdf
Size:
1.15 MB
Format:
Adobe Portable Document Format
Download
Collections
Computer Graphics & Visual Computing (CGVC) 2024