Video-Driven Animation of Neural Head Avatars

dc.contributor.authorPaier, Wolfgangen_US
dc.contributor.authorHinzer, Paulen_US
dc.contributor.authorHilsmann, Annaen_US
dc.contributor.authorEisert, Peteren_US
dc.contributor.editorGuthe, Michaelen_US
dc.contributor.editorGrosch, Thorstenen_US
dc.date.accessioned2023-09-25T11:38:50Z
dc.date.available2023-09-25T11:38:50Z
dc.date.issued2023
dc.description.abstractWe present a new approach for video-driven animation of high-quality neural 3D head models, addressing the challenge of person-independent animation from video input. Typically, high-quality generative models are learned for specific individuals from multi-view video footage, resulting in person-specific latent representations that drive the generation process. In order to achieve person-independent animation from video input, we introduce an LSTM-based animation network capable of translating person-independent expression features into personalized animation parameters of person-specific 3D head models. Our approach combines the advantages of personalized head models (high quality and realism) with the convenience of video-driven animation employing multi-person facial performance capture.We demonstrate the effectiveness of our approach on synthesized animations with high quality based on different source videos as well as an ablation study.en_US
dc.description.sectionheadersImage Processing
dc.description.seriesinformationVision, Modeling, and Visualization
dc.identifier.doi10.2312/vmv.20231237
dc.identifier.isbn978-3-03868-232-5
dc.identifier.pages149-156
dc.identifier.pages8 pages
dc.identifier.urihttps://doi.org/10.2312/vmv.20231237
dc.identifier.urihttps://diglib.eg.org:443/handle/10.2312/vmv20231237
dc.publisherThe Eurographics Associationen_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectCCS Concepts: Computing methodologies -> Machine learning; Computer graphics; Animation; Rendering
dc.subjectComputing methodologies
dc.subjectMachine learning
dc.subjectComputer graphics
dc.subjectAnimation
dc.subjectRendering
dc.titleVideo-Driven Animation of Neural Head Avatarsen_US
Files
Original bundle
Now showing 1 - 2 of 2
Loading...
Thumbnail Image
Name:
149-156.pdf
Size:
2.31 MB
Format:
Adobe Portable Document Format
No Thumbnail Available
Name:
paper1046_mm.mp4
Size:
35.34 MB
Format:
Unknown data format
Collections