Physically Based Video Editing

dc.contributor.authorBazin, Jean-Charlesen_US
dc.contributor.authorPlüss (Kuster), Claudiaen_US
dc.contributor.authorYu, Guoen_US
dc.contributor.authorMartin, Tobiasen_US
dc.contributor.authorJacobson, Alecen_US
dc.contributor.authorGross, Markusen_US
dc.contributor.editorEitan Grinspun and Bernd Bickel and Yoshinori Dobashien_US
dc.date.accessioned2016-10-11T05:20:49Z
dc.date.available2016-10-11T05:20:49Z
dc.date.issued2016
dc.description.abstractConvincing manipulation of objects in live action videos is a difficult and often tedious task. Skilled video editors achieve this with the help of modern professional tools, but complex motions might still lack physical realism since existing tools do not consider the laws of physics. On the other hand, physically based simulation promises a high degree of realism, but typically creates a virtual 3D scene animation rather than returning an edited version of an input live action video. We propose a framework that combines video editing and physics-based simulation. Our tool assists unskilled users in editing an input image or video while respecting the laws of physics and also leveraging the image content. We first fit a physically based simulation that approximates the object's motion in the input video. We then allow the user to edit the physical parameters of the object, generating a new physical behavior for it. The core of our work is the formulation of an image-aware constraint within physics simulations. This constraint manifests as external control forces to guide the object in a way that encourages proper texturing at every frame, yet producing physically plausible motions. We demonstrate the generality of our method on a variety of physical interactions: rigid motion, multi-body collisions, clothes and elastic bodies.en_US
dc.description.number7
dc.description.sectionheadersImages and Video
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume35
dc.identifier.doi10.1111/cgf.13039
dc.identifier.issn1467-8659
dc.identifier.pages421-429
dc.identifier.urihttps://doi.org/10.1111/cgf.13039
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf13039
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectI.3.3 [Computer Graphics]
dc.subjectPicture/Image Generation
dc.subjectLine and curve generation
dc.titlePhysically Based Video Editingen_US
Files
Collections