Real-Time Capture, Reconstruction and Insertion into Virtual World of Human Actors

dc.contributor.authorHasenfratz, J.M.en_US
dc.contributor.authorLapierre, M.en_US
dc.contributor.authorGascuel, J.-D.en_US
dc.contributor.authorBoyer, E.en_US
dc.contributor.editorPeter Hall and Philip Willisen_US
dc.description.abstractIn this paper, we show how to capture an actor with no intrusive trackers and without any special environment like blue set, how to estimate its 3D-geometry and how to insert this geometry into a virtual world in real-time. We use several cameras in conjunction with background subtraction to produce silhouettes of the actor as observed from the different camera viewpoints. These silhouettes allow the 3D-geometry of the actor to be estimated by a voxel based method. This geometry is rendered with a marching cube algorithm and inserted into a virtual world. Shadows of the actor corresponding to virtual lights are then added and interactions with objects of the virtual world are proposed. The main originality of this paper is to propose a complete pipeline that can computes up to 30 frames per second. Since the rapidity of the process depends mainly on its slowest step, we present here all these steps. For each of them, we present and discuss the solution that is used. Some of them are new solutions, as the 3D shape estimation which is achieved using graphics hardware. Results are presented and discussed.en_US
dc.description.sectionheadersPoster Session 1en_US
dc.description.seriesinformationVision, Video, and Graphics (VVG) 2003en_US
dc.identifier.pagesJ.M. Hasenfratz, M. Lapierre, J.-D. Gascuel and E. Boyer-I.3.3 [Computer Graphics]: Picture/Image Generation - Bitmap and framebuffer operations I.3.7 [Computer Graphics]: Three-Dimensional Graphics and Realism - Virtual reality I.4.1 [Image Processing and Computer Vision]: Scene Analysis - Trackingen_US
dc.publisherThe Eurographics Associationen_US
dc.subjectI.3.3 [Computer Graphics]en_US
dc.subjectPicture/Image Generationen_US
dc.subjectBitmap and framebuffer operationsen_US
dc.subjectI.3.7 [Computer Graphics]en_US
dc.subjectThree Dimensional Graphics and Realismen_US
dc.subjectVirtual realityen_US
dc.subjectI.4.1 [Image Processing and Computer Vision]en_US
dc.subjectScene Analysisen_US
dc.titleReal-Time Capture, Reconstruction and Insertion into Virtual World of Human Actorsen_US
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
3.99 MB
Adobe Portable Document Format