Facial Performance Capture by Embedded Photo Reflective Sensors on A Smart Eyewear

Asano, Nao; Masai, Katsutoshi; Sugiura, Yuta; Sugimoto, Maki

Facial Performance Capture by Embedded Photo Reflective Sensors on A Smart Eyewear

Files

021-028.pdf (8.5 MB)

output_truth_1.mp4 (57 MB)

Date

2017

Authors

Asano, Nao
Masai, Katsutoshi
Sugiura, Yuta
Sugimoto, Maki

Publisher

The Eurographics Association

Abstract

Facial performance capture is used for animation production that projects a performer's facial expression to a computer graphics model. Retro-reflective markers and cameras are widely used for the performance capture. To capture expressions, we need to place markers on the performer's face and calibrate the intrinsic and extrinsic parameters of cameras in advance. However, the measurable space is limited to the calibrated area. In this paper, we propose a system to capture facial performance using a smart eyewear with photo reflective sensors and machine learning technique.

        @inproceedings{10.2312:egve.20171334
,
booktitle = {ICAT-EGVE 2017 - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments
},
editor = {Robert W. Lindeman and Gerd Bruder and Daisuke Iwai
},
title = {{Facial Performance Capture by Embedded Photo Reflective Sensors on A Smart Eyewear
}},
author = {Asano, Nao and 
Masai, Katsutoshi and 
Sugiura, Yuta and 
Sugimoto, Maki
},
year = {2017
},
publisher = {The Eurographics Association
},
ISSN = {1727-530X
},
ISBN = {978-3-03868-038-3
},
DOI = {10.2312/egve.20171334
}
}