ZooBuilder: 2D and 3D Pose Estimation for Quadrupeds Using Synthetic Data
Loading...
Date
2020
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
This work introduces a novel strategy for generating synthetic training data for 2D and 3D pose estimation of animals using keyframe animations. With the objective to automate the process of creating animations for wildlife, we train several 2D and 3D pose estimation models with synthetic data, and put in place an end-to-end pipeline called ZooBuilder. The pipeline takes as input a video of an animal in the wild, and generates the corresponding 2D and 3D coordinates for each joint of the animal's skeleton. With this approach, we produce motion capture data that can be used to create animations for wildlife.
Description
@inproceedings{10.2312:sca.20201217,
booktitle = {Eurographics/ ACM SIGGRAPH Symposium on Computer Animation - Showcases},
editor = {Holden, Daniel},
title = {{ZooBuilder: 2D and 3D Pose Estimation for Quadrupeds Using Synthetic Data}},
author = {Fangbemi, Abassin Sourou and Lu, Yi Fei and Xu, Maoyuan and Luo, Xiaowu and Rolland, Alexis and Raissi, Chedy},
year = {2020},
publisher = {The Eurographics Association},
ISSN = {1727-5288},
ISBN = {978-3-03868-129-8},
DOI = {10.2312/sca.20201217}
}