PG2021 Short Papers, Posters, and Work-in-Progress Papers

Permanent URI for this collection

https://diglib.eg.org/handle/10.2312/2633094

Browse

Browsing PG2021 Short Papers, Posters, and Work-in-Progress Papers by Subject "Learning latent representations"

Now showing 1 - 1 of 1
  • Thumbnail Image
    Item
    Human Motion Synthesis and Control via Contextual Manifold Embedding
    (The Eurographics Association, 2021) Zeng, Rui; Dai, Ju; Bai, Junxuan; Pan, Junjun; Qin, Hong; Lee, Sung-Hee and Zollmann, Stefanie and Okabe, Makoto and Wünsche, Burkhard
    Modeling motion dynamics for precise and rapid control by deterministic data-driven models is challenging due to the natural randomness of human motion. To address it, we propose a novel framework for continuous motion control by probabilistic latent variable models. The control is implemented by recurrently querying between historical and target motion states rather than exact motion data. Our model takes a conditional encoder-decoder form in two stages. Firstly, we utilize Gaussian Process Latent Variable Model (GPLVM) to project motion poses to a compact latent manifold. Motion states could be clearly recognized by analyzing on the manifold, such as walking phase and forwarding velocity. Secondly, taking manifold as prior, a Recurrent Neural Network (RNN) encoder makes temporal latent prediction from the previous and control states. An attention module then morphs the prediction by measuring latent similarities to control states and predicted states, thus dynamically preserving contextual consistency. In the end, the GP decoder reconstructs motion states back to motion frames. Experiments on walking datasets show that our model is able to maintain motion states autoregressively while performing rapid and smooth transitions for the control.