PG2017short

Permanent URI for this collection

Now showing 1 - 1 of 1

Transferring Pose and Augmenting Background Variation for Deep Human Image Parsing
(The Eurographics Association, 2017) Kikuchi, Takazumi; Endo, Yuki; Kanamori, Yoshihiro; Hashimoto, Taisuke; Mitani, Jun; Jernej Barbic and Wen-Chieh Lin and Olga Sorkine-Hornung
Human parsing is a fundamental task to estimate semantic parts in a human image such as face, arm, leg, hat, and dress. Recent deep-learning based methods have achieved significant improvements, but collecting training datasets of pixel-wise annotations is labor-intensive. In this paper, we propose two solutions to cope with limited dataset. First, to handle various poses, we incorporate a pose estimation network into an end-to-end human parsing network in order to transfer common features across the domains. The pose estimation network can be trained using rich datasets and feed valuable features to the human parsing network. Second, to handle complicated backgrounds, we increase the variations of background images automatically by replacing the original backgrounds of human images with those obtained from large-scale scenery image datasets. While each of the two solutions is versatile and beneficial to human parsing, their combination yields further improvement.