Image Inpainting for High-Resolution Textures using CNN Texture Synthesis

Laube, Pascal; Grunwald, Michael; Franz, Matthias O.; Umlauf, Georg

Image Inpainting for High-Resolution Textures using CNN Texture Synthesis

Files

103-107.pdf (5.76 MB)

Date

2018

Authors

Laube, Pascal
Grunwald, Michael
Franz, Matthias O.
Umlauf, Georg

Publisher

The Eurographics Association

Abstract

Deep neural networks have been successfully applied to problems such as image segmentation, image super-resolution, coloration and image inpainting. In this work we propose the use of convolutional neural networks (CNN) for image inpainting of large regions in high-resolution textures. Due to limited computational resources processing high-resolution images with neural networks is still an open problem. Existing methods separate inpainting of global structure and the transfer of details, which leads to blurry results and loss of global coherence in the detail transfer step. Based on advances in texture synthesis using CNNs we propose patch-based image inpainting by a CNN that is able to optimize for global as well as detail texture statistics. Our method is capable of filling large inpainting regions, oftentimes exceeding the quality of comparable methods for high-resolution images. For reference patch look-up we propose to use the same summary statistics that are used in the inpainting process.

        @inproceedings{10.2312:cgvc.20181212
,
booktitle = {Computer Graphics and Visual Computing (CGVC)
},
editor = {{Tam, Gary K. L.  and Vidal, Franck
},
title = {{Image Inpainting for High-Resolution Textures using CNN Texture Synthesis
}},
author = {Laube, Pascal and 
Grunwald, Michael and 
Franz, Matthias O. and 
Umlauf, Georg
},
year = {2018
},
publisher = {The Eurographics Association
},
ISBN = {978-3-03868-071-0
},
DOI = {10.2312/cgvc.20181212
}
}