High-Performance Image Filters via Sparse Approximations
Loading...
Date
2020
Journal Title
Journal ISSN
Volume Title
Publisher
ACM
Abstract
We present a numerical optimization method to find highly efficient (sparse) approximations for convolutional image filters. Using a modified parallel tempering approach,we solve a constrained optimization that maximizes approximation quality while strictly staying within a user-prescribed performance budget. The results are multi-pass filters where each pass computes a weighted sum of bilinearly interpolated sparse image samples, exploiting hardware acceleration on the GPU. We systematically decompose the target filter into a series of sparse convolutions, trying to find good trade-offs between approximation quality and performance. Since our sparse filters are linear and translation-invariant, they do not exhibit the aliasing and temporal coherence issues that often appear in filters working on image pyramids. We show several applications, ranging from simple Gaussian or box blurs to the emulation of sophisticated Bokeh effects with user-provided masks. Our filters achieve high performance as well as high quality, often providing significant speed-up at acceptable quality even for separable filters. The optimized filters can be baked into shaders and used as a drop-in replacement for filtering tasks in image processing or rendering pipelines.
Description
@inproceedings{10.1145:3406182,
booktitle = {Proceedings of the ACM on Computer Graphics and Interactive Techniques},
editor = {Yuksel, Cem and Membarth, Richard and Zordan, Victor},
title = {{High-Performance Image Filters via Sparse Approximations}},
author = {Schuster, Kersten and Trettner, Philip and Kobbelt, Leif},
year = {2020},
publisher = {ACM},
ISSN = {2577-6193},
ISBN = {},
DOI = {10.1145/3406182}
}