A Bag of Tricks for Efficient Implicit Neural Point Clouds

Loading...
Thumbnail Image
Date
2025
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Implicit Neural Point Cloud (INPC) is a recent hybrid representation that combines the expressiveness of neural fields with the efficiency of point-based rendering, achieving state-of-the-art image quality in novel view synthesis. However, as with other high-quality approaches that query neural networks during rendering, the practical usability of INPC is limited by comparatively slow rendering. In this work, we present a collection of optimizations that significantly improve both the training and inference performance of INPC without sacrificing visual fidelity. The most significant modifications are an improved rasterizer implementation, more effective sampling techniques, and the incorporation of pre-training for the convolutional neural network used for hole-filling. Furthermore, we demonstrate that points can be modeled as small Gaussians during inference to further improve quality in extrapolated, e.g., close-up views of the scene. We design our implementations to be broadly applicable beyond INPC and systematically evaluate each modification in a series of experiments. Our optimized INPC pipeline achieves up to 25% faster training, 2× faster rendering, and 20% reduced VRAM usage paired with slight image quality improvements.
Description

CCS Concepts: Computing methodologies → Image-based rendering; Rasterization; Point-based models

        
@inproceedings{
10.2312:vmv.20251229
, booktitle = {
Vision, Modeling, and Visualization
}, editor = {
Egger, Bernhard
and
Günther, Tobias
}, title = {{
A Bag of Tricks for Efficient Implicit Neural Point Clouds
}}, author = {
Hahlbohm, Florian
and
Franke, Linus
and
Overkämping, Leon
and
Wespe, Paula
and
Castillo, Susana
and
Eisemann, Martin
and
Magnor, Marcus
}, year = {
2025
}, publisher = {
The Eurographics Association
}, ISBN = {
978-3-03868-294-3
}, DOI = {
10.2312/vmv.20251229
} }
Citation
Collections