Differentiable Surface Splatting for Point-based Geometry Processing

publication
ACM SIGGRAPH ASIA 2019
authors
Wang Yifan, , Shihao Wu, Cengiz Öztireli, Olga Sorkine-Hornung

Differentiable Surface Splatting for Point-based Geometry Processing

Using our differentiable point-based renderer, scene content can be optimized to match target rendering. Here, the positions and normals of points are optimized in order to reproduce the reference rendering of the Stanford bunny. It successfully deforms a sphere to a target bunny model, capturing both large scale and fine-scale structures. From left to right are the input points, the results of iteration 18, 57, 198, 300, and the target.

abstract

We propose Differentiable Surface Splatting (DSS), a high-fidelity differentiable renderer for point clouds. Gradients for point locations and normals are carefully designed to handle discontinuities of the rendering function. Regularization terms are introduced to ensure uniform distribution of the points on the underlying surface. We demonstrate applications of DSS to inverse rendering for geometry synthesis and denoising, where large scale topological changes, as well as small scale detail modifications, are accurately and robustly handled without requiring explicit connectivity, outperforming state-of-the-art techniques.

downloads

accompanying video

acknowledgments

We would like to thank Federico Danieli for the insightful discussion, Philipp Herholz for the timely feedack and Romann Weber for the video voice-over. This work was supported in part by gifts from Adobe, Facebook and Snap, Inc.