RodMesh: Two-handed 3D Surface Modeling in Virtual Reality

Symposium on Vision, Modeling and Visualization (VMV) 2019
Floor Verhoeven, Olga Sorkine-Hornung

RodMesh: Two-handed 3D Surface Modeling in Virtual Reality

Manifold mesh models created using RodMesh on Oculus Rift, with and without the deformable control rods visualized. Users cadefine and manipulate these control rods to edit the mesh surface.


User interfaces for 3D shape modeling in Virtual Reality (VR), unlike basic tasks such as text input and item selection, have been less explored in research so far. Shape modeling in 3D lends itself very well to VR, since the 3D immersion provides the user with richer spatial feedback and depth perception when compared to traditional 2D displays. That said, currently existing 3D modeling applications do not focus on optimizing the modeling interaction techniques for VR, but instead mostly merely port standard interaction paradigms. Our approach utilizes a popular sketch-based surface modeling algorithm in VR by rethinking the user interface in order to benefit from the 3D immersive environment and its inherent support of two-handed input. We propose a bimanual interaction technique that allows users to create 3D models via virtual deformable rods. These rods are bendable into outline shapes that are automatically inflated into manifold mesh surfaces, and can then be incrementally edited to further refine the shape.


accompanying video


This work was supported in part by gifts from Snap, Inc. and Facebook. We would like to thank the participants of our user study for their useful suggestions, the anonymous reviewers for their valuable feedback, Kaan Baki for helping with the video creation and Alexandra Ion and Katja Wolff for their insightful feedback on drafts of this paper.