Sketch Based Image Deformation

Vision, Modeling and Visualization (VMV) 2007
Mathias Eitz, Olga Sorkine-Hornung, Marc Alexa

Sketch Based Image Deformation

Reshaping a pineapple (left) by sketching the rough outline of the new form. The result of the initial deformation (middle) shows strong distortions. After minimizing the deformation energy, visible distortions are eliminated (right).


We present an image editing tool that allows to deform and composite image regions using an intuitive sketch-based interface. Users simply draw the outline of the source image region and sketch a new boundary shape onto the location where this region is to be pasted. The deformation optimizes a shape distortion energy, and we use Poisson cloning for subsequent compositing. Since the correspondence between the source and target boundary curves is not known a priori, we propose an alternating optimization process that interleaves minimization of the deformation energy w.r.t. the image region interior and the mapping between the boundary curves, thus automatically determining the boundary correspondence and deforming the image at the same time. Thanks to the particular design of the deformation energy, its gradient can be efficiently computed, making the entire image editing framework interactive and convenient for practical use.



We wish to thank Andrew Nealen for fruitful discussions and the anonymous reviewers for their valuable comments. This work was supported in part by the Alexander von Humboldt Foundation.