A Sparse Control Model for Image and Video Editing

Li Xu     Qiong Yan     Jiaya Jia

The Chinese Univeristy of Hong Kong

Abstract

It is common that users draw strokes, as control samples, to modify color, structure, or tone of a picture. We discover inherent limitation of existing methods for their implicit requirement on where and how the strokes are drawn, and present a new system that is principled on minimizing the amount of work put in user interaction. Our method automatically determines the influence of edit samples across the whole image jointly considering spatial distance, sample location, and appearance. It greatly reduces the number of samples that are needed, while allowing for a decent level of global and local manipulation of resulting effects and reducing propagation ambiguity. Our method is broadly beneficial to applications adjusting visual content.

Additional Results

• Matting examples

• Selection and editing examples

Related Projects

• Structure Extraction from Texture via Relative Total Variation

• Image Smoothing via L0 Gradient Minimization

• Combining Sketch and Tone for Pencil Drawing Production

Downloads

"A Sparse Control Model for Image and Video Editing" Li Xu, Qiong Yan, Jiaya Jia ACM Trans. Graph. 32(6): 197 (SIGGRAPH Asia 2013)   [Paper (pdf, 9.76MB)] [BibTeX]   [Presentation Slides] coming soon

Last update: Oct. 27, 2013