# A Closed-Form Solution to Natural Image Matting

@article{Levin2008ACS, title={A Closed-Form Solution to Natural Image Matting}, author={Anat Levin and Dani Lischinski and Yair Weiss}, journal={IEEE Transactions on Pattern Analysis and Machine Intelligence}, year={2008}, volume={30}, pages={228-242} }

Interactive digital matting, the process of extracting a foreground object from an image based on limited user input, is an important task in image and video editing. [...] Key Method Current approaches either restrict the estimation to a small part of the image, estimating foreground and background colors based on nearby pixels where they are known, or perform iterative nonlinear estimation by alternating foreground and background color estimation with alpha estimation. In this paper, we present a closed-form… Expand

#### Figures and Topics from this paper

#### 833 Citations

Natural Image and Video Matting

- Computer Science
- International Conference on Computational Intelligence and Multimedia Applications (ICCIMA 2007)
- 2007

This paper presents an object extraction technique which uses global color and local smoothness information to estimate the accurate alpha values and extends the object extraction method to video, where from a single video shot with a moving foreground object and stationary background, the motion statistics, color and contrast cues are combined. Expand

Simultaneous foreground, background, and alpha estimation for image matting

- Computer Science, Mathematics
- 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
- 2010

This work proposes a method of solving for the foreground, background, and alpha of an unknown region in an image simultaneously, which allows for novel constraints to be placed directly on the foreground and background as well as on alpha. Expand

Improvements of Bayesian Matting

- Computer Science
- 2007

This paper shows how a smoothness constraint can be incorporated into Bayesian matting algorithm framework as additional regularization to improve the result quality without affecting the computation speed. Expand

New appearance models for natural image matting

- 2009 IEEE Conference on Computer Vision and Pattern Recognition
- 2009

This paper shows that closed form models for image matting can be an overfit when the colors of the two layers are locally constant, and derives new closed form expressions in such cases, and shows that their models are more compact than existing ones. Expand

A Novel Approach to Video Matting using Optical Flow

- 2009

The image matting problem refers to foreground object extraction from an image. Similarly, video matting problem refers to extraction of a foreground object from each frame of a video-sequence… Expand

A Fast Approach for Natural Image Matting using Structure Information

- Computer Science
- 2007 IEEE International Conference on Multimedia and Expo
- 2007

The approach exploits a simple convolution operation to detect structure information in images and uses two kinds of estimation methods to propagate colors based on the structure types to handle objects with strong structures and large part of interaction region with the background. Expand

Optimized Color Sampling for Robust Matting

- Mathematics, Computer Science
- 2007 IEEE Conference on Computer Vision and Pattern Recognition
- 2007

This work analyzes the weaknesses of previous matting approaches, proposes a new robust matting algorithm, and presents an extensive and quantitative comparison between the algorithm and a number of previous approaches in hopes of providing a benchmark for future matting research. Expand

Targeting Accurate Object Extraction From an Image: A Comprehensive Study of Natural Image Matting

- Computer Science, Medicine
- IEEE Transactions on Neural Networks and Learning Systems
- 2015

A comprehensive survey of the existing image matting algorithms and compared using several metrics to demonstrate the strengths and weaknesses of each method both quantitatively and qualitatively is provided. Expand

Non-parametric natural image matting

- Mathematics, Computer Science
- 2009 16th IEEE International Conference on Image Processing (ICIP)
- 2009

A novel approach which uses non-parametric statistics to model image appearance variations to overcome the limitations of previous parametric approaches which are purely colour-based and thereby unable to model natural image structure. Expand

A Global Sampling Based Image Matting Using Non-Negative Matrix Factorization

- Engineering
- 2017

Image matting is a technique in which a foreground is separated from the background of a given image along with the pixel wise opacity. This foreground can then be seamlessly composited in a… Expand

#### References

SHOWING 1-10 OF 36 REFERENCES

A Closed-Form Solution to Natural Image Matting

- Computer Science
- 2008

A closed-form solution to natural image matting that allows us to find the globally optimal alpha matte by solving a sparse linear system of equations and predicts the properties of the solution by analyzing the eigenvectors of a sparse matrix, closely related to matrices used in spectral image segmentation algorithms. Expand

Bayesian video matting using learnt image priors

- Computer Science
- Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004.
- 2004

A prior is learnt that models the relationship between the spatiotemporal gradients in the image sequence and those in the alpha mattes and is used in combination with a learnt foreground colour model and a prior on the alpha distribution to help regularize the solution and greatly improve the automatic performance of such systems. Expand

An iterative optimization approach for unified image segmentation and matting

- Computer Science
- Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1
- 2005

This paper combines the segmentation and matting problem together and proposes a unified optimization approach based on belief propagation, which is more efficient to extract high quality mattes for foregrounds with significant semitransparent regions. Expand

A Bayesian approach to digital matting

- Mathematics, Computer Science
- Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001
- 2001

This paper proposes a new Bayesian framework for solving the matting problem, i.e. extracting a foreground element from a background image by estimating an opacity for each pixel of the foreground element by using a maximum-likelihood criterion. Expand

RANDOM WALKS FOR INTERACTIVE ALPHA-MATTING

- Computer Science
- 2005

This work proposes a new technique based on random walks that has the following advantages: first, by leveraging a recent technique from manifold learning theory, it effectively use RGB values to set boundaries for the random walker, even in fuzzy or low-contrast images. Expand

Video matting of complex scenes

- Computer Science
- SIGGRAPH
- 2002

A Bayesian matting technique uses the flowed trimaps to yield high-quality mattes of moving foreground elements with complex boundaries filmed by a moving camera, and a novel technique for smoke matte extraction is also demonstrated. Expand

Easy Matting ‐ A Stroke Based Approach for Continuous Image Matting

- Computer Science, Mathematics
- Comput. Graph. Forum
- 2006

This work proposes an iterative energy minimization framework for interactive image matting and demonstrates that the energy‐driven scheme can be extended to video matting, with which the spatio‐temporal smoothness is faithfully preserved. Expand

Colorization using optimization

- Computer Science
- ACM Trans. Graph.
- 2004

This paper presents a simple colorization method that requires neither precise image segmentation, nor accurate region tracking, and demonstrates that high quality colorizations of stills and movie clips may be obtained from a relatively modest amount of user input. Expand

"GrabCut": interactive foreground extraction using iterated graph cuts

- Computer Science
- ACM Trans. Graph.
- 2004

A more powerful, iterative version of the optimisation of the graph-cut approach is developed and the power of the iterative algorithm is used to simplify substantially the user interaction needed for a given quality of result. Expand

Shadow matting and compositing

- Computer Science
- ACM Trans. Graph.
- 2003

This paper develops physically-based shadow matting and compositing equations and uses these to pull a shadow matte from a source scene in which the shadow is cast onto an arbitrary planar background, and builds a shadow displacement map without requiring camera or light source calibration. Expand