Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How does Content-Aware fill work?

In the upcoming version of Photoshop there is a feature called Content-Aware fill.

This feature will fill a selection of an image based on the surrounding image - to the point it can generate bushes and clouds while being seamless with the surrounding image.

See http://www.youtube.com/watch?v=NH0aEp1oDOI for a preview of the Photoshop feature I'm talking about.

My question is: How does this feature work algorithmically?

like image 423
CiscoIPPhone Avatar asked Mar 27 '10 18:03

CiscoIPPhone


People also ask

How long does content aware fill take?

Sometimes it's under 60 seconds. Sometimes a render can take a couple of minutes. Upon completion of the render, After Effects will create an additional layer in the layer panel (Figure F), which is placed above your footage layer. This will fill in the missing pixels created by your mask.


1 Answers

I am a co-author of the PatchMatch paper previously mentioned here, and I led the development of the original Content-Aware Fill feature in Photoshop, along with Ivan Cavero Belaunde and Eli Shechtman in the Creative Technologies Lab, and Jeff Chien on the Photoshop team.

Photoshop's Content-Aware Fill uses a highly optimized, multithreaded variation of the algorithm described in the PatchMatch paper, and an older method called "SpaceTime Video Completion." Both papers are cited on the following technology page for this feature:

http://www.adobe.com/technology/projects/content-aware-fill.html

You can find out more about us on the Adobe Research web pages.

like image 131
danbgoldman Avatar answered Oct 13 '22 11:10

danbgoldman