Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

What's the best depth map generation algorithm?

I'm into a 2D-to-3D application project and I'm looking for a method to produce the depth map of a single input image, without other external informations. I know that's a sort of "artificial intelligence" mattern but maybe an efficient algorythm exists.

At the moment I've found this one: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.109.7959&rep=rep1&type=pdf but I'm wondering if there is a better method, before start implementing. Suggestions? Thanks!

like image 878
TheUnexpected Avatar asked Oct 30 '11 12:10

TheUnexpected


People also ask

How are depth maps generated?

Depth maps can be generated by 3D scanners or reconstructed from multiple images. In Machine vision and computer vision, to allow 3D images to be processed by 2D image tools.

What is depth map in image processing?

Depth maps are a representation of the distance from the camera to the subject for each pixel in an image. They have various applications, including the familiar smartphone camera function that blurs distant background images when taking a picture and detecting nearby objects for self-driving vehicles.

What is depth map fusion?

Depthmap fusion is a standard approach for generating accurate and robust 3D scene representations using structure from motion pipelines.

What is a depth map Photoshop?

A depth map is a grayscale image that describes the distance between various objects in the scene and the camera lens. If we create this image such that far away objects are bright and near objects are dark, then we can use that information to blur the photo- graph and simulate a narrow depth of field.


1 Answers

I've written quite a few automatic depth map generators. I don't think there's one that's better than all others in all cases. It all depends on the stereo pair you're starting with. I personally think a depth map generator based on local method (window or block based) with an edge preserving smoother is probably the best all-around depth map generator.

In any case, on this page:

depth map generation software

you can find depth map generator software based on optical flow, weight-based windows, graph cuts, and many other things that relate to depth map generation and lenticular creation. The best part is that it's all free.

For 2d to 3d conversion (which is more what you are asking), there's a piece of software called DMAG4 that uses a scarsely populated depth map (typically, done in Gimp with the paint brush) to indicate the main depths and then fills the unfilled areas using interpolation while maintaining the edges of the objects (edge-preserving).

DMAG4 can be found here (it's free to use):

2d to 3d conversion software DMAG4

Another way to 2d to 3d conversion is to use a sculpting program like Gimpel3d or Blender, both free. Clearly, this goes beyond depth map since you're essentially creating a 3d scene in which you can then move around (using the camera movement in Blender). This is often referred to as "camera mapping".

like image 157
ugocapeto Avatar answered Sep 24 '22 13:09

ugocapeto