Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Generating point cloud from many 2d images

From my, somewhat limited, understanding of how point clouds work I feel that one should be able to generate a point cloud from a set of 2d images from around the outside of an object. The problem that I am experiencing is that I can not seem to find any examples of how to generate such a point cloud.

like image 303
gilbertbw Avatar asked Dec 01 '13 16:12

gilbertbw


People also ask

Can you create point cloud from photos?

This technique uses overlapping photographs to derive the three-dimensional structure of the landscape and objects on it, producing a 3D point cloud. The resulting point cloud is sometimes referred to as PhoDar or Fodar because it can generate a similar point cloud to traditional Lidar data collection.

Is LiDAR a point cloud?

Point clouds are sets of points that describe an object or surface. To create a point cloud, laser scanning technology like LiDAR can be used. Each point contains an ample amount of data that can be integrated with other data sources or used to create 3D models.

What is the difference between point cloud and mesh?

First, a point cloud is created from photographs; then, a mesh model is made up of meshes whose vertices are the refinement points of this point cloud [2]. Because of this, a photograph-based point cloud has a higher resolution with more input images [3], which is already well-known.


2 Answers

In general, 3D shaped reconstruction from a sequence of 2D images is a hard problem. It can range from difficult to extremely difficult, depending on the amount of information that is known about the camera and it's relationship to the object and scene. There is a lot of information out there: try googling for "3D reconstruction image sequence" or "3D image reconstruction turn table". Here is one paper that gives a pretty good summary of the process and its challenges. This paper is good (and it introduces "RANSAC" - another good search keyword). This link frames the problem in terms of facial reconstruction, but the theory can be applied to this question.

Note that the interpretation of the 3D points is dependent upon knowledge of the camera's extrinsic and intrinsic parameters. Extrinsic parameters specify the location and orientation of the camera with respect to the world. Intrinsic parameters map pixel coordinates to coordinates in the world frame.

When neither the extrinsic nor intrinsic parameters are known, the 3D reconstruction is accurate to an unknown scale factor (i.e. relative size/distance can be established, but absolute size/distance is not known). When both sets of camera parameters are known, the scale, orientation, and location of the 3D points are known. The OpenCV documentation covers the concept of camera calibration well. This link, this link, and this link are good, too.

like image 190
Throwback1986 Avatar answered Nov 09 '22 22:11

Throwback1986


VisualSFM is an application that allows 3D reconstruction. You can get a point cloud from multiple 2D images.

This video shows how to extract multiple images from a short clip of a tree and then use VisualSFM to create a point cloud.

like image 32
Ben Avatar answered Nov 09 '22 23:11

Ben