What is Metrology Part 12: 3D Reconstruction

Share this Article

3D Reconstruction

In our previous article we outlined the basis of most applications within computer vision. It is a vast and large field. It has a lot of intersectionality with 3D technology and the future of 3D printing as well as metrology. The field of 3D imaging in general takes a wide skill set in general and that is exciting. In this article we will talk about a specific realm within 3D metrology and machine vision and computer vision. This realm is known as 3D reconstruction.

3D reconstruction is the process of capturing the shape and appearance of real objects. This process can be accomplished either by active or passive methods. If the model is allowed to change its shape in time, this can be referred to as non-rigid or spatio-temporal reconstruction. Spatio-temporal reconstruction refers to 4D reconstruction as it is adding the 4th element of time into creating an object (x-position, y-position, z-position, and time). 

Spatio-temporal reconstruction of eyelids

2D digital image acquisition is the typical information source of 3D reconstruction. 3D reconstruction is based on multiple images, and it may use only one image in some cases. There are various methods for image acquisition that depend on the occasions and purposes of an application. Visual disparity, illumination, performance of the camera, and the scenario should be considered when attempting to do a 3D reconstruction. 

In terms of metrology, the objects used to measure the 3 dimensional object as a whole include a camera as well as a data interpreter such as a computer. The camera will take 2D images in terms of digital image data. This is referred to as a monocular cue method for data collection. Monocular cues typically include a singular viewport, such as a camera with one lense. Monocular cues methods refer to using one or more images from one viewpoint to create a 3D construction. It makes use of 2D characteristics (e.g. Silhouettes, shading and texture) to measure 3D shape, and that’s why it is also named Shape-From-X, where X can be silhouettes, shading, texture, etc. 3D reconstruction through monocular cues is simple and quick, and usually one digital image so it requires only one camera. Stereo correspondence is a fairly complex problem that this method tries to avoid. 

Correspondence Problem

Stereo correspondence refers to correspondence problem of 3D reconstruction. The correspondence problem refers to the problem of realizing which parts of an image correspond to certain parts of a different image. Differences are due to movement of a camera, time changing, and/or movement of objects in a photo.

When we have two or more images of the same 3D scene, taken from different points of view, the correspondence problem refers to how we find a set of points in one image that are classified as the same points in another image. Points or features in one image are matched with the matching points or features in another image. The images can be taken from a different point of view, at different times, or with objects in the scene in general motion relative to a camera(s). 

This problem of stereo correspondence is most prevalent when multiple devices are used to capture images. If two photographers take an image of a scene, it is nearly impossible to have them sync up their 3D data from the 2D forms that they took. One frame of reference may include an extreme amount of information that does not sync with a frame of reference that may be only a couple meters away. 

A typical application of the correspondence problem is found in panorama creation or image stitching. When two or more images that have a small overlap are stitched into a larger image this problem is apparent. It is necessary to be able to identify a set of corresponding points in a pair of images in order to calculate the transformation of one image to stitch it onto the other image.

In our next article we will be analyzing a particular method within measurement that deals with this problem and the advanced physics behind it.

Share this Article


Recent News

Lubrizol Buys into 3D Printing Parts and Services via Avid Acquisition

NASA Lets You 3D Print Your Own Mars Perseverance Rover



Categories

3D Design

3D Printed Art

3D printed automobiles

3D Printed Food


You May Also Like

Featured

NASA Funds 3D Printing Projects for Upcoming Era of Space Exploration

Driven by Moon exploration, space tourism, spacecraft manufacturing, and orbital infrastructure, space agencies and private companies worldwide have developed ambitious plans for the future of spaceflight. This heightened interest in...

BeeHex Puts 3D Printed Pizza on the Back Burner for Sugr-Bot Bakery

The DIY market is on fire, along with 3D printer sales in international markets like China, as the viral pandemic keeps many at home looking for things to do. Gardening,...

Relativity Secures a New Launch Site in California for 3D Printed Rockets

A new launch site facility at Vandenberg Air Force Base in Southern California will be Relativity Space‘s latest adoption to its growing portfolio of infrastructure partnerships. With this new addition,...

Featured

3D Printing Extreme Environment Technology for Exploring Venus

As a new era of commercialized space flight begins, NASA and private space companies are rushing to colonize the Moon and Mars for space tourism and exploration. Although this follows...


Shop

View our broad assortment of in house and third party products.