AMS Spring 2023

MIT Media Lab: New Algorithms to Harness Polarized Light for 3D Printing from Smartphones

6K SmarTech

Share this Article

UntitledEverything in life and work is better if you’ve got a smooth rhythm going. But according to MIT, soon it’s going to be all about some serious new moves with algorithms–and polarized light–to help us get our groove on more conveniently with 3D printing–and other technology–in the future.

Inspired by previous works and studies regarding inverse rendering and shape recovery techniques, Polarized 3D: Depth Sensing with Polarization Cues has been authored by Achuta Kadambi, a PhD student in the MIT Media Lab; his thesis advisor, Ramesh Raskar, associate professor of media arts and sciences in the MIT Media Lab; Boxin Shi, who was a postdoctoral student in Raskar’s group and is now a research fellow at the Rapid-Rich Object Search Lab; and Vage Taamazyan, a master’s student at the Skolkovo Institute of Science and Technology in Russia, which MIT helped found in 2011.

The team and their research is taking those previous, inspiring ideas to another level: using a framework of algorithms to harness and polarize light, allowing for 3D imaging that will be better on the exponential level. And much, much easier.

. Polarization enhancement works for varied material conditions. A noisy depth skeleton is used as the depth template and the refinement technique recovers the sphere for all materials

Polarization enhancement regarding varied material conditions.

With the exploitation of light already used in areas such as polarized sunglasses or 3D movie systems, these scientists now see numerous–and undeniably quite futuristic ways–to use this particular science.

While the MIT researchers state that this could even be used in the developing technology for driverless cars, what is most promising today is that it may lead to a user-friendly process for taking a simple photo of an object and then being able to 3D print it with ease due to a new technology for making high resolution cameras that could be integrated into smartphones.

In their paper, recently presented at the International Conference on Computer Vision 2015 in Santiago, Chile, the authors explained how it is possible to start with a coarse depth map and then enhance it through polarized shape and image information. They use the example of the polarization filter used today in 2D technology regarding photography.

“Today, they can miniaturize 3D cameras to fit on cellphones,” says Kadambi. “But they make compromises to the 3D sensing, leading to very coarse recovery of geometry. That’s a natural application for polarization, because you can still use a low-quality sensor, and adding a polarizing filter gives you something that’s better than many machine-shop laser scanners.”

Their work is unique in that the goal is to recover a shape fully in 3D, an action not fully supported by age-old work like Fresnel equations that link surface normals with material and polarimetric properties.

“This is a new tool for 3D sensing and finds use in virtual reality, autonomous navigation, and industrial inspection. In particular, the proposed technique is suited in areas that require precise 3D depth (e.g. 3D scanning),” states the team.

Polarization is centered around bounce. This is why those polarized sunglasses worked so nicely while you were on that fishing trip in Florida–out in that unpolarized sun. As light is bouncing off of objects you are seeing in a polarized fashion, glare is cut and visual resolution is higher. This ‘bounce’ is very important in the process of polarization, and can go from up and down to side to side, depending on the angle.

Various captures, ranging from controlled scenes to complex scenes

Various captures, ranging from controlled scenes to complex scenes

To measure polarization and settle ambiguities regarding this type of light, the researchers used a Microsoft Kinect in attempting to measure depth using reflection time. In a battery of experiments, each time they took three photos of an object, rotating the polarizing filter, and comparing algorithms and the intensity of the light. Their discovery was that while the Kinect can already resolve extremely small details, with polarization information, they could actually resolve features ‘in the range of tens of micrometers, or one-thousandth the size.’

Their technology could also work, feasibly, to improve issues with driverless cars, where vision algorithms stopped working due to weather because the light becomes unpredictably scattered. With these new algorithms, light could be controlled–and scattering eliminated.

“Mitigating scattering in controlled scenes is a small step,” Kadambi says. “But that’s something that I think will be a cool open problem.”

While some of the mechanics used in their original experiment may not be realistic in translation to smartphone camera technology, using a more scalable method would work in terms of grids of tiny polarization filters overlaying individual pixels.

“The work fuses two 3D sensing principles, each having pros and cons,” says Yoav Schechner, an associate professor of electrical engineering at Technion — Israel Institute of Technology in Haifa, Israel. “One principle provides the range for each scene pixel: This is the state of the art of most 3D imaging systems. The second principle does not provide range. On the other hand, it derives the object slope, locally. In other words, per scene pixel, it tells how flat or oblique the object is.”

While the work of the MIT researchers sounds as if it may improve and expand numerous methods, as well as innovative works in progress, it should also offer value in a range of current and more traditional technologies which rely on imaging. Translated to the smartphone, it may truly offer the ability to revolutionize other processes that could be conveniently controlled by apps.

“The work uses each principle to solve problems associated with the other principle,” Schechner explains. “Because this approach practically overcomes ambiguities in polarization-based shape sensing, it can lead to wider adoption of polarization in the toolkit of machine-vision engineers.”

Discuss this story in the Polarized Light 3D Printing forum thread on 3DPB.com.

Untitled

Polarization enhancement works in a range of lighting conditions (real experiment). (a) ToF Kinect, due to multipath, fails to capture an accurate corner. (b) Polarization enhancement indoors. (c) Polarization enhancement under disco lighting. The disco ball casts directional uneven lighting into the corner and introduces caustic effects. (d) Polarization enhancement outdoors on a partly sunny, winter day. (Source: Polarized 3D: Depth Sensing with Polarization Cues)

Share this Article


Recent News

3D Printing News Briefs, December 3, 2022: Degradable Polymers & 3D Printed Trophies

ColdMetalFusion Alliance Announces First Two End-to-End Platforms for Metal 3D Printing



Categories

3D Design

3D Printed Art

3D Printed Food

3D Printed Guns


You May Also Like

Featured

A First-Timer’s “Definitive” Guide to Surviving Formnext

Believe it or not, this year was my very first time attending the additive manufacturing (AM) industry powerhouse event known as formnext, which has been held in Germany for eight...

3D Printing Webinar and Event Roundup: November 27, 2022

Coming off of Thanksgiving in the U.S., we’re still at low mass when it comes to 3D printing webinars and events, but there are still a few offerings this week,...

3D Printing News Briefs, November 23, 2022: ESD-Safe Resin, Edible QR Codes, & More

In today’s 3D Printing News Briefs, AM Solutions has joined the ColdMetalFusion Alliance, AMFG is partnering with French 3D printing service bureau Erpro Group, and AddUp and the WBA are...

3D Printing Financials: voxeljet Q3 Earnings Results Miss on Revenue, Net Loss Widens

Pioneering 3D printer manufacturer voxeljet (NASDAQ: VJET) reported its latest round of earnings last week, missing on revenue and earning expectations. The German company’s revenue was €5.7 million for the...