MIT Media Lab: New Algorithms to Harness Polarized Light for 3D Printing from Smartphones

Share this Article

UntitledEverything in life and work is better if you’ve got a smooth rhythm going. But according to MIT, soon it’s going to be all about some serious new moves with algorithms–and polarized light–to help us get our groove on more conveniently with 3D printing–and other technology–in the future.

Inspired by previous works and studies regarding inverse rendering and shape recovery techniques, Polarized 3D: Depth Sensing with Polarization Cues has been authored by Achuta Kadambi, a PhD student in the MIT Media Lab; his thesis advisor, Ramesh Raskar, associate professor of media arts and sciences in the MIT Media Lab; Boxin Shi, who was a postdoctoral student in Raskar’s group and is now a research fellow at the Rapid-Rich Object Search Lab; and Vage Taamazyan, a master’s student at the Skolkovo Institute of Science and Technology in Russia, which MIT helped found in 2011.

The team and their research is taking those previous, inspiring ideas to another level: using a framework of algorithms to harness and polarize light, allowing for 3D imaging that will be better on the exponential level. And much, much easier.

. Polarization enhancement works for varied material conditions. A noisy depth skeleton is used as the depth template and the refinement technique recovers the sphere for all materials

Polarization enhancement regarding varied material conditions.

With the exploitation of light already used in areas such as polarized sunglasses or 3D movie systems, these scientists now see numerous–and undeniably quite futuristic ways–to use this particular science.

While the MIT researchers state that this could even be used in the developing technology for driverless cars, what is most promising today is that it may lead to a user-friendly process for taking a simple photo of an object and then being able to 3D print it with ease due to a new technology for making high resolution cameras that could be integrated into smartphones.

In their paper, recently presented at the International Conference on Computer Vision 2015 in Santiago, Chile, the authors explained how it is possible to start with a coarse depth map and then enhance it through polarized shape and image information. They use the example of the polarization filter used today in 2D technology regarding photography.

“Today, they can miniaturize 3D cameras to fit on cellphones,” says Kadambi. “But they make compromises to the 3D sensing, leading to very coarse recovery of geometry. That’s a natural application for polarization, because you can still use a low-quality sensor, and adding a polarizing filter gives you something that’s better than many machine-shop laser scanners.”

Their work is unique in that the goal is to recover a shape fully in 3D, an action not fully supported by age-old work like Fresnel equations that link surface normals with material and polarimetric properties.

“This is a new tool for 3D sensing and finds use in virtual reality, autonomous navigation, and industrial inspection. In particular, the proposed technique is suited in areas that require precise 3D depth (e.g. 3D scanning),” states the team.

Polarization is centered around bounce. This is why those polarized sunglasses worked so nicely while you were on that fishing trip in Florida–out in that unpolarized sun. As light is bouncing off of objects you are seeing in a polarized fashion, glare is cut and visual resolution is higher. This ‘bounce’ is very important in the process of polarization, and can go from up and down to side to side, depending on the angle.

Various captures, ranging from controlled scenes to complex scenes

Various captures, ranging from controlled scenes to complex scenes

To measure polarization and settle ambiguities regarding this type of light, the researchers used a Microsoft Kinect in attempting to measure depth using reflection time. In a battery of experiments, each time they took three photos of an object, rotating the polarizing filter, and comparing algorithms and the intensity of the light. Their discovery was that while the Kinect can already resolve extremely small details, with polarization information, they could actually resolve features ‘in the range of tens of micrometers, or one-thousandth the size.’

Their technology could also work, feasibly, to improve issues with driverless cars, where vision algorithms stopped working due to weather because the light becomes unpredictably scattered. With these new algorithms, light could be controlled–and scattering eliminated.

“Mitigating scattering in controlled scenes is a small step,” Kadambi says. “But that’s something that I think will be a cool open problem.”

While some of the mechanics used in their original experiment may not be realistic in translation to smartphone camera technology, using a more scalable method would work in terms of grids of tiny polarization filters overlaying individual pixels.

“The work fuses two 3D sensing principles, each having pros and cons,” says Yoav Schechner, an associate professor of electrical engineering at Technion — Israel Institute of Technology in Haifa, Israel. “One principle provides the range for each scene pixel: This is the state of the art of most 3D imaging systems. The second principle does not provide range. On the other hand, it derives the object slope, locally. In other words, per scene pixel, it tells how flat or oblique the object is.”

While the work of the MIT researchers sounds as if it may improve and expand numerous methods, as well as innovative works in progress, it should also offer value in a range of current and more traditional technologies which rely on imaging. Translated to the smartphone, it may truly offer the ability to revolutionize other processes that could be conveniently controlled by apps.

“The work uses each principle to solve problems associated with the other principle,” Schechner explains. “Because this approach practically overcomes ambiguities in polarization-based shape sensing, it can lead to wider adoption of polarization in the toolkit of machine-vision engineers.”

Discuss this story in the Polarized Light 3D Printing forum thread on


Polarization enhancement works in a range of lighting conditions (real experiment). (a) ToF Kinect, due to multipath, fails to capture an accurate corner. (b) Polarization enhancement indoors. (c) Polarization enhancement under disco lighting. The disco ball casts directional uneven lighting into the corner and introduces caustic effects. (d) Polarization enhancement outdoors on a partly sunny, winter day. (Source: Polarized 3D: Depth Sensing with Polarization Cues)

Share this Article

Recent News

Equispheres Receives $8 Million from SDTC to Scale Metal 3D Printing Powder Production

3D Printed Diagnostics: Smartphone Attachments & Software for Detecting Parasitic Infections


3D Design

3D Printed Art

3D Printed Food

3D Printed Guns

You May Also Like

3D Printing News Briefs: March 23, 2018

We’re starting off with some major medical news in today’s 3D Printing News Briefs – Materialise is the first company in the world to receive FDA clearance for 3D printed...

Get Ready, Makers: OtterBox Has Released CAD Designs for 3D Printable uniVERSE Case System Accessory Mount

The same day I purchased my very first iPhone several years ago, I also bought a light purple OtterBox case for it, having been told by all of my other...

Researchers Use Inkjet 3D Printing to Create Fast, Accurate, Inexpensive Diagnostic Tool

From whirligigs and models to printers and smart bathrooms, 3D printing technology has definitely made an impact on diagnostics. Healthcare workers use diagnostic tools to detect and determine the severity...

3D Printed MRI-Compatible Biopsy Robot Works to Diagnose Breast Cancer

I first truly became aware of 3D technology sometime in 2010 or 2011, when I went to the mall with my co-worker during our lunch break to grab a chili...


View our broad assortment of in house and third party products.

Services & Data

Subscribe To Our Newsletter

Subscribe To Our Newsletter

Join our mailing list to receive the latest news and updates from our

You have Successfully Subscribed!