MIT CSAIL Creates 3D Printable Sculptures of the Body in Motion

Share this Article

[Image: MIT CSAIL]

MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) is responsible for numerous fascinating innovations, many of them related to 3D printing, including color-changing ink, origami-inspired robots, and much more. The lab’s latest project is an especially fascinating one. CSAIL is currently focusing on the movement of the human body. While some athletes will study film of themselves or their opponents in order to improve their own performances on the field or court, two-dimensional videos can only give them a limited viewpoint. CSAIL’s “MoSculp” project uses an algorithm to take those 2D videos and turn them into 3D printable “motion sculptures.”

The technology is detailed in a paper entitled “MoSculp: Interactive Visualization of Space and Time.” The researchers believe that it could be a new way for athletes to study the motion of the human body.

“Imagine that you have a video of Roger Federer serving a ball in a tennis match, and a video of yourself learning tennis,” said PhD student Xiuming Zhang, lead author of the paper. “You could then build motion sculptures of both scenarios to compare them and more comprehensively study where you need to improve.”

Users can use a computer interface to navigate around the motion sculptures and see them from every angle. The sculptures can also be 3D printed.

Different techniques have been used in the past to try to get a full visual understanding of the body in motion. Stroboscopic photography techniques, in which hundreds of photographs are snapped in rapid sequence and then stitched together like a flip book, have commonly been used. These are still only snapshots, though, that provide limited understanding. CSAIL’s technique takes a video and automatically detects key 2D points on the subject’s body, then takes the best possible poses from those points to be turned into 3D “skeletons.” Those skeletons are then stitched together and a motion sculpture is generated.

Users can do a lot with the sculptures, customizing them to focus on different body parts, assigning different 3D printed materials to distinguish among parts, or customizing lighting. In a user study, the researchers learned that more than 75 percent of subjects felt that MoSculp provided a more detailed visualization for studying movement than standard photographic techniques.

“Dance and highly-skilled athletic motions often seem like ‘moving sculptures’ but they only create fleeting and ephemeral shapes,” said Courtney Brigham, communications lead at Adobe. “This work shows how to take motions and turn them into real sculptures with objective visualizations of movement, providing a way for athletes to analyze their movements for training, requiring no more equipment than a mobile camera and some computing time.”

The system works best with larger movements, such as throwing a ball or leaping. It also works in situations that might obstruct or complicate movement, like someone wearing loose clothing or carrying an object. At this point, the system only uses single people to construct motion sculptures, but the researchers hope to expand it to multiple people shortly. They believe that it could be used to study things like social disorders, interpersonal interactions and team dynamics.

The paper will be presented at the User Interface Software and Technology (UIST) conference, which will be taking place in Berlin from October 14th to 17th. Authors of the paper include Xiuming Zhang, Tali Dekel, Tianfan Xue, Andrew Owens, Qiurui He, Jiajun Wu, Stefanie Mueller, and William T. Freeman.

Discuss this and other 3D printing topics at 3DPrintBoard.com or share your thoughts below. 

 

Facebook Comments

Share this Article


Related Articles

MIT CSAIL Program Breaks Complex CAD Models Down Into Simpler Shapes for Easier 3D Printing

German Designer Debuts 3D Printed Christmas Ornament Collection Inspired by the Motion of Dance



Categories

3D Design

3D Printed Art

3D Printed Food

3D Printed Guns


You May Also Like

3D Printing News Briefs: September 14, 2018

We’re bringing you the latest 3D printing business news in today’s 3D Printing News Briefs, plus a little 3D printed art to round things out. FATHOM is partnering with SOLIDWORKS software...

Detailed 3D Printed Sculptures Depict Common Scenes and the Light That Illuminates Them

Have you ever stopped to think about your relationship with light? I’m not talking philosophically in terms of Star Wars and the light side versus the dark side, but actual...

3D Printed Autonomous Boats Could Reduce Traffic and Self-Assemble into Other Structures

Autonomous cars are becoming a reality, as self-driving vehicles finally begin to leave the concept stage and actually arrive on the streets. It would make sense, then, that autonomous boats...

3D Printing and Clay Bring Kennis & Kennis’ Historic Reconstructions to Life

Just as forensic artists have used 3D printing to give unidentified murder victims a realistic face, archaeologists and researchers use the technology to provide faces for historical figures. Hominid palaeo-artists...


Training


Shop

View our broad assortment of in house and third party products.


Print Services

Subscribe To Our Newsletter

Subscribe To Our Newsletter

Join our mailing list to receive the latest news and updates from our 3DPrint.com.

You have Successfully Subscribed!