Site Sponsor: Desktop Metal
Logo 3DPrint Logo 3DPrint
  • News
    View All News Data & Analysis Get PRO Bioprinting, Medical and Dental 3D Software 3D Scanning
    Aerospace Education Metals Materials Editorials/Opinions Exclusive Interviews Podcast

    Metal 3D Printing Firm Velo3D Announces Impressive Q2 Earning

    3D Printing News Unpeeled, Live with Joris Peels Thursday 11th of August

    MedTech Giant Stryker Opens New Metal 3D Printing Facility

  • Zones
    View All Zones EOS Zone The ExOne Zone Velo3D Zone Desktop Metal Zone Bioprinting Zone ASTM Zone
    The 3D Systems Zone ASME Zone Flashforge Zone The Space Zone 3D Printing Stocks Zone GE Additive Zone
    The EOS Zone
    The EOS Zone
    The Desktop Metal Zone
    ASME Logo
    The ASME & Metrix Zone
    The Space Zone
    The Bioprinting Zone
    ASTM Logo
    The EOS Zone

    — The EOS Zone


    On-Demand Webinars
    White Papers
    Brochures
    Customer Success Videos
    Product / Technology Videos
    Podcasts
    EOS News on 3DPrint.com
    EOS Articles Around The Web
    Social Media
    The ROKIT Healhcare Zone

    — The ROKIT Healhcare Zone


    What is 4D Bioprinting?
    Who is ROKIT Healthcare?
    What is Dr. INVIVO?
    Bioprinting Case Studies
    Clinical Application Spotlight
    R&D Application Spotlight
    ROKIT in the News
    Community Pages
    Events of November 2020

    The Bioprinting Zone


    Bioprinting World Map
    ROKIT Webinars
    Bioprinting 101
    Medical & Dental News
    e-NABLE Prosthetics
    ROKIT Healthcare Zone
    The Desktop Metal Zone

    — The Desktop Metal Zone


    Case Studies
    eBooks
    White Papers
    Webinars
    Articles on 3DPrint.com
    Customer Videos
    Community Pages
    The ASME & Metrix Zone

    — The ASME & Metrix Zone


    Events
    ASME Resources
    Metrix Resources
    ASME News on 3DPrint.com
    Social Media
    The astm Zone

    — The ASTM Zone


    Events
    Training & Webinars
    Publications
    On-Demand
    Press Releases
    ASTM News
    Social Media
    The Space Zone

    — The Space Zone


    3D Printing Off-Earth Ecosystem
    Earth
    Low Earth Orbit (LEO)
    International Space Station (ISS)
    Archinaut
    Artemis
    Moon
    Mars
    3DPrint Space News
    Research
    The HP Zone

    — The HP Zone


    Featured Content
    Industrial
    Orthotics & Prosthetics
    Automotive
    MJF Handbook
    Materials
    Printers
    White Papers
    Software & Services
    Case Studies
    Consumer Goods
    Community
    The ExOne Zone

    — The ExOne Zone


    Webinars
    Case Studies
    White Papers
    Videos
    Brochures
    ExOne News
    ExOne Articles Around the Web
    Social Media
    VELO3D Zone

    — Velo3D Zone


    Velo3D Overview Videos
    Product Briefs
    Success Stories
    On-Demand Webinars
    White Papers
    Velo3D Blog Articles
    Press Releases
    3D in 30
    Podcast
    Community
    The 3D Systems Zone

    — The 3D Systems Zone


    Featured Content
    Videos
    eBooks
    Real World Applications
    Whitepapers
    Webinars
    Application & Executive Briefs
    Aerospace & Defense
    Automotive & Motorsports
    Semiconductors
    Jewelry
    Dental
    Healthcare
    Bioprinting
    Read Our Blog
    Connect With Us on Social
    Upcoming Events
    Schedule a Meeting
    GE Additive Zone

    — GE Additive Zone


    Who is GE Additive?
    Additive Solutions
    Powders & Materials
    Recent Press Releases
    Content Offers
    On-Demand Webinars
    Videos
    Industry Material
    The Faster Path: A GE Additive Blog
    Request a Consultation
    Virtual Customer Experience Center
    Social Community
    GE Additive Zone

    — Flashforge Zone


    Commercial 3D Printers
    Professional 3D Printers
    Consumer 3D Printers
    Educational 3D Printers
    News
    Let’s Get Social
  • EOS Zone
  • 3D Systems Zone
  • Velo3D
  • GE Additive
  • Research
    Data & Analysis Get PRO View All Reports Market Studies Patent Studies Data Reports End User Reports

    Polymers Market Data: Q1 2022

    July 13, 2022

    Report #

    Smart Tech Logo

    Metals Market Data: Q1 2022

    July 13, 2022

    Report #

    Smart Tech Logo

    Metals Market Data: Q4 & Annual 2021

    April 05, 2022

    Report #

    Smart Tech Logo

    Healthcare Additive Manufacturing Still AM’s Backbone in 2019, But for How Long?
    Learn More

    Electron Beam Melting Poised to Move into the Metal AM Spotlight
    Learn More

    MARKETS

    Quarterly Additive Manufacturing Hardware Spending by Industry
    Learn More

    Market for Bound Metal Additive Manufacturing 2022

    March 01, 2022

    Report # SMP-BMAM-2022

    Smart Tech Logo

    The Market for Additive Manufactured Polymer Automotive Parts: Europe and North America Regions

    February 22, 2022

    Report # SMP-AMPolyAuto-2022

    Smart Tech Logo

    DED and Large-Format Additive Manufacturing Markets: 2021-2030

    October 01, 2021

    Report # SMP-AM-DED2021-1021

    Smart Tech Logo

    3D Printed Metals: A Patent Landscape Analysis 2019

    July 22, 2019

    Report # SMP-MP-0719

    Smart Tech Logo

    3d Printed Polymers: A Patent Landscape Analysis – 2016

    August 14, 2016

    Report # SMP-PATENT-3DPP-0816

    Smart Tech Logo

    3d-printed Metals: A Patent Landscape Analysis – 2016

    March 14, 2016

    Report # SMP-PR-3DPM-0316

    Smart Tech Logo

    Metal Parts Produced 2021: Additive Manufacturing Applications Market Analysis

    August 11, 2021

    Report # SMP-AM-MPP-0821

    Smart Tech Logo

    Additive Manufacturing with Metal Powders 2020

    August 18, 2020

    Report # SMP-AM-MP-0820

    Smart Tech Logo

    Copper Additive Manufacturing 2020–Market Database and Outlook

    May 07, 2020

    Report # SMP-AMC-0520

    Smart Tech Logo

    Surface Finish Study by Fraunhofer IAPT

    April 09, 2021

    Report #

    Smart Tech Logo

    Additive Monitoring Study by Fraunhofer IAPT

    April 09, 2021

    Report #

    Smart Tech Logo

    Additive Fatigue Study by Fraunhofer IAPT

    April 09, 2021

    Report #

    Smart Tech Logo
  • Guides
    Guides Webinars White Papers

    Article Series

    A curated collection of industry and product deep-dives.

    View All

    Exclusive Content

    Videos, podcasts, product reviews and free downloadable resources.

    View All

    Directories

    Powerful search with product databases and business directories.

    View All
  • Guides
  • Podcast

    3DPOD

    3DPOD Episode 114: Industrial 3D Printing Services with Ivan Madera, Morf3D CEO 3DPOD Episode 114: Industrial 3D Printing Services with Ivan Madera, Morf3D CEO
    3DPOD Episode 113: Industrial 3D Print Services with MakerVerse CEO Markus Seibold 3DPOD Episode 113: Industrial 3D Print Services with MakerVerse CEO Markus Seibold
    3DPOD Episode 112: America Makes Executive Director John Wilczynski 3DPOD Episode 112: America Makes Executive Director John Wilczynski
  • Podcast
  • Resources
    Message Board Jobs Shop Events

    Dig Deeper, Search Our Message Board 3dprintboard.com

    Software Engineer

    • Full Time
    • Boston, USA
    • Contact us
    Learn More

    Senior Mechanical Engineer

    • Full Time
    • Boston, USA
    • Contact us
    Learn More

    Feature Your Job Posting Here

    • List 3 Requirments
    • Link directly to your job board
    • Contact us below to learn more
    Learn More
    on demand additive webinar
    Additive Manufacturing Research and Advisory Services
    3d printing spare parts

    Velo3D

    October 27, 2021

    Velo Webinar

    A New Twist on a Boring Bit

    Innovator's Roundtable

    September 23, 2021

    Velo Webinar

    Innovator's Roundtable: Ditching DfAM and Embracing Design Freedom

    Elkem Silicones

    June 10, 2021

    Elkem Silicones

    Elkem Silicones

    In-Vision

    May 27, 2021

    In-Vision

    In-Vision LIVE-Webinar: Bioprinting from Scratch

    Eos whitepaper
    Download
    Eos whitepaper
    Download
    Eos whitepaper
    Download
    Download
    Download
    Download
    3d print project
    Formnext
    Mil AM 2023
    Networking & Intelligence Summit
    3D Printers 3D Scanners 3D Filaments
    3D Tools Post Processing 3D Printed Fashion
    Print Services 3D Printing Books
  • Newsletter
    Free Daily Newsletter Data & Analysis Get PRO

    Metal 3D Printing Firm Velo3D Announces Impressive Q2 Earning

    3D Printing News Unpeeled, Live with Joris Peels Thursday 11th of August

    MedTech Giant Stryker Opens New Metal 3D Printing Facility

  • About/Submit
    About / Team Contact / Submit Advertise Newsletter Survey

    Metal 3D Printing Firm Velo3D Announces Impressive Q2 Earning

    3D Printing News Unpeeled, Live with Joris Peels Thursday 11th of August

    MedTech Giant Stryker Opens New Metal 3D Printing Facility

  • About
  • Submit
Log In Register
PRO Content Advertise Get 3D Printing Quotes
Metal Binder Jetting
Automotive Polymers

RIT Student Combines HoloLens Glasses with HTC Vive System to Make New Shared Reality App

February 6, 2017 by Sarah Saunders 3D DesignVirtual Reality

Share this Article

Drew Gottlieb

Drew Gottlieb

Whether you’re reaching out and grabbing items in a game using the Dexma Exoskeleton, or taking an up close and personal look at the human brain, what’s not to love about entering a completely immersive environment from the comfort of your couch? Virtual reality (VR) is especially magical if you’re using it to create art in thin air. But Drew Gottlieb, a software developer studying computer science at the Rochester Institute of Technology, realized that if one person is creating 3D art using virtual reality, it’s not much fun for the other friends in the room: they’re only able to see what’s being created by taking a look at a rather distorted view, on a computer monitor, of the other person’s perspective.

Gottlieb was recently with a friend who was painting a 3D submarine using the Google Tilt Brush, which is basically a hand-held high-tech handle, used to paint in the air while wearing a VR headset. When Gottlieb’s friend told him to look at a periscope she’d drawn with the Tilt Brush, the only way he could see it was for his friend to lean in closer to the periscope while wearing her VR headset, as he leaned in closer to his monitor. His opinion? “We can do better than this.”

microsoft-hololensGottlieb says he is on “a mission to empower creativity with computing that feels human,” and has created projects using PHP, Java, Python, and C++, among others. Until now, it would have been impossible for a person not using a Tilt Brush and wearing a VR headset to see the created artwork without getting up and going to the computer. But Microsoft recently released development kits of their mixed-reality HoloLens glasses, which we’ve written about before. Gottlieb has access to a few of these units, and decided to make a proof of concept for people to use mixed reality to share in another person’s VR experience. He notes on his website that he recently started an internship with Google working on the Tilt Brush, and that this project was his own work before the internship began and has no Google association.

hololens-and-vive

HoloViveObserver [Image: Drew Gottlieb via YouTube]

His shared reality system, called the HoloViveObserver, runs on a VR system called the HTC Vive, which comes with two postionally-tracked controllers and was recently on the Top Tech List at CES 2017. Instead of wasting time trying make something like Tilt Brush, Gottlieb instead put together an app where the player using VR can draw simple shapes like cubes in thin air with their controller.

viveAccording to Gottlieb, “The interesting part is that when the same app runs on a HoloLens, it automatically connects to the VR session using Unity‘s built-in networking and matchmaking service.”

Unity is a game development platform, where users can make a highly-optimized 2D or 3D game and utilize the site’s integrated services to speed up the game development process. Gottlieb’s new app uses the HoloLens to search for the VR environment, and aligns it with the Vive environment, using both a physical Vive controller and a virtual one. Thus, a shared reality environment is born.

“A challenge in this experiment was not just getting the Vive and HoloLens to talk to each other, but to bring them to a shared understanding of space,” Gottlieb wrote. “How do we align the virtual and room spaces? Ideally this would happen automatically, but I couldn’t think of a way to do this just using the technology offered by the Vive and HoloLens. Perhaps you could attach tracking symbols to the VR base stations?”

[Image: Drew Gottlieb via YouTube]

[Image: Drew Gottlieb via YouTube]

Gottlieb came up with a quicker solution. The game enters what is called “alignment mode” when the HoloLens app connects to the VR app: the HoloLens will actually speak, and prompt the user to pick up a physical Vive controller and intersect it in the air with a virtual controller. This can be a little tricky, as there are a total of four degrees of alignment to match up: one degree of rotation around the room’s vertical axis, and three position degrees. Gottlieb explained that the biggest error when trying to enter alignment mode is when there’s a slight rotation inaccuracy when you’re trying to align the controllers: if you’re just one degree off, users will start to see increasing misalignment as they move away from the original point. Gottlieb says he plans to prompt the the alignment of three points, instead of just one, in the future, to reduce this degree of error. This fix will use the three points’ position information to set the rotation, and ignore the controller’s rotations.

[Image: Drew Gottlieb via YouTube]

[Image: Drew Gottlieb via YouTube]

When the two controllers are aligned, the HoloLens user can pull the controller’s trigger, and the HoloLens will announce, “You are now aligned.” Gottlieb says he’s successfully tested two HoloLens devices in the same session, and that there’s no limit to how many people can join in on the same session. One of the cool takeaways from his project is that people are now able to work together in the same space, across both holographic and virtual environments. If you’re the spectator wearing the HoloLens, and you have a cool idea, you can ask the VR player in the room to hand over a controller, and you’re able to interact with the art as well. The other option is both people wearing their own HoloLens: each person can take a controller, and you can build larger shapes together.

gottlieb-shared-reality-app

[Image: Drew Gottlieb via YouTube]

“I have no doubt this kind of mixed space will be a big part of the future, especially for creative industries,” Gottlieb wrote. “As virtual and mixed reality become stronger platforms for content creation, it’s only inevitable that they’ll be able to interact on a whim.”

If you’d like to try this project out yourself, and happen to have both a $3,000 HoloLens and the $800 HTC Vive, Gottlieb made the app open source; you can get the source code from GitHub here. Watch this video Gottlieb posted to see how the HoloViveObserver works:

Discuss in the Shared Reality forum at 3DPB.com.

 

 

Subscribe to Our Email Newsletter

Stay up-to-date on all the latest news from the 3D printing industry and recieve information and offers from thrid party vendors.

  • This field is for validation purposes and should be left unchanged.
Tagged with: 3D painting • 3d virtual reality • DIY HoloLens device • Drew Gottlieb • github • google tilt brush • holographs • hololens • HoloViveObserver • HTC Vive • microsoft hololens • Mixed Reality • open source • Rochester Institute of Technology • shared reality • tilt brush • Unity • virtual reality • virtual reality device

Share this Article


Recent News

Metal 3D Printing Firm Velo3D Announces Impressive Q2 Earning

3D Printing News Unpeeled, Live with Joris Peels Thursday 11th of August

View More

Share this Article


Categories

3D Design

3D Printed Art

3D Printed Food

3D Printed Guns

View More

You May Also Like

3D Printing

3D Printing News Unpeeled, Live with Joris Peels – Wednesday 10th of August

Today we’re going to discuss 3D printed razors, CERN and more in this live cast of the 3D Printing news.    

August 10, 2022
3D Printing

3D Printing News Unpeeled, Live with Joris Peels – Tuesday 9th of August

Today we look at 3D Systems´ acquisition of DP Polar, 3D printing guns for money, revolutionary 3D printed breast implants and more. Below you can see the previous videos.  

August 9, 2022
Featured
3D Printing3D Printing MaterialsBusinessFeatured StoriesStocks

3D Systems Buys High-Speed 3D Printing Firm dp polar

The 3D printing mergers and acquisitions continue apace. On the heels of Markforged’s buyout of Digital Metal and Nano Dimension’s 12 percent purchase of Stratasys, 3D Systems (NYSE: DDD) has...

August 8, 2022
3D Printing3D Printing Events

3D Printing Webinar and Event Roundup: August 7, 2022

Things are picking up a little in terms of 3D printing webinars and events this week! Fortify will be at the SmallSat Conference, ASTM is continuing its virtual certificate course,...

August 7, 2022

Print Services

Upload your 3D Models and get them printed quickly and efficiently.

FacFox Jawstec 3ERP 3D Systems Xometry Deed3D Craftcloud® Makelab 3DBGPRINT
  • FacFox
  • Jawstec
  • 3ERP
  • 3D Systems
  • Xometry
  • Deed3D
  • Craftcloud®
  • Makelab
  • 3DBGPRINT
  • XYZprinting
Powered by FacFox
Powered by 3D Systems 3D Systems - Solve Your Biggest Design
Jawstec
Powered by Craftcloud®
Xometry
3DBGPrint
+359 889 101 327
DESIGN & 3D PRINT
About 3DBGPrint
LCD Printer
FDM Printer
POLY Printer
SLA Printer
Contact with 3DBGPrint
XYZprinting service
Aniwaa
  • Aniwaa
Powered by Aniwaa
Aniwaa
  • Aniwaa
Powered by Aniwaa
3DPrinting Business Directory
  • 3DPrinting Business Directory

Site Sponsor

FlashforgeUSA
GE Additive
FacFox
Flashforge
3d systems
ExOne
Velo3D
EOS
Desktop Metal
SmarTech Bound Metal
Metal Parts Produced 2021: AM Applications Market Analysis
Medical Devices 2021
Aniwaa

Events

Additive Manufacturing Strategies

Networking & Intelligence Summit,
February 7-9, 2023

Networking & Intelligence Summit
View More

Jobs

3D Printing jobs around the world.

View More

Subscribe to Our Email Newsletter

Stay up-to-date on all the latest news from the 3D printing industry and receive information and offers from third party vendors.
  • This field is for validation purposes and should be left unchanged.

3D Printing Guides

  • Desktop 3D Printer Buyer’s Guide
  • 3D Scanner Buyer's Guide
  • Metal 3D Printer Guide
  • Industrial Polymer 3D Printer Guide
  • EOS Zone
  • The 3D Systems Zone
  • The ExOne Zone
  • VELO3D Zone
  • Desktop Metal Zone
  • The HP Zone
  • GE Additive Zone
  • ASTM Zone
  • ASME Zone
  • Bioprinting Zone
  • FlashForge Zone
  • The Space Zone
  • 3D Printing Stocks Zone
  • All Guides
  • News Forum
  • Newsletter Advertise
  • About Shop
  • Research Zones
  • Events Contact
  • Podcast Privacy Policy
  • Additive Manufacturing
  • 3D Printing
  • Industry Directory
  • Pinterest
  • Facebook
  • Twitter
  • LinkedIn
  • Youtube
  • RSS
Logo 3DPrint holdings

© 2016 - 2022 3DR HOLDINGS.
ALL RIGHTS RESERVED.


Register

Register to view and download proprietary industry data from SmarTech and 3DPrint.com

Questions? Contact info@3dprint.com

Already have an account?

Log In

  • This field is for validation purposes and should be left unchanged.