Site Sponsor: Desktop Metal
Logo 3DPrint Logo 3DPrint
  • Logo 3DPrint
  • News
    View All News Data & Analysis Get PRO Bioprinting, Medical and Dental 3D Software 3D Scanning
    Aerospace Education Metals Materials Editorials/Opinions Exclusive Interviews Podcast

    XJet Builds Momentum Moving Into 2023 – AMS Speaker Spotlight

    Dude, Where’s My ROI? – AMS Speaker Spotlight

    CEAD’s Vision for the Future of Large-format 3D Printers – AMS Speaker Spotlight

  • Zones
    View All Zones BASF Zone EOS Zone Velo3D Zone Desktop Metal Zone Bioprinting Zone ASTM Zone
    The 3D Systems Zone Flashforge Zone The Space Zone 3D Printing Stocks Zone GE Additive Zone
    The EOS Zone
    The EOS Zone
    The Desktop Metal Zone
    The Space Zone
    The Bioprinting Zone
    ASTM Logo
    BASF Zone

    — BASF Zone

    The EOS Zone

    — The EOS Zone


    On-Demand Webinars
    White Papers
    Brochures
    Customer Success Videos
    Product / Technology Videos
    Podcasts
    EOS News on 3DPrint.com
    EOS Articles Around The Web
    Social Media
    The ROKIT Healhcare Zone

    — The ROKIT Healhcare Zone


    What is 4D Bioprinting?
    Who is ROKIT Healthcare?
    What is Dr. INVIVO?
    Bioprinting Case Studies
    Clinical Application Spotlight
    R&D Application Spotlight
    ROKIT in the News
    Community Pages
    Events of November 2020

    The Bioprinting Zone


    Bioprinting World Map
    ROKIT Webinars
    Bioprinting 101
    Medical & Dental News
    e-NABLE Prosthetics
    ROKIT Healthcare Zone
    The Desktop Metal Zone

    — The Desktop Metal Zone


    Case Studies
    eBooks
    White Papers
    Webinars
    Articles on 3DPrint.com
    Customer Videos
    Community Pages
    The astm Zone

    — The ASTM Zone


    Events
    Training & Webinars
    Publications
    On-Demand
    Press Releases
    ASTM News
    Social Media
    The Space Zone

    — The Space Zone


    3D Printing Off-Earth Ecosystem
    Earth
    Low Earth Orbit (LEO)
    International Space Station (ISS)
    Archinaut
    Artemis
    Moon
    Mars
    3DPrint Space News
    Research
    The HP Zone

    — The HP Zone


    Featured Content
    Industrial
    Orthotics & Prosthetics
    Automotive
    MJF Handbook
    Materials
    Printers
    White Papers
    Software & Services
    Case Studies
    Consumer Goods
    Community
    VELO3D Zone

    — Velo3D Zone


    Velo3D Overview Videos
    Product Briefs
    Material Datasheets
    Success Stories
    On-Demand Webinars
    White Papers
    Velo3D Blog Articles
    Press Releases
    3D in 30
    Podcast
    Community
    The 3D Systems Zone

    — The 3D Systems Zone


    Featured Content
    Videos
    eBooks
    Real World Applications
    Whitepapers
    Webinars
    Application & Executive Briefs
    Aerospace & Defense
    Automotive & Motorsports
    Semiconductors
    Jewelry
    Dental
    Healthcare
    Bioprinting
    Read Our Blog
    Connect With Us on Social
    Upcoming Events
    Schedule a Meeting
    GE Additive Zone

    — GE Additive Zone


    Who is GE Additive?
    Additive Solutions
    Powders & Materials
    Recent Press Releases
    Content Offers
    On-Demand Webinars
    Videos
    Industry Material
    The Faster Path: A GE Additive Blog
    Request a Consultation
    Virtual Customer Experience Center
    Social Community
    GE Additive Zone

    — Flashforge Zone


    Commercial 3D Printers
    Professional 3D Printers
    Consumer 3D Printers
    Education
    News
    Let’s Get Social
  • EOS Zone
  • 3D Systems Zone
  • Velo3D
  • GE Additive
  • BASF
  • Research
    View All Reports Market Studies Data Reports

    Metals Market Data: Q3 2022

    December 22, 2022

    Report #

    Smart Tech Logo

    Polymers Market Data: Q3 2022

    December 22, 2022

    Report #

    Smart Tech Logo

    Opportunities in Additive Manufacturing Software Markets 2023

    December 09, 2022

    Report # SMP-AMSOFT2023-1222

    Smart Tech Logo

    Healthcare Additive Manufacturing Still AM’s Backbone in 2019, But for How Long?
    Learn More

    Electron Beam Melting Poised to Move into the Metal AM Spotlight
    Learn More

    MARKETS

    Quarterly Additive Manufacturing Hardware Spending by Industry
    Learn More

    Opportunities in Additive Manufacturing Software Markets 2023

    December 09, 2022

    Report # SMP-AMSOFT2023-1222

    Smart Tech Logo

    Post-Processing for Additive Manufacturing: Market Analysis and Forecast

    October 07, 2022

    Report # SMP-PPAM2022-1022

    Smart Tech Logo

    Bioprinting: Markets and Opportunities

    October 07, 2022

    Report # SMP-BIO2022-1022

    Smart Tech Logo

    Metals Market Data: Q3 2022

    December 22, 2022

    Report #

    Smart Tech Logo

    Polymers Market Data: Q3 2022

    December 22, 2022

    Report #

    Smart Tech Logo

    Metal Parts Produced 2022: Global Market Data & Forecast

    November 25, 2022

    Report #

    Smart Tech Logo
  • Podcast

    3DPOD

    3D Printing News Unpeeled
    3DPOD Episode 138: Point-of-Care Medical Device 3D Printing with Dr. Steven Kurtz, Drexel University 3DPOD Episode 138: Point-of-Care Medical Device 3D Printing with Dr. Steven Kurtz, Drexel University
    3DPOD Episode 137: From RepRap to Government Supplier, MatterHackers CEO Lars Brubaker 3DPOD Episode 137: From RepRap to Government Supplier, MatterHackers CEO Lars Brubaker
    3DPOD Episode 136: Exploring the Boundaries of 3D Printing with Fergal Coulter, ETH Zurich 3DPOD Episode 136: Exploring the Boundaries of 3D Printing with Fergal Coulter, ETH Zurich
  • Podcast
  • Resources
    Message Board Jobs Shop Events Guides

    Dig Deeper, Search Our Message Board 3dprintboard.com

    Additive Manufacturing Design Engineer

    • Full Time
    • New Brunswick, United States
    • Contact us
    Learn More

    Laser and Optics Development Engineer

    • Full Time
    • Hamburg, Germany
    • Contact us
    Learn More

    Feature Your Job Posting Here

    • List 3 Requirments
    • Link directly to your job board
    • Contact us below to learn more
    Learn More
    on demand additive webinar
    Additive Manufacturing Research and Advisory Services
    3d printing spare parts

    Velo3D

    October 27, 2021

    Velo Webinar

    A New Twist on a Boring Bit

    Innovator's Roundtable

    September 23, 2021

    Velo Webinar

    Innovator's Roundtable: Ditching DfAM and Embracing Design Freedom

    Elkem Silicones

    June 10, 2021

    Elkem Silicones

    Elkem Silicones

    In-Vision

    May 27, 2021

    In-Vision

    In-Vision LIVE-Webinar: Bioprinting from Scratch

    Eos whitepaper
    Download
    Eos whitepaper
    Download
    Eos whitepaper
    Download
    Download
    Download
    Download
    Manufacturing Technology
    Networking & Intelligence Summit
    AMUG
    RAPID 2023
    3D Printers 3D Scanners 3D Filaments
    3D Tools Post Processing 3D Printed Fashion
    Print Services 3D Printing Books

    Article Series

    A curated collection of industry and product deep-dives.

    View All

    Exclusive Content

    Videos, podcasts, product reviews and free downloadable resources.

    View All
  • Newsletter
    Free Daily Newsletter Data & Analysis Get PRO

    XJet Builds Momentum Moving Into 2023 – AMS Speaker Spotlight

    Dude, Where’s My ROI? – AMS Speaker Spotlight

    CEAD’s Vision for the Future of Large-format 3D Printers – AMS Speaker Spotlight

  • About/Submit
    About / Team Contact / Submit Advertise Newsletter Survey

    XJet Builds Momentum Moving Into 2023 – AMS Speaker Spotlight

    Dude, Where’s My ROI? – AMS Speaker Spotlight

    CEAD’s Vision for the Future of Large-format 3D Printers – AMS Speaker Spotlight

  • About
  • Submit
Log In Register
PRO Content Advertise Get 3D Printing Quotes
AMS Spring 2023

RIT Student Combines HoloLens Glasses with HTC Vive System to Make New Shared Reality App

February 6, 2017 by Sarah Saunders 3D DesignVirtual Reality
RAPID

Share this Article

Drew Gottlieb

Drew Gottlieb

Whether you’re reaching out and grabbing items in a game using the Dexma Exoskeleton, or taking an up close and personal look at the human brain, what’s not to love about entering a completely immersive environment from the comfort of your couch? Virtual reality (VR) is especially magical if you’re using it to create art in thin air. But Drew Gottlieb, a software developer studying computer science at the Rochester Institute of Technology, realized that if one person is creating 3D art using virtual reality, it’s not much fun for the other friends in the room: they’re only able to see what’s being created by taking a look at a rather distorted view, on a computer monitor, of the other person’s perspective.

Gottlieb was recently with a friend who was painting a 3D submarine using the Google Tilt Brush, which is basically a hand-held high-tech handle, used to paint in the air while wearing a VR headset. When Gottlieb’s friend told him to look at a periscope she’d drawn with the Tilt Brush, the only way he could see it was for his friend to lean in closer to the periscope while wearing her VR headset, as he leaned in closer to his monitor. His opinion? “We can do better than this.”

microsoft-hololensGottlieb says he is on “a mission to empower creativity with computing that feels human,” and has created projects using PHP, Java, Python, and C++, among others. Until now, it would have been impossible for a person not using a Tilt Brush and wearing a VR headset to see the created artwork without getting up and going to the computer. But Microsoft recently released development kits of their mixed-reality HoloLens glasses, which we’ve written about before. Gottlieb has access to a few of these units, and decided to make a proof of concept for people to use mixed reality to share in another person’s VR experience. He notes on his website that he recently started an internship with Google working on the Tilt Brush, and that this project was his own work before the internship began and has no Google association.

hololens-and-vive

HoloViveObserver [Image: Drew Gottlieb via YouTube]

His shared reality system, called the HoloViveObserver, runs on a VR system called the HTC Vive, which comes with two postionally-tracked controllers and was recently on the Top Tech List at CES 2017. Instead of wasting time trying make something like Tilt Brush, Gottlieb instead put together an app where the player using VR can draw simple shapes like cubes in thin air with their controller.

viveAccording to Gottlieb, “The interesting part is that when the same app runs on a HoloLens, it automatically connects to the VR session using Unity‘s built-in networking and matchmaking service.”

Unity is a game development platform, where users can make a highly-optimized 2D or 3D game and utilize the site’s integrated services to speed up the game development process. Gottlieb’s new app uses the HoloLens to search for the VR environment, and aligns it with the Vive environment, using both a physical Vive controller and a virtual one. Thus, a shared reality environment is born.

“A challenge in this experiment was not just getting the Vive and HoloLens to talk to each other, but to bring them to a shared understanding of space,” Gottlieb wrote. “How do we align the virtual and room spaces? Ideally this would happen automatically, but I couldn’t think of a way to do this just using the technology offered by the Vive and HoloLens. Perhaps you could attach tracking symbols to the VR base stations?”

[Image: Drew Gottlieb via YouTube]

[Image: Drew Gottlieb via YouTube]

Gottlieb came up with a quicker solution. The game enters what is called “alignment mode” when the HoloLens app connects to the VR app: the HoloLens will actually speak, and prompt the user to pick up a physical Vive controller and intersect it in the air with a virtual controller. This can be a little tricky, as there are a total of four degrees of alignment to match up: one degree of rotation around the room’s vertical axis, and three position degrees. Gottlieb explained that the biggest error when trying to enter alignment mode is when there’s a slight rotation inaccuracy when you’re trying to align the controllers: if you’re just one degree off, users will start to see increasing misalignment as they move away from the original point. Gottlieb says he plans to prompt the the alignment of three points, instead of just one, in the future, to reduce this degree of error. This fix will use the three points’ position information to set the rotation, and ignore the controller’s rotations.

[Image: Drew Gottlieb via YouTube]

[Image: Drew Gottlieb via YouTube]

When the two controllers are aligned, the HoloLens user can pull the controller’s trigger, and the HoloLens will announce, “You are now aligned.” Gottlieb says he’s successfully tested two HoloLens devices in the same session, and that there’s no limit to how many people can join in on the same session. One of the cool takeaways from his project is that people are now able to work together in the same space, across both holographic and virtual environments. If you’re the spectator wearing the HoloLens, and you have a cool idea, you can ask the VR player in the room to hand over a controller, and you’re able to interact with the art as well. The other option is both people wearing their own HoloLens: each person can take a controller, and you can build larger shapes together.

gottlieb-shared-reality-app

[Image: Drew Gottlieb via YouTube]

“I have no doubt this kind of mixed space will be a big part of the future, especially for creative industries,” Gottlieb wrote. “As virtual and mixed reality become stronger platforms for content creation, it’s only inevitable that they’ll be able to interact on a whim.”

If you’d like to try this project out yourself, and happen to have both a $3,000 HoloLens and the $800 HTC Vive, Gottlieb made the app open source; you can get the source code from GitHub here. Watch this video Gottlieb posted to see how the HoloViveObserver works:

Discuss in the Shared Reality forum at 3DPB.com.

 

 

Subscribe to Our Email Newsletter

Stay up-to-date on all the latest news from the 3D printing industry and receive information and offers from third party vendors.

  • This field is for validation purposes and should be left unchanged.
Tagged with: 3D painting • 3d virtual reality • DIY HoloLens device • Drew Gottlieb • github • google tilt brush • holographs • hololens • HoloViveObserver • HTC Vive • microsoft hololens • Mixed Reality • open source • Rochester Institute of Technology • shared reality • tilt brush • Unity • virtual reality • virtual reality device

Share this Article


Recent News

XJet Builds Momentum Moving Into 2023 – AMS Speaker Spotlight

Dude, Where’s My ROI? – AMS Speaker Spotlight

View More

Share this Article


Categories

3D Design

3D Printed Art

3D Printed Food

3D Printed Guns

View More

You May Also Like

Sponsored
3D Printers3D Printing MaterialsQuality ControlSponsored

Thermal Management: A Necessary Innovation for 3D Printing – AMS Speaker Spotlight

In the manufacturing industry, the laws of physics are the great playing field leveler. Unconcerned with money, marketing, or good intentions, first principles innovation can create big leaps in performance...

January 25, 2023
3D Printing3D Printing Materials3D Printing Research

3D Printing News Briefs, December 24, 2022: ESD Resin, Clay Tiles, & Other Materials

The focus of today’s 3D Printing News Briefs is materials, materials, and more materials! Starting with research, ORNL scientists found that naturally derived materials are fit for 3D printing. Fraunhofer...

December 24, 2022
Featured
3D PrintingExclusive InterviewsFeatured StoriesMetal 3D PrintingSpace 3D Printing

Ursa Major and EOS to Disrupt Space Production with 3D Printed Copper

“Let’s build some engines!” That’s essentially what Ursa Major is doing. Based in Colorado, this space technology business is racing to improve humanity’s quest to explore the universe – several...

December 2, 2022
3D Printing3D Printing Materials3D Printing ServicesExclusive InterviewsMetal 3D PrintingStartup Accelerator Series

Slurry Metal 3D Printing with MetShape – AMS Focus

AM Ventures is the Networking Sponsor for the Bavarian Beer & Pretzels Networking Reception at the Additive Manufacturing Strategies, business summit February 7-9, 2023. In order to more deeply understand...

November 28, 2022

Print Services

Upload your 3D Models and get them printed quickly and efficiently.

FacFox Jawstec 3ERP 3D Systems Xometry Craftcloud® Makelab PCBWay
  • FacFox
  • Jawstec
  • 3ERP
  • 3D Systems
  • Xometry
  • Craftcloud®
  • Makelab
  • XYZprinting
  • ADDMAN
  • Unionfab
  • PCBWay
Powered by FacFox
Powered by 3D Systems 3D Systems - Solve Your Biggest Design
Jawstec
Powered by Craftcloud®
Xometry
XYZprinting service
ADDMAN
Aniwaa
  • Aniwaa
Powered by Aniwaa
Aniwaa
  • Aniwaa
Powered by Aniwaa
3DPrinting Business Directory
  • 3DPrinting Business Directory

Site Sponsor

Desktop Metal
6K SmarTech
Ultimate Guide to DLP
Velo3D
3d systems
EOS
Certificate Course
ASTM
FacFox
GE Additive
Alexander Daniels Global
Metal Binder Jetting
Commercial Space
Post-Processing
Bioprinting
AM Software
Automotive

Events

Additive Manufacturing Strategies

Networking & Intelligence Summit,
February 7-9, 2023

Networking & Intelligence Summit
View More

Jobs

3D Printing jobs around the world.

View More

Subscribe to Our Email Newsletter

Stay up-to-date on all the latest news from the 3D printing industry and receive information and offers from third party vendors.
  • This field is for validation purposes and should be left unchanged.

3D Printing Guides

  • Desktop 3D Printer Buyer’s Guide
  • 3D Scanner Buyer's Guide
  • Metal 3D Printer Guide
  • Industrial Polymer 3D Printer Guide
  • EOS Zone
  • The 3D Systems Zone
  • Velo3D Zone
  • Desktop Metal Zone
  • GE Additive Zone
  • ASTM Zone
  • Bioprinting Zone
  • FlashForge Zone
  • The Space Zone
  • 3D Printing Stocks Zone
  • All Guides
  • News Forum
  • Newsletter Advertise
  • About Shop
  • Research Zones
  • Events Contact
  • Podcast
  • Additive Manufacturing
  • 3D Printing
  • Industry Directory
  • Privacy Policy
  • Cookie Policy
  • Pinterest
  • Facebook
  • Twitter
  • LinkedIn
  • Youtube
  • RSS
Logo 3DPrint holdings

© 2016 - 2023 3DR HOLDINGS.
ALL RIGHTS RESERVED.


Register

Register to view and download proprietary industry data from SmarTech and 3DPrint.com

Questions? Contact info@3dprint.com

Already have an account?

Log In

  • This field is for validation purposes and should be left unchanged.