Holodeck for Fish, Flies and Mice Illuminates Animal Behavior in Virtual Reality

Share this Article

A virtual reality arena for flies.

If you’re a Star Trek fan, you’re well acquainted with the concept of the holodeck, an immersive virtual reality environment in which characters can virtually interact with any setting. You may also have had the thought, “Wouldn’t it be cool if someone made one of those for fish?” No? Well, that’s the thought that inspired researchers at the University of Freiburg. Professor of Biology Dr. Andrew Straw, along with Dr. Kristin Tessmar-Raible of the Max F. Perutz Laboratories and an international team of scientists, created a holodeck for the purpose of studying animal behavior in a virtual environment.

Researchers have been trying to find out more about how animals learn spatial cognition, and Dr. Straw and his team turned to sci-fi to find the answers.

“Until now, we have envied an invention from the world of science fiction: a holodeck like they have in Star Trek,” he said. “Something like the holodeck from Star Trek would enable key experiments in which we could artificially decouple an animal’s movement from its perception.”

A virtual reality environment for fish.

The holodeck system was constructed for flies, mice and fish, animals commonly used in neurobiology and behavior research. The goal was to separate movement from sensation, two processes that are linked in the brains of humans and animals. The 3D virtual environments included images such as vertical columns, plants, and even space invaders. Several high-speed cameras tracked and recorded the exact 3D position of each animal in the virtual environment, and a computer program recorded the animals’ movements within milliseconds and projected constantly updated videos on the walls.

“We created an immersive, 3-D virtual reality in which the animals could move freely, because we wanted our visual scenery to tie in naturally with the animal’s own action-perception cycle,” said Dr. Straw.

If you’re delighted by the idea of a fish swimming in a swarm of space invaders, you’re not alone, but the researchers gleaned valuable knowledge from that particular experiment – the computer-controlled space invaders were programmed to recognize the fish as one of them, and the fish’s behavior was, in turn, influenced by the aliens. The scientists also used the virtual reality environment to control and change flies’ flight direction, test to see if mice were afraid of virtual heights (they are), and even do something that hasn’t been done before in behavioral research: directly manipulate interaction between multiple individual animals.

Mice are not fans of virtual heights.

In partnership with the team of Dr. Iain Couzin from the University of Konstanz and the Max Planck Institute for Ornithology, the researchers developed a photorealistic model of a swimming, computer-controlled fish and placed it in the virtual environment with a real fish. The experiment showed that the real fish would most reliably follow the virtual fish when the latter matched its swim direction to the former.

The researchers named the system FreemoVR, and documented the research in a paper entitled “Virtual reality for freely moving animals,” which you can access here. Authors of the study include John R. Stowers, Maximilian Hofbauer, Renaud Bastien, Johannes Griessner, Peter Higgins, Sarfarazhussain Farooqui, Ruth M. Fischer, Karin Nowikovsky, Wulf Haubensak, Iain D. Couzin, Kristin Tessmar-Raible and Andrew D. Straw. You can learn more about FreemoVR here. Discuss in the Holodeck forum at 3DPB.com.

A fish in a swarm of space invaders.

[Source: University of Freiburg / Images: Straw Lab]

 

Share this Article


Recent News

Interview with Scott Sevcik, VP Aerospace Stratasys, on 3D Printing for Aviation and Space

Design Your Own 3D Model for Printing in CAD Software — All Online!



Categories

3D Design

3D Printed Art

3D Printed Food

3D Printed Guns


You May Also Like

Make Your Own 3D Print Design with Expert Guidance

3DPrint.com’s Design Essentials for 3D Printing online crash-course starts October 23 with two live presentations from industry leaders. Over the course of the one-week, learn how to create 3D print-ready...

3DEXPERIENCE Modeling & Simulation Conference: Finn Mast Project & Guest Speaker Dr. Byron Pipes

Recently, Dassault Systèmes, the 3DEXPERIENCE software company, held its 3DEXPERIENCE Modeling & Simulation Conference. I was lucky enough to be invited to attend the event in Novi, Michigan, and the first...

Coding for 3D Part 3: Tools of Choice

This is an in-depth article explaining the plan of attack for learning parametric design through code. I will be consulting various online resources as well as books to strengthen my knowledge base.

3DEXPERIENCE Modeling & Simulation Conference: Keynote by Skunk Works & Executive Roundtable

Last week, Dassault Systèmes, the 3DEXPERIENCE software company, held the 3DEXPERIENCE Modeling & Simulation Conference in Michigan. I was invited to attend the event, which was held from September 18-19...


Shop

View our broad assortment of in house and third party products.


Print Services

Subscribe To Our Newsletter

Subscribe To Our Newsletter

Join our mailing list to receive the latest news and updates from our 3DPrint.com.

You have Successfully Subscribed!