Google (GOOG, GOOGL) on Thursday debuted an all-new version of its Android operating system designed to power virtual and augmented reality headsets and glasses.
Dubbed Android XR, the software, which Google developed in conjunction with Samsung, will allow users to interact with everything from virtual reality apps to real-world objects via your voice, motion controls, and eye-tracking capabilities.
Shares of Google were largely flat immediately following the news.
This isn’t Google or Samsung’s first foray into AR and VR headsets. Google previously offered its Google Daydream phone-based headset, while Samsung sold its Gear VR and its Odyssey headsets. Neither company, however, could get the technology to stick in the consumer market.
What makes things different this time around, the companies say, is the inclusion of Google’s Gemini artificial intelligence software.
“We are at an inflection point for … XR, where breakthroughs in multimodal AI enable natural and intuitive ways to use technology in your everyday life,” Google president of Android Ecosystem Sameer Samat said in a statement.
“We’re thrilled to partner with Samsung to build a new ecosystem with Android XR, transforming computing for everyone on next-generation devices like headsets, glasses, and beyond.”
Samsung is developing the first Android XR-powered device called Project Moohan. A virtual reality header with mixed reality functionality thanks to external cameras, Project Moohan looks like a mix of Apple’s (AAPL) pricey Vision Pro and Meta’s (META) Quest 3 headsets. Google says other device makers will build their own headsets using Android XR as well.
The overall interface looks similar to competing AR/VR operating systems that allow you to place app windows around your virtual space while still being able to view the real world around you via passthrough. Google and Samsung also showed off how you’ll be able to interact with content via your mouse and keyboard, allowing you to work using a massive virtual display.
Google is also incorporating its Circle to Search technology, which allows you to circle an object you see on a website using gesture controls and get additional information about it via Google Search.
In one example, a woman saw an image of a soccer player wearing a pair of cleats that she was interested in buying. The woman then used Circle to Search to find out more about them and interact with a virtual version of the footwear, including by being able to spin a cleat around and place it near her own foot.
Google and Samsung are putting voice controls via Gemini front and center, ensuring users are able to navigate the Android XR and learn more about content using just their voices.
