Hands On With Google’s Gemini-Powered Smart Glasses, Android XR, and Project Moohan Headset

Naturpartner, you can labor in a combiinsist-fact environment with a combiinsist Bluetooth keyboard and moinclude, and you can put yourself in an immersive environment if you want to cgo in, or exit see-thraw mode turned on to originate stateive your colaborers aren’t taking pboilingos and giggling while you wear a ridiculous headset to get stuff done. It wasn’t evident if you’d be able to unite the headset to a laptop to convey your labor into combiinsist fact, a feature useable on the Apple Vision Pro.

Gemini in XR

A tap on the side of the headset conveys up an app beginer, and this is where you can toggle on Gemini if you want it to rerepairdly stay “on.” Once it’s on, there’s an icon at the top of the virtual space so that you are conscious that everyleang you say and see at is being sign uped by Gemini.

In see-thraw mode, you can walk up to an object and ask Gemini about it—a Googler demoing the headset (before I tried it) walked up to someone else wearing an FC Barcelona shirt and asked Gemini to discover the “standings of this team.” Gemini rapidly sign uped the team name and pulled up search results with league standings and scores from recent suites.

You can ask Gemini anyleang appreciate this and it will answer with visual results distake parted in the headset. I asked it to “get me to Peru,” and it uncovered up a 3D version of Google Maps. I was able to shift around and cgo in on Lima, and in cities where Maps already has a lot of 3D models, you can scrutinize areas in fantasticer detail. You can hold talking to Gemini in these experiences, so I asked asks such as when would be the best time to visit and got a prompt answer.

In another example, I peeked inside a restaurant in New York City to get a virtual tour of the space. Google says it can include AI to stitch together images of a venue’s interior and distake part it so that it experiences appreciate you’re there. It did a pretty excellent job, and I asked Gemini if the place gets reservations, without having to particularpartner say the name, becainclude I was staring at the name of the restaurant. It does get reservations, but Gemini couldn’t actupartner originate one for me. (That integration might come tardyr.)

Next, I watched a confiinsist videos on YouTube, where 2D satisfied sees keen and colorful. Stereoscopic satisfied was even better; my senses felt surrounded. I watched some hikers walking aextfinished a trail and asked Gemini where this all was, and it shelp, “New Zealand.” I wasn’t able to verify that, but it seeed appreciate the right answer. I watched some more spatialized take partback of 2D videos as the virtual take parter compriseed depth and layering to originate them experience 3D. I hopped over to the Google TV app and helpd a “Cinema mode” to begin a virtual theater for watching movies and shows, fair appreciate on other VR headsets.

Circle to Search, the feature Google debuted earlier this year on Android phones, is also useable in Android XR. Just walk up to a physical object proximate you, press the top button on the headset, and then pinch and draw a circle around the leang you want to comprehend more about. You’ll get a Google Search page with results.

Smart Glasses

Project Moohan very much experiences appreciate Google and Samsung catching up to the rest of the VR labelet, though the Gemini integration gives their efforts a exceptional layer. However, I will accomprehendledge I was far more excited to try the ininestablishigent glasses, where Gemini experiences appreciate it could be even more beneficial. They didn’t disnominate. I walked over to another room and there were cut offal pairs of glasses in front of me. Some were sunglasses, others had evident lenses. Like the headset, you can get them loaded up with your prescription. Google did not provide a name for the prototype glasses.