Android XR Preview from Google I/O: XR glasses with Gemini AI integration and more

Design and Hardware Partnerships

To ensure the hardware remains unobtrusive for everyday use, Google has partnered with Samsung and eyewear brands Warby Parker and Gentle Monster. The goal of this collaboration is to integrate AI technology into standard eyewear designs. The resulting audio glasses feature a discreet form factor and include private over-ear speakers for audio transmission.

The hardware is designed to be accessible to everyone and can be paired with both iOS and Android smartphones. Users can interact with the system via the voice command “Hey Google” or by tapping the frame.

AI-Driven Features

Through the integration of Gemini, the glasses can function as a real-time assistant. Users can ask questions about their immediate surroundings, such as requesting reviews for nearby businesses or identifying geographical and meteorological features.

Navigation is handled by location-aware systems that provide turn-by-turn directions based on the user’s current position and line of sight. Gemini can further customize these routes by adding stops or suggesting locations based on the user’s saved preferences.

Communication features allow users to manage calls and text messages without using a handheld device. The system can provide summaries of missed notifications and control media playback via the built-in speakers.

Multimedia and Translation Tools

The audio glasses feature built-in cameras for capturing high-resolution photos and videos. These images can be edited using Nano Banana, an AI tool capable of removing background distractions or altering image elements via voice command.

For language support, the glasses offer real-time translation of spoken language that replicates the intonation and pitch of the original speakers. The system also supports the translation of written text found on menus and signs.

Application Integration and Task Automation

In addition to simple queries, the Android XR platform also supports the automation of complex tasks. Gemini can execute multi-step background processes, such as preparing a delivery order via third-party services, so that the user only receives the final confirmation.

In addition, the glasses provide access to various mobile applications via the voice interface, allowing users to request rides via Uber or interact with language learning tools like Mondly without directly interacting with their phone.