- Highlight objects or ask questions for a deeper understanding of what’s in your view.
- Collaborate with Gemini across apps and windows on your screen.
Availability
- Where the Gemini mobile app is available
- With a signed-in personal Google Account
- Important:
- You can use Android XR devices if you are at least 18 yers old.
- You can use XR headsets if you are located in Korea, the United Kingdom, or the United States.
- You can use wired XR glasses if you are located in Canada, Japan, Korea, or the United States.
Chat with Gemini Live on your Android XR device
When you chat with Gemini on your Android XR device, you can explore more deeply. For example, you can ask Gemini questions about a video on YouTube, get help planning a trip while exploring the immersive view in Maps, or compare info across tabs in Chrome.
To chat live with Gemini:
- On your Android XR device’s Home screen, select Gemini
.
- You can also go Live by saying “Hey Google.”
- Pressing and holding the top button on XR headsets.
- Pressing and holding the home button on wired XR glasses.
- For your first time, follow any on-screen instructions.
- Start talking.
.
You can share your device’s view to get help from Gemini Live. When you choose to share your view, your full view is shared, including digital content on your device and physical space visible from your device. Be careful with personal content like passwords, payment details, or medications, and ask for people’s permission before including them in your view.
Tip: To share your physical space with Gemini Live:
- If you're using an XR headset, you'll have to turn your virtual environment off.
- If you're using wired XR glasses, you'll have to turn off dimming.
To share your view with Gemini Live:
- On your Android XR device, open the Gemini mobile app
- Select Turn on view sharing
.
- When you’re sharing your view, to stop sharing, select view sharing
- When you’re sharing your view, to stop sharing, select view sharing
- Follow the on screen instructions.
.
Use visual guidance in Gemini to highlight objects and content
While sharing your view with Gemini, you can ask Gemini to highlight specific objects with a lightweight bounding box.
For example, you can ask Gemini:
- About physical objects (e.g., "Show me which fruit has the most fiber.")
- About static digital content in your view (e.g., "Highlight the flowers I should buy for my kitchen.")