Google's Guided Vision lets Gemini Live describe the world for blind and low-vision users

You open Gemini Live, share your camera, and Gemini describes what it sees out loud. Then you can talk back. Ask what the label says, what color the jacket is, or what's on the table.

Google calls it "voice-forward, real-time visual interpretation." In plain words, it's a conversation, not a single snapshot description.

"Technology is most powerful when it opens up the world for everyone," Google writes, adding that Guided Vision "turns Gemini into a conversational visual partner." You ask, it looks, it answers, and you can keep asking.

Gemini Live already let Android users share their camera and ask questions, the Centre for Accessibility Australia notes. Guided Vision builds on that with features made specifically for blind and low-vision users.

This is the clever part. If the camera is pointed too high, too close or a bit off to one side, Gemini speaks up and helps you fix it.

Google gives examples of the cues:

• Pan: "pan slowly to the right"
• Tilt: "tilt downward"
• Distance: "step back"

The Centre for Accessibility Australia explains why this matters. A blind or low-vision user doesn't have to know whether the thing they want to ask about is actually in the frame before they ask.

Digitbin points out that this correction loop is what sets Guided Vision apart from earlier AI image description tools. Most of those needed a clean photo handed to them, and offered nothing useful if the first attempt missed. Here, a missed shot just turns into the next instruction.

Think of it like a friend standing next to you while you take a photo. They don't take the picture for you. They just say "a little left, a little lower" until it's right.

Google lists four kinds of everyday tasks where a quick visual check matters:

• Fine print and tricky text: small nutrition labels, appliance dials, washing machine cycles, or a printed menu in a dim restaurant.
• Finding things: a dropped earbud on the floor, or the black pepper hiding in a crowded spice cabinet.
• Colors and details: checking whether a striped shirt goes with a pair of trousers, or the color of a specific jacket.
• Exploring a space: a quick overview of an unfamiliar room, its layout, or what's spread across a table.

In real life You're making dinner and grab two spice jars that feel identical. Point the phone at them, ask which one is the pepper, and Gemini tells you. If the jars are out of frame, it asks you to move the camera first.

Google says it also helps older adults, people with low literacy, or anyone squinting at fine print in bad lighting. The feature works across multiple languages, too.

Digitbin sums up the target well: everyday friction, like reading a food label in dim light, checking a restaurant menu, or identifying an object without needing to touch it first. Those are the moments when, until now, the only real options were a phone camera that couldn't talk back or a sighted friend nearby.

Google says Guided Vision was built "through close collaboration with the accessibility community," and the Centre for Accessibility Australia describes it as designed "for and with" blind and low-vision people.

The biggest partner is Aira, a company that provides visual interpretation services. Here's what Google says Aira contributed:

• Training data: Aira visually interpreted data for a total of tens of thousands of hours to teach Gemini Live how to handle real-world, conversational situations.
• Testing: more than 1,000 members of Aira's Trusted Tester network stress-tested the model across daily routines.
• Safety: Aira specialists worked with Google's teams as subject-matter experts to set up and check the safety guardrails.

Google adds that blind and low-vision communities in India, Brazil, Singapore, Indonesia, Japan and other places tested it and gave feedback, to make the descriptions and cues feel natural.

Google first previewed Guided Vision earlier this month, alongside other accessibility tools for Android. Digitbin reports it was part of the September Android Drop that Google shipped on September 1, 2026, and credits Android Core Platform VP Erik Kay with describing it as designed for and with the blind and low-vision community.

Back then, Google gave no fixed date and only said "coming soon." Today's post says it is now available.

There are three ways in, according to Google:

• In the Gemini app: open your profile settings and switch on "Use Guided Vision in Live." Then open Gemini Live and tap to share your camera.
• With an accessibility shortcut: in Android Settings, go to Accessibility, then Vision assistance, then Guided Vision. You can launch it with the floating accessibility button, a two-finger swipe, or by pressing both volume keys.
• Through TalkBack: if you use Google's TalkBack screen reader, a three-finger tap opens the TalkBack menu, where you can pick Guided Vision.

By the numbers: it runs on Android phones with Android 9 or later, in regions and languages where Gemini Live is supported. Google says to update both the Gemini app and your Android system software first.

That device list is wider than you might expect. Digitbin notes that several of Google's newer Pixel AI features are limited to recent chips and more memory, so not every phone on a recent Android version gets them. Guided Vision doesn't carry that ceiling: an older phone on Android 9 can run it too.

If you've been following Gemini, this joins a busy run of new tricks, like Gemini Live's talking avatars. More: Google news.

Google is very direct about the limits, and they're worth repeating.

The catch: Guided Vision "can make mistakes," like any generative AI tool. Google says it "is not a medical device, mobility aid, or white cane replacement."

It is also not meant for navigation, safe-travel guidance or obstacle detection. Google says users should keep relying on their established mobility aids and safe-travel habits when moving around.

So the right way to think about it: great for reading the menu at the restaurant, not for getting to the restaurant.

• If you're blind or have low vision and use Android: update the Gemini app, switch on Guided Vision, and try it on a label or menu. Set up a shortcut so you can launch it fast.
• If you use TalkBack: you can open Guided Vision straight from the TalkBack menu with a three-finger tap.
• If you just struggle with tiny print: it can read small labels and dim menus for you, too.
• Keep your cane or guide dog: Google says it is not for navigation or spotting obstacles.