Google launched Guided Vision in Gemini Live for Android. It provides real-time audio descriptions and reframing cues via camera. The feature was built with the blind and low-vision community. It was previewed earlier this month. Development used tens of thousands of hours of visual data from Aira. Over 1,000 Aira testers helped refine the model. It supports reading fine print, locating objects, and describing environments. It offers multi-language conversations. It integrates with Android Accessibility Shortcuts and TalkBack. It is not a mobility aid or medical device. It is available where Gemini Live is supported.
What changed
Gemini Live provided text-based visual assistance without real-time reframing cues.
What it unlocks
Receiving real-time audio descriptions and verbal reframing cues via camera during a live session.
- tens of thousands of hours of visual interpretation data
- 1,000+ Aira Trusted Testers
- Android 9 and above
What you need to act on it
- an Android device running Android 9 or higher
- Gemini Live enabled
- latest app and system software updates
Sources