Google has introduced Guided Vision, a new feature debuting in Gemini Live on compatible Android devices today. The capability leverages artificial intelligence to provide real-time audio descriptions when users point their phone’s camera at objects, text, or surroundings. Through the Gemini Live interface, users can receive assistance with tasks such as reading small print, identifying objects, describing environmental details, and obtaining information about specific items.
The feature is designed primarily for individuals who are blind or have low vision, though it is also available for users seeking assistance in particular circumstances. Guided Vision can be accessed through the Gemini app itself, the Google TalkBack accessibility service, or through an accessibility shortcut configured in the device Settings menu on Android 9 and above versions. The feature was introduced as part of recent Pixel device updates.
The AI system supports interactive use, allowing users to ask follow-up questions about items they encounter, such as requesting that Gemini identify and read specific information like expiration dates. Google has incorporated audio cues to help users properly position their camera when attempting to capture objects that may not initially be in view. However, the company has advised users against relying on Guided Vision for critical functions including navigation, safe-travel guidance, obstacle detection, or as a substitute for traditional mobility aids such as canes.
Article Attribution | Read More at Article Source
Article summary produced by Claude AI