Google has updated its AI Mode chatbot so it can now “see” pictures and answer questions about them. This means users can take or upload a photo, and the AI will give useful information and links about what’s in the image.
The new feature combines Google’s Gemini AI with its Lens image tool. This lets AI Mode understand what’s in a photo — including objects, colors, shapes, and how everything fits together. The update is now available in the Google app on Android and iOS.
Robby Stein, a Google Search VP, said that AI Mode takes Google’s visual search technology to the next level. It can understand full scenes in photos and how different things in the image are related.
Google’s AI uses a special method called “fan-out technique.” It looks at the photo and asks itself many smart questions about what it sees. This helps it give more detailed and accurate answers. For example, if there’s a photo of books, it can name the titles, suggest similar books, and recommend the best ones to read.
AI Mode is Google’s version of other tools like ChatGPT Search and Perplexity. It gives AI-based answers using information from Google’s search system.
The feature was first available only to Google One AI Premium users in Labs. Now, Google is expanding access to millions more users in the U.S.
Source: theverge
