The feature combines the company’s Gemini AI with Lens image recognition, which means users can take or upload a photo and ask questions about what they see.

Google announced today that it will be integrating Gemini's multimodal capabilities into AI Mode on Google Search. This will help expand Search's capabilities by answering comprehensive questions in one go.

“AI Mode builds on our years of work on visual search and takes it a step further,” says Robby Stein, VP of product for Google Search. “With Gemini’s multimodal capabilities, AI Mode can understand the entire scene in an image, including the context of how objects relate to one another and their unique materials, colors, shapes, and arrangements.”