Google expands AI Mode with multimodal search capabilities for all users

April 08, 2025 at 4:36:04 AM

TL;DR Google has expanded AI Mode to include multimodal capabilities, allowing users to ask complex questions using images. Feedback highlights its design and speed. AI Mode is now available to more U.S. users, merging visual search from Lens with Gemini for detailed image responses. Users can upload photos, ask questions, and receive comprehensive answers with links for further exploration. The feature is still being tested, and feedback is encouraged.

Google expands AI Mode with multimodal search capabilities for all users

Google has expanded AI Mode to include multimodal capabilities, now available to more Labs users in the U.S. Following positive feedback from Google One AI Premium subscribers, who appreciated the design and response time, AI Mode is being utilized for complex queries, such as product comparisons and trip planning.

The new multimodal feature allows users to snap a photo or upload an image, enabling them to ask questions about the visual content. This integration combines visual search capabilities from Lens with a customized version of Gemini, enhancing the understanding of images by analyzing the relationships between objects, their materials, colors, and arrangements.

AI Mode utilizes a query fan-out technique to issue multiple queries about the entire image and its components, resulting in nuanced and contextually relevant responses. For instance, it can identify books on a shelf, provide recommendations, and facilitate follow-up questions for more refined searches. Google continues to test and improve AI Mode, encouraging user feedback through the Labs program.

Have more questions on this topic? Ask our AI assistant for in-depth insights.

Read more from sources 👇

The Only Digital Marketing Feed You'll Ever Need.

Stay informed your way. Tailored updates when and how you want them. 100% Free.

10,000+ Users

500+ Sources

1000+ Tools

Or

Related Posts

Marketing Workflow Templates

Marketing Workflow Templates

Featured
Markifact
Markifact

Verified Sponsor

Verified Sponsor

Markifact is a Verified Sponsor. Want to get featured here? Contact us.

Verified Sponsor
Google Search Console now tracks AI Mode data affecting traffic metrics Trending ️‍🔥

Google Search Console now tracks AI Mode data affecting traffic metrics

Google
Google

Official Source

Official Source

Google is a Official Source. The source has been verified by Swipe Insight team.

Official Source
Google AI Mode Launches Interactive Data Visualizations for Finance Queries

Google AI Mode Launches Interactive Data Visualizations for Finance Queries

Google
Google

Official Source

Official Source

Google is a Official Source. The source has been verified by Swipe Insight team.

Official Source
Google Reveals Insights on AI Mode Development for Marketers

Google Reveals Insights on AI Mode Development for Marketers

Google
Google

Official Source

Official Source

Google is a Official Source. The source has been verified by Swipe Insight team.

Official Source
Google releases new Ads in AI Overviews help document

Google releases new Ads in AI Overviews help document

Google
Google

Official Source

Official Source

Google is a Official Source. The source has been verified by Swipe Insight team.

Official Source
Google tests replacing I’m Feeling Lucky button with AI Mode feature

Google tests replacing I’m Feeling Lucky button with AI Mode feature

Google AI Mode Launches for All US Users with Enhanced Features and Accessibility

Google AI Mode Launches for All US Users with Enhanced Features and Accessibility

Google
Google

Official Source

Official Source

Google is a Official Source. The source has been verified by Swipe Insight team.

Official Source
Google Introduces AI Overviews in YouTube Search for Enhanced Video Discovery

Google Introduces AI Overviews in YouTube Search for Enhanced Video Discovery

Google
Google

Official Source

Official Source

Google is a Official Source. The source has been verified by Swipe Insight team.

Official Source

Related Tools

Markifact logo

Markifact

Verified Tool

Verified Tool

Markifact is a Verified Tool. Want to get this badge? Contact us.

Verified Tool

Marketing Workflows Powered by AI

Featured
Marketing Auditor logo

Marketing Auditor

Verified Tool

Verified Tool

Marketing Auditor is a Verified Tool. Want to get this badge? Contact us.

Verified Tool

Automated audits for Google Ads and Analytics.

Get Featured Here

Showcase your tool in this list.

Contact Us