Google Continues to Struggle with AI Overview Accuracy as Users Spot More Search Flaws

June 12, 2024 at 5:50:44 AM

TL;DR Google is struggling to improve AI Overviews accuracy, with social media users exposing flaws through viral memes. Despite reducing AI Overviews in search results to less than 15%, down from 84%, issues persist. Notably, Google's AI suggested adding glue to pizza, a mistake confirmed by The Verge. Other errors include incorrect answers about Google products. Competing AI like Perplexity.AI and ChatGPT avoid such mistakes.

Google Continues to Struggle with AI Overview Accuracy as Users Spot More Search Flaws

Google continues to face challenges in improving the accuracy of its AI Overviews in search results, as evidenced by viral memes and user reports highlighting flaws. Despite efforts to reduce the presence of AI Overviews, their appearance has dropped significantly from 84% to less than 15% of queries since mid-April, coinciding with the launch of AI Overviews in the U.S. This launch was plagued by numerous incorrect and potentially dangerous AI-generated answers.

Viral Memes and Incorrect AI Answers

A notable example is the viral meme suggesting the addition of glue to pizza, which originated from a humorous incident involving Katie Notopoulos. Despite the absurdity of the query, Google's AI still provides incorrect information, citing the meme as a valid answer. This issue was confirmed by The Verge, which replicated the query and received the same erroneous result.

Screenshot_2024_06_11_at_4.48.56_PM.webp

Comparison with Other AI Systems

Other AI systems like Perplexity.AI and ChatGPT do not recommend adding glue to pizza, highlighting the disparity in accuracy between different AI platforms. Perplexity.AI explicitly advises against using glue as it is toxic, while ChatGPT also warns against it for health reasons. Screenshot_2024_06_11_at_3.12.03_PM.webp

Screenshot_2024_06_11_at_3.15.30_PM.webp

Broader Implications and Other Errors

The problem extends beyond humorous queries. For instance, Google's AI struggles to provide accurate answers about its own products. Verge editor Richard Lawler found that Google's AI gave incorrect instructions on how to take screenshots in Chrome's Incognito mode, suggesting methods that either do not work or are not applicable.

Screenshot_20240609_105925.webp

Conclusion

These ongoing issues with AI Overviews not only reduce the utility of Google's search results but also perpetuate misinformation. The feedback loop created by reporting these errors may further exacerbate the problem, as the AI continues to train on flawed data.

Have more questions on this topic? Ask our AI assistant for in-depth insights.

The Only Digital Marketing Feed You'll Ever Need.

Stay informed your way. Tailored updates when and how you want them. 100% Free.

10,000+ Users

500+ Sources

1000+ Tools

Or

Related Posts

Ahrefs Introduces AI Overview Tracking Feature

Ahrefs Introduces AI Overview Tracking Feature

Audit your GA4 account in Minutes

Audit your GA4 account in Minutes

Sponsored
GA4 Auditor
GA4 Auditor

Verified Sponsor

Verified Sponsor

GA4 Auditor is a Verified Sponsor. Want to get featured here? Contact us.

Verified Sponsor
 Google Officially Introduces Ads In AI Overviews Trending ️‍πŸ”₯

Google Officially Introduces Ads In AI Overviews

Google
Google

Official Source

Official Source

Google is a Official Source. The source has been verified by Swipe Insight team.

Official Source
Semrush Launches AI Overview Tracking in Organic Research

Semrush Launches AI Overview Tracking in Organic Research

Brodie Clark
Brodie Clark

Top Creator

Top SEO Creator

Brodie Clark is a Top SEO Creator. Part of Swipe Insight Select, a curated list of top creators.

Top SEO Creator
Google Adds Listen Buttons to AI Overviews

Google Adds Listen Buttons to AI Overviews

 Google Confirms AI Overviews Count Towards Search Console Metrics

Google Confirms AI Overviews Count Towards Search Console Metrics

Google Search Central
Google Search Central

Official Source

Official Source

Google Search Central is a Official Source. The source has been verified by Swipe Insight team.

Official Source
Google Expands AI Overviews to Six New Countries, Adds New Features in Search Labs

Google Expands AI Overviews to Six New Countries, Adds New Features in Search Labs

Google
Google

Official Source

Official Source

Google is a Official Source. The source has been verified by Swipe Insight team.

Official Source
Google Tests More Link Citations in AI Overviews

Google Tests More Link Citations in AI Overviews

Related Tools

GA4 Auditor logo

GA4 Auditor

Verified Tool

Verified Tool

GA4 Auditor is a Verified Tool. Want to get this badge? Contact us.

Verified Tool

Automated GA4 audits with actionable insights

Get Featured Here

Showcase your tool in this list.

Contact Us