Google Continues to Struggle with AI Overview Accuracy as Users Spot More Search Flaws

June 12, 2024 at 5:50:44 AM

TL;DR Google is struggling to improve AI Overviews accuracy, with social media users exposing flaws through viral memes. Despite reducing AI Overviews in search results to less than 15%, down from 84%, issues persist. Notably, Google's AI suggested adding glue to pizza, a mistake confirmed by The Verge. Other errors include incorrect answers about Google products. Competing AI like Perplexity.AI and ChatGPT avoid such mistakes.

Google Continues to Struggle with AI Overview Accuracy as Users Spot More Search Flaws

Google continues to face challenges in improving the accuracy of its AI Overviews in search results, as evidenced by viral memes and user reports highlighting flaws. Despite efforts to reduce the presence of AI Overviews, their appearance has dropped significantly from 84% to less than 15% of queries since mid-April, coinciding with the launch of AI Overviews in the U.S. This launch was plagued by numerous incorrect and potentially dangerous AI-generated answers.

Viral Memes and Incorrect AI Answers

A notable example is the viral meme suggesting the addition of glue to pizza, which originated from a humorous incident involving Katie Notopoulos. Despite the absurdity of the query, Google's AI still provides incorrect information, citing the meme as a valid answer. This issue was confirmed by The Verge, which replicated the query and received the same erroneous result.

Screenshot_2024_06_11_at_4.48.56_PM.webp

Comparison with Other AI Systems

Other AI systems like Perplexity.AI and ChatGPT do not recommend adding glue to pizza, highlighting the disparity in accuracy between different AI platforms. Perplexity.AI explicitly advises against using glue as it is toxic, while ChatGPT also warns against it for health reasons. Screenshot_2024_06_11_at_3.12.03_PM.webp

Screenshot_2024_06_11_at_3.15.30_PM.webp

Broader Implications and Other Errors

The problem extends beyond humorous queries. For instance, Google's AI struggles to provide accurate answers about its own products. Verge editor Richard Lawler found that Google's AI gave incorrect instructions on how to take screenshots in Chrome's Incognito mode, suggesting methods that either do not work or are not applicable.

Screenshot_20240609_105925.webp

Conclusion

These ongoing issues with AI Overviews not only reduce the utility of Google's search results but also perpetuate misinformation. The feedback loop created by reporting these errors may further exacerbate the problem, as the AI continues to train on flawed data.

Have more questions on this topic? Ask our AI assistant for in-depth insights.

Want Personalized Digital Marketing Insights at Your Preferred Time?

Our Smart Newsletter brings you the latest insights on the topics you love, delivered at your preferred time and frequency.

Discover More

Google Launches New AI Overview Layout with Top Links

Google Launches New AI Overview Layout with Top Links

Google AI Overviews Resurge in Health Queries

Google AI Overviews Resurge in Health Queries

Google is Testing AI Overviews for Non-Logged-In Users

Google is Testing AI Overviews for Non-Logged-In Users

Brodie Clark
Brodie Clark

Top Creator

Top SEO Creator

Brodie Clark is a Top SEO Creator. Part of Swipe Insight Select, a curated list of top creators.

Top SEO Creator
Frequently asked questions about AI Overviews

Frequently asked questions about AI Overviews

Google
Google

Official Source

Official Source

Google is a Official Source. The source has been verified by Swipe Insight team.

Official Source
Experiment to Track AI Overviews in Google Search Console

Experiment to Track AI Overviews in Google Search Console

Brodie Clark
Brodie Clark

Top Creator

Top SEO Creator

Brodie Clark is a Top SEO Creator. Part of Swipe Insight Select, a curated list of top creators.

Top SEO Creator
Google Search Head: AI Mistakes Will Happen, But We Must Keep Going

Google Search Head: AI Mistakes Will Happen, But We Must Keep Going