Google recently introduced a new feature called “AI Overviews” in Search, where instead of receiving a page of links, users now get an AI chatbot’s answer at the top of the results page. However, these AI answers have been shown to sometimes be bizarre or even dangerous. For example, Google has been caught suggesting people put glue on their pizzas and claiming that Wario is gay. This has led to some hilarious moments, but it’s unclear how this will affect Google’s bottom line.
To test the effectiveness of AI Overviews, several searches were conducted comparing AI responses to traditional search results. For example, a search query about the harmful effects of standing desks yielded vastly different results between the AI Overview and traditional search results. Similarly, a search about whether parrots understand what they’re saying showcased the limitations of relying on AI for complex scientific topics.
In another test, a search query about how to make a clutch car go revealed that the AI-provided steps were somewhat lacking in basic information. On the other hand, traditional search results led to a Reddit post that was unhelpful and did not address the query effectively.
Overall, while AI Overviews may offer speed and convenience, they may not always provide accurate or comprehensive information. Users will need to decide for themselves whether the new Google experience is an improvement or a downgrade.