AI Overviews have been appearing in Google Search for some time as synthetic answers to user queries. The investigation showed that in certain medical cases the system combined accurate information with false or out-of-context content, which could result in incorrect guidance on symptoms, treatment, or how urgently a doctor should be consulted.
Google admitted that, following the review, it decided to remove selected categories of these summaries, particularly where the risk of misinterpretation was highest. However, according to observations by the media and users, the removed summaries mostly concerned liver-related topics — the specific area where problems were detected. In other areas, AI Overviews remain active and can still provide medical advice with a high degree of confidence, even when that advice is questionable.
Concerns about Google’s automated health answers had already been raised by doctors and researchers. Outlets such as Mashable and The New York Times previously warned that generative AI in search can appear authoritative despite not meeting the standards of evidence-based medicine. These concerns were especially relevant for users who treat search results as a substitute for professional medical advice.
The American Medical Association has also repeatedly stressed that AI tools providing health information must clearly communicate their limitations and must not suggest diagnoses or treatment recommendations without physician involvement. Although the AMA did not comment directly on Google’s specific feature, its position is often cited in discussions about similar solutions.
Google maintains that AI is meant to support users in accessing information, not to replace professional medical care. At the same time, the withdrawal of part of the functionality shows that healthcare remains one of the most challenging application areas for generative AI, where even single errors can have real consequences for user safety.
It is worth remembering that even short, summarized answers can have a disproportionate impact on health decisions, especially when they are displayed prominently in search results and phrased with a tone of confidence.
