Fatal error: Google’s artificial intelligence invented an organ that isn’t in the human body.

The system may have been referring to the basal ganglia, a real part of the brain that helps control movement and emotions, but confused it with the basilar artery, a completely different part, according to a report by The Verge, a website specializing in technology news, reviewed by Al Arabiya Business.

The name of the organ invented by the AI ​​system, “basilar ganglia,” suggests that it combined the English terms “basal ganglia” and “basilar artery.”

This type of error may seem simple, but in the medical field, it can have serious consequences.

This error appeared in a research paper published by Google earlier this year demonstrating the capabilities of Med-Gemini, and also in a blog post by the company.

No one at Google initially noticed the problem, but neurologist Brian Moore was the one who noticed the error and reported it to the company.

Google secretly corrected the blog post, replacing “basilar ganglia” with “basal ganglia,” but made no mention of the change. The research paper remains unupdated.

Google later said it was just a typo, but many doctors weren’t convinced by this explanation, saying it was a clear example of AI hallucinations, where the system makes something up and presents it as reality.

What’s even more worrying is that Google has already begun testing this AI in real hospital settings. Another of its models, MedGemma, also showed signs of glitches, sometimes giving the correct diagnosis when asked a detailed question, but when asked a simpler question, missing the problem entirely.

Experts said AI could certainly help in healthcare, but it requires careful oversight, as these tools appear confident, even when they’re wrong.