With the rise of Large Language Models (LLM’s) like ChatGPT and Claude, many people have incorporated them into their daily lives, asking the LLMs to help with all types of tasks, such as drafting emails and helping with homework. However, while these tools are useful for general productivity, relying on them for health information can be problematic. From spreading misinformation to delaying medical treatment, AI is not a reliable source for health information

One of the main issues with using AI is its tendency to “hallucinate,” which is essentially when AI generates completely false information, but presents it as if it were factual. AI models are trained on datasets from the internet, which include outdated and even completely incorrect health content. And unlike a medical professional, AI cannot say “I don’t know,” so it generates a confident answer regardless of its accuracy. This means that when a user uses AI for health advice, they may receive false medical information, backed by studies that do not even exist. Overall, this is dangerous because users generally can’t tell whether the information is accurate or “hallucinated.” As a result, they may unknowingly rely on advice that has no real medical backing.

Another drawback of using AI for health information is its lack of personalized care. A doctor can tailor their advice to the patient based on their medical history, allergies, and past diagnoses, but AI does not have access to any of this. This results in AI giving generalized responses that may not apply to the user at all. For example, if two patients have the same symptom, it can be due to different underlying causes, but AI will give the same response to both users. At the end of the day, your health is too important and too personal to leave to a generic AI response.

Furthermore, we see that a reliance on AI for advice can cause an actual delay in proper medical treatment. If an individual turns to AI before talking with a qualified healthcare provider, they may attempt to self-diagnose the problem and manage initial symptoms on their own. However, this delay can have serious consequences, especially with diseases that require early detection or immediate care. 

Although AI is a great tool for everyday tasks, it cannot be a substitute for actual professional medical advice. Given the risks of misinformation, lack of personalized care, and delayed treatment, AI is too unreliable and should not be used for health information.

The views in this column do not necessarily reflect the views of the HiLite staff. Reach Viraj Gadeela at [email protected].