OpenAI is rolling out ChatGPT Health, a new feature designed to centralize medical inquiries within its popular AI chatbot. The move reflects the growing demand for health-related information from AI, with OpenAI reporting that “hundreds of millions” of users already seek wellness advice weekly. The Health tab, currently in beta, will allow users to integrate data from apps like Apple Health and MyFitnessPal, creating a more comprehensive, but potentially risky, digital health profile.
The Privacy Dilemma
The expansion into healthcare raises immediate concerns about data security and privacy. Unlike regulated healthcare providers, OpenAI isn’t bound by HIPAA or any comprehensive US privacy law. This means personal health data collected by ChatGPT Health will be subject to OpenAI’s policies, which may not offer the same protections as traditional medical settings. According to Andrew Crawford of the Center for Democracy and Technology, this could leave sensitive health information vulnerable to breaches and misuse.
OpenAI claims the new tab will include separate chat history, encryption, and multifactor authentication. It also states that health conversations won’t be used for model training. However, the lack of stringent legal oversight remains a significant risk.
Accuracy and the Risk of Misinformation
Beyond privacy, the reliability of AI-generated health advice is a growing problem. Cases have emerged where users received dangerous recommendations, such as replacing salt with sodium bromide, leading to hospitalization. OpenAI acknowledges this danger, stating that ChatGPT Health isn’t intended for diagnosis or treatment. Despite improvements in its GPT-5 model (which hallucinates less frequently), the potential for inaccurate or harmful advice remains.
Mental Health Considerations
The company has engaged over 170 mental health experts to improve its responses to sensitive conversations. ChatGPT has been trained to direct users seeking mental health help toward crisis resources. While OpenAI claims its AI can now de-escalate distressed conversations more effectively, the effectiveness of these guardrails is still uncertain.
Access and Future Outlook
ChatGPT Health is currently available via a waitlist. OpenAI frames the tab as a tool for fitness, nutrition, and general medical information, explicitly stating it won’t replace professional healthcare. However, the expansion into this domain introduces new risks that demand careful consideration.
The lack of comprehensive privacy laws and the inherent risk of AI-generated misinformation mean users must proceed with caution. ChatGPT Health may offer convenience, but it doesn’t replace the expertise and legal protections of traditional healthcare systems.
