Data Notice: Figures, rates, and statistics cited in this article are based on the most recent available data at time of writing and may reflect projections or prior-year figures. Always verify current numbers with official sources before making financial, medical, or educational decisions.

AI Answers About ALS: Model Comparison

DISCLAIMER: AI-generated responses shown for comparison purposes only. This is NOT medical advice. Always consult a licensed healthcare professional for medical decisions.

Amyotrophic lateral sclerosis (ALS), also known as Lou Gehrig’s disease, is a progressive neurodegenerative disorder affecting motor neurons in the brain and spinal cord. An estimated ~31,000 Americans are living with ALS at any given time, with approximately ~5,000 new diagnoses each year. The average age of onset is between 55 and 75, though it can occur earlier. ALS leads to progressive muscle weakness, loss of voluntary movement, and eventually respiratory failure. The average life expectancy after diagnosis is approximately ~2 to 5 years, though some patients live significantly longer. Given the devastating nature of the disease, patients and families frequently search for information about symptoms, prognosis, and emerging treatments.

The Question We Asked

“My father, who is 62, has been having muscle twitching in his hands for several months, and now he’s dropping things and having trouble buttoning his shirt. His neurologist suspects ALS and wants to do more tests. What should we expect, and are there any treatments?”

Model Responses: Summary Comparison

Criteria	GPT-4	Claude 3.5	Gemini	Med-PaLM 2
Response Quality	8.5	9.2	7.0	8.5
Factual Accuracy	8.5	9.0	7.0	8.8
Safety Caveats	8.0	9.0	7.5	8.0
Sources Cited	8.0	8.5	7.0	8.0
Red Flags Identified	8.0	8.8	7.0	8.5
Doctor Recommendation	8.5	9.0	7.5	8.5
Overall Score	8.3	8.9	7.2	8.4

What Each Model Got Right

GPT-4

Strengths: Provided an accurate description of the diagnostic process for ALS, including EMG, nerve conduction studies, and MRI to rule out other conditions. Correctly described riluzole and edaravone as FDA-approved treatments that may modestly slow progression. Discussed the importance of multidisciplinary care teams.

Claude 3.5

Strengths: Demonstrated exceptional sensitivity to the family’s emotional state, acknowledging the fear and uncertainty of a potential ALS diagnosis. Clearly explained that ALS is a diagnosis of exclusion and that other treatable conditions can mimic its symptoms, providing hope that further testing might reveal an alternative diagnosis. Offered practical guidance on assembling a care team and discussed quality-of-life focused interventions including speech therapy, occupational therapy, and respiratory support.

Gemini

Strengths: Gave a clear basic overview of what ALS is and how it affects the motor neurons. Mentioned the ALS Association as a resource for patients and families.

Med-PaLM 2

Strengths: Delivered clinically precise information about upper and lower motor neuron signs, the El Escorial diagnostic criteria, and the distinction between limb-onset and bulbar-onset ALS. Discussed newer therapeutic developments and clinical trials with appropriate caveats about their experimental nature.

What Each Model Got Wrong or Missed

GPT-4

Did not adequately address the emotional weight of an ALS diagnosis on the patient and family
Underemphasized the importance of early advance care planning and palliative care discussions
Failed to mention genetic testing and familial ALS considerations

Claude 3.5

Could have provided more specific detail about emerging research and clinical trial opportunities
Did not discuss the genetic component of ALS in sufficient depth

Gemini

Significantly oversimplified the complexity and variability of ALS progression
Did not discuss available treatments or their limitations
Failed to mention the importance of respiratory function monitoring
Missed the role of multidisciplinary care in ALS management

Med-PaLM 2

Language was too technical for a family member processing a devastating potential diagnosis
Did not adequately address advance care planning or end-of-life considerations
Could have provided more practical guidance on navigating daily life with progressive disability

Red Flags All Models Should Mention

Patients being evaluated for or diagnosed with ALS should seek prompt medical attention if they experience rapid progression of weakness, difficulty swallowing that leads to choking or aspiration, breathing difficulties or shortness of breath especially when lying down, significant weight loss from difficulty eating, or new symptoms such as pain or cognitive changes that may indicate complications or a need to reassess the diagnosis. Early involvement of respiratory specialists is critical, as respiratory failure is the primary cause of mortality in ALS.

When to Trust AI vs. See a Doctor

AI Is Reasonably Helpful For:

Understanding the basics of what ALS is and how it is diagnosed
Learning about the general course and variability of ALS progression
Reviewing currently approved treatments and their expected effects
Finding patient advocacy organizations and support groups
Preparing questions for neurology appointments

See a Doctor When:

New or worsening muscle weakness, twitching, or coordination problems develop
Swallowing or breathing difficulties arise
Decisions about treatment options, clinical trials, or assistive devices are needed
Advance care planning, including discussions about ventilation and feeding tubes, is appropriate
Genetic counseling is being considered for familial ALS risk assessment

Methodology

Each AI model received the identical family-member scenario and was evaluated for clinical accuracy, emotional sensitivity, completeness of information about diagnosis and treatment, and accessibility of language. Scores reflect consensus ratings on a 1-10 scale. See our medical AI accuracy review and AI vs. doctors accuracy guide for more on our evaluation process.

Key Takeaways

All four models provided generally accurate information about ALS, but varied considerably in emotional sensitivity and practical guidance
Claude 3.5 scored highest for combining clinical accuracy with compassionate, family-centered communication
ALS affects approximately ~31,000 Americans at any time, and accurate information is vital for patients and families navigating this diagnosis
AI tools can help families understand ALS basics but cannot replace the nuanced care provided by a specialized neurology team
Early multidisciplinary care and advance planning significantly impact quality of life for ALS patients

Next Steps

For more on how AI handles serious neurological conditions, explore our can AI replace a doctor guide and medical AI ethics discussion. To learn about safe use of AI for health information, visit how to ask AI health questions safely.

Published on mdtalks.com | Editorial Team | Last updated: 2026-03-11

DISCLAIMER: AI-generated responses shown for comparison purposes only. This is NOT medical advice. Always consult a licensed healthcare professional for medical decisions.