Research Project
AI Medicare Advice Evaluator
Based on Accuracy of Medicare Information Provided by State Health Insurance Assistance Programs — Dugan et al., JAMA Network Open, 2025
Research Use Only. ⚠️ This system is for research purposes only. It evaluates AI-generated information quality but does NOT: - Provide medical, legal, or insurance advice - Replace professional Medicare counseling - Recommend specific health coverage decisions - Serve as a decision-support tool for beneficiaries Results should not be used to make healthcare decisions. This tool presents comparative evaluation data, not beneficiary guidance.
Question-Level Accuracy
Hide Models Show All Models
Sort:
Overall Accuracy Across All Questions  
Model / Group Accurate & Complete Accurate but Incomplete Not Substantive Incorrect n Δ A&C vs SHIP
Medicare-Only Scenario
Q# Question / Company / Model Accurate &
Complete
Accurate but
Incomplete
Not
Substantive
Incorrect Δ A&C
(AI − SHIP)
Click any model row
to view its verbatim response