arxivcs.AIcs.LG2026-07-02
A rubric-based controlled comparison of frontier language models on expert-authored clinical reasoning tasks
Samiha A. Ismail, Fan X. Chen, Ali Merali
Multiple-choice medical benchmarks are increasingly saturated, and recent rubric-based evaluations such as HealthBench have shown that open-ended clinical performance is far from solved - its "Hard" subset top score remains 32%. We present a small, deliberately difficult evaluati…