PhysicianBench

by HealthRex · Agent Tool · ★ 41

About PhysicianBench

PhysicianBench: Evaluating LLM Agents in Real-World EHR Environments Overview PhysicianBench is a benchmark for evaluating LLM agents on physician tasks grounded in real clinical workflows. It comprises 100 long-horizon tasks (670 sub-checkpoints) adapted from real primary-care/specialty consultations across 21 specialties, executed in an EHR environment with real patient records accessed via standard FHIR APIs.

benchmarkehrhealthcare-aillm-agentmedical-ai

Quick Facts

Stars41
Forks3
LanguagePython
CategoryAgent Tool
LicenseApache-2.0
Quality Score72.2209338015781/100
Last Updated2026-06-25
Created2026-04-28
Platformspython
Est. Tokens~14k

Compatible Skills

These tools work well together with PhysicianBench for enhanced workflows:

  • PawBench — semantic(0.47)+complementary+same_lang+similar_pop+shared_platform (66%)
  • OpenClawProBench — semantic(0.46)+complementary+same_lang+similar_pop+shared_platform (66%)
  • Toucan — semantic(0.34)+complementary+same_lang+similar_pop+shared_platform (62%)
  • MCPBench — semantic(0.31)+complementary+same_lang+similar_pop+shared_platform (61%)
  • toolathlon_gym — semantic(0.30)+complementary+same_lang+similar_pop+shared_platform (61%)

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

Frequently Asked Questions

What is PhysicianBench?

PhysicianBench is The benchmark tasks and evaluation harness for "PhysicianBench: Evaluating LLM Agents in Real-World EHR Environments".. It is categorized as a Agent Tool with 41 GitHub stars.

What programming language is PhysicianBench written in?

PhysicianBench is primarily written in Python. It covers topics such as benchmark, ehr, healthcare-ai.

How do I install or use PhysicianBench?

You can find installation instructions and usage details in the PhysicianBench GitHub repository at github.com/HealthRex/PhysicianBench. The project has 41 stars and 3 forks, indicating an active community.

What license does PhysicianBench use?

PhysicianBench is released under the Apache-2.0 license, making it free to use and modify according to the license terms.

View on GitHub → Browse Agent Tool tools