Benchmark health

Catalog discovery, scraper implementation, admission, and rank eligibility are separate stages. This page reports each without turning missing publication into a claim that a benchmark is dead.

What we can answer today

Unavailable does not mean a benchmark is dead. It means no working data feed currently supports a public ranking, so EvalRank holds back rather than publishing a weak answer. Source recovery and scraper work can change that.

Each card is a kind of work people use AI for. Open one to see how the options compare.

Evidence current as of 40 days ago

16 more kinds of work, not ranked yetShow

EvalRank understands these questions but does not yet have enough independent evidence to rank them. They are listed so the gaps are visible.

  • Function and tool calling

    Not ranked

    Emit correct schema-valid tool calls

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Web browsing and navigation

    Not ranked

    Retrieve and act on live web content

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Computer use

    Not ranked

    Operate a graphical interface to complete a task

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Deep research

    Not ranked

    Synthesize multiple sources with traceable citations

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Customer support agent

    Not ranked

    Resolve user support issues end to end

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Enterprise and CRM workflow

    Not ranked

    Execute business workflows across enterprise systems

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Mathematical reasoning

    Not ranked

    Solve quantitative or symbolic problems

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Long-term memory

    Not ranked

    Persist and recall useful information across sessions

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Finance

    Not ranked

    Perform domain-grounded financial reasoning and workflows

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Legal

    Not ranked

    Perform domain-grounded legal reasoning and drafting

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Medical

    Not ranked

    Perform domain-grounded clinical reasoning and question answering

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Multilingual

    Not ranked

    Maintain quality across languages and translation tasks

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Vision and multimodal

    Not ranked

    Reason over images, audio, or video

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • SRE incident response

    Not ranked

    Diagnose and repair live service or infrastructure incidents

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Professional deliverables

    Not ranked

    Create review-ready professional work products from a complete brief, domain context, and reference files.

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Computational research reproduction

    Not ranked

    Reproduce published computational results by implementing or executing experiments from papers, code, data, and environments.

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

Health generated Aug 27, 2026, 12:00 AM UTC