Benchmark health

Catalog discovery, scraper implementation, admission, and rank eligibility are separate stages. This page reports each without turning missing publication into a claim that a benchmark is dead.

What we can answer today

Unavailable does not mean a benchmark is dead. It means no working data feed currently supports a public ranking, so EvalRank holds back rather than publishing a weak answer. Source recovery and scraper work can change that.

Each card is a kind of work people use AI for. Open one to see how the options compare.

Evidence current as of 6 phút trước

13 more kinds of work, not ranked yetShow

EvalRank understands these questions but does not yet have enough independent evidence to rank them. They are listed so the gaps are visible.

  • Function and tool calling

    Not ranked

    Emit correct schema-valid tool calls

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Web browsing and navigation

    Not ranked

    Retrieve and act on live web content

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Computer use

    Not ranked

    Operate a graphical interface to complete a task

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Deep research

    Not ranked

    Synthesize multiple sources with traceable citations

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Customer support agent

    Not ranked

    Resolve user support issues end to end

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Mathematical reasoning

    Not ranked

    Solve quantitative or symbolic problems

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Long-term memory

    Not ranked

    Persist and recall useful information across sessions

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Finance

    Not ranked

    Perform domain-grounded financial reasoning and workflows

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Legal

    Not ranked

    Perform domain-grounded legal reasoning and drafting

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Medical

    Not ranked

    Perform domain-grounded clinical reasoning and question answering

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • SRE incident response

    Not ranked

    Diagnose and repair live service or infrastructure incidents

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Professional deliverables

    Not ranked

    Create review-ready professional work products from a complete brief, domain context, and reference files.

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Computational research reproduction

    Not ranked

    Reproduce published computational results by implementing or executing experiments from papers, code, data, and environments.

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

Health generated 00:14 4 thg 11, 2026 UTC