Benchmark health

Catalog discovery, scraper implementation, admission, and rank eligibility are separate stages. This page reports each without turning missing publication into a claim that a benchmark is dead.

What we can answer today

Unavailable does not mean a benchmark is dead. It means no working data feed currently supports a public ranking, so EvalRank holds back rather than publishing a weak answer. Source recovery and scraper work can change that.

Each card is a kind of work people use AI for. Open one to see how the options compare.

Evidence current as of 4분 전

13 more kinds of work, not ranked yetShow

EvalRank understands these questions but does not yet have enough independent evidence to rank them. They are listed so the gaps are visible.

  • Function and tool calling

    Not ranked

    Emit correct schema-valid tool calls

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Web browsing and navigation

    Not ranked

    Retrieve and act on live web content

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Computer use

    Not ranked

    Operate a graphical interface to complete a task

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Deep research

    Not ranked

    Synthesize multiple sources with traceable citations

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Customer support agent

    Not ranked

    Resolve user support issues end to end

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Mathematical reasoning

    Not ranked

    Solve quantitative or symbolic problems

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Long-term memory

    Not ranked

    Persist and recall useful information across sessions

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Finance

    Not ranked

    Perform domain-grounded financial reasoning and workflows

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Legal

    Not ranked

    Perform domain-grounded legal reasoning and drafting

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Medical

    Not ranked

    Perform domain-grounded clinical reasoning and question answering

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • SRE incident response

    Not ranked

    Diagnose and repair live service or infrastructure incidents

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Professional deliverables

    Not ranked

    Create review-ready professional work products from a complete brief, domain context, and reference files.

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

  • Computational research reproduction

    Not ranked

    Reproduce published computational results by implementing or executing experiments from papers, code, data, and environments.

    Reached: In catalog

    0 implemented · 0 admitted · 0 rank-eligible

Health generated 2026. 11. 4. 오전 12:14 UTC