APEX-Agents
Professional-services tasks — consulting, law, finance — completed as an agent and graded against expert rubrics. Pass@1.
Long-horizon tasks with tools: terminals, desktops, browsers, whole jobs. One of 8 comparable tests in agentic, a category the Index averages.
Publisher: MercorWhat a model is asked to do
Complete professional-services work in consulting, law and finance as an agent, graded against expert rubrics.
For exampleReview the attached vendor contract, flag every clause that shifts liability to the client, and draft the redlines.
Why it matters. Expert-graded knowledge work is what professional teams would actually delegate.
The example is original and illustrative, not an item from the dataset.
- Models scored here
- 49
- Who produced the numbers
- Official leaderboard
- Best published result
- 47.4%
- License
- CC BY 4.0 (via Epoch AI)
- Direction
- Higher is better
- Scale
- Published as a share of items solved. For the Index, each score is a share of the best published result (47.4%), so the frontier reads 100. Guessing earns nothing on this test, so no chance correction applies.
- Provenance
- Produced by the benchmark's own leaderboard or a third-party evaluator, not by the model's maker.
Snapshot September 8, 2026
Ranking on this test
49 models on APEX-Agents
Best published run per model, and how close each one comes to the best published result on this test (the frontier reads 100). Every number links to the publisher that produced it. Internal runs are marked and carry their run details on the model page.
The best models, ranked here, working inside Theo.
28 of the models on this page run inside Theo today. Theo picks the right one for each step and always shows which engine answered.