Complete a real task inside a terminal, such as setting up a service, fixing a build or wrangling data, verified by tests.
66.5%
78.5% of the best (84.7%)
#8 of 40
agent: Deep Agents
Harnesses differ by model, so this compares model-plus-harness systems, not models alone.
Source: Terminal-Bench