Skip to main content
GET
Get benchmark status

Authorizations

X-API-Key
string
header
required

API key for authentication

Path Parameters

task_id
string
required

Benchmark run to poll for status and results

Example:

"a3b2c1d0-e5f4-3210-abcd-ef1234567890"

Query Parameters

only_failed
boolean
default:false

Return only failing test cases for each model. Omit to return every case

compact
boolean
default:false

Return a compact response that omits heavy detail fields (model_results.test_results, evaluators.output_config), keeping only the lightweight decision fields. Omit for full detail

Response

Successful Response

task_id
string
required

Benchmark run job ID

Required string length: 36
Example:

"a3b2c1d0-e5f4-3210-abcd-ef1234567890"

status
enum<string>
required

Current status of the run

Available options:
queued,
in_progress,
cancelled,
done,
failed
test_uuids
string[] | null

IDs of the tests this benchmark executed, in run order

evaluators
TestRunEvaluator · object[] | null

The evaluators used in this run. Each verdict in judge_results links to one of these by evaluator_uuid

model_results
ModelResult · object[] | null

Results for each model

leaderboard_summary
object[] | null

Leaderboard comparing the models, one row per model. Columns vary by benchmark: a model column plus pass/fail counts, latency, cost, and one score column per evaluator, keyed by evaluator name

Example:
error
boolean
default:false

True if the run failed

is_public
boolean
default:false

Whether the run is shared publicly

share_token
string | null

Token for building the public share URL