Skip to main content
POST
Bulk create tests

Authorizations

X-API-Key
string
header
required

API key for authentication

Body

application/json
type
enum<string>
required

What the test judges:

  • response: judges the generated reply
  • tool_call: diffs the generated tool calls
  • conversation: judges the full conversation

Applied to every test in the batch

Available options:
response,
tool_call,
conversation
tests
BulkTestItem · object[]
required

Test items to create, at most 500 per request, with names unique within the batch

agent_uuids
string[] | null

IDs of agents to link every created test to. Omit to link none

Example:
language
string | null

Language written to each test's config.settings.language. Omit to leave unset

Response

Successful Response

uuids
string[]
required

IDs of the created tests, in request order

Example:
count
integer
required

Number of tests created

message
string
required

Confirmation message

warnings
string[] | null

Non-fatal issues, such as agents some tests could not be linked to