Documentation Index
Fetch the complete documentation index at: /docs/llms.txt
Use this file to discover all available pages before exploring further.

Skip to main content

Calibrate home page

Join WhatsApp
GitHub
Get Started
Get Started

Calibrate Local

GitHub
WhatsApp

Getting started

Overview

Agent tests

Link tests to agent
Run agent benchmark
Run agent tests
List test runs for agent
List tests for agent
Get benchmark status
Run agent tests in batch
Get test run status

Agents

List agents
Create agent
Resolve agent names to IDs
Get agent
Update agent
List agent evaluators
Link evaluators to agent
Verify agent connection

Annotation tasks

List annotation tasks
Create annotation task
Get annotation task
Get task agreement
Run evaluators on items
Get evaluator run
Update task evaluators
Bulk create items
Bulk update items
Get task summary

Evaluators

List evaluators
Create evaluator
Get evaluator
Create evaluator version

Tests

List tests
Create test
Bulk create tests
Get test
Update test

Usage
API endpoint

Tests

List tests

List all the test cases for your agents

Usage

from calibrate import Calibrate

client = Calibrate(
    api_key="your_api_key",
)

client.tests.list()

API endpoint

See GET /tests in the API reference tab.

Create evaluator version

⌘I

Powered byThis documentation is built and hosted on Mintlify, a developer documentation platform