> ## Documentation Index > Fetch the complete documentation index at: https://penseapp.vercel.app/docs/llms.txt > Use this file to discover all available pages before exploring further. # Update test > Update an agent test case ## OpenAPI ````yaml /api-reference/openapi.json put /tests/{test_uuid} openapi: 3.1.0 info: title: Calibrate Public API version: 0.1.0 description: Programmatic API for CI/automation. Pass your key in the `X-API-Key` header. servers: - url: https://api.calibrate.artpark.ai description: Production security: [] paths: /tests/{test_uuid}: put: tags: - tests summary: Update test description: Update an agent test case operationId: update_test_endpoint_tests__test_uuid__put parameters: - name: test_uuid in: path required: true schema: type: string description: Test to update examples: - b1c2d3e4-f5a6-7890-bcde-f12345678901 title: Test Uuid description: Test to update requestBody: required: true content: application/json: schema: $ref: '#/components/schemas/TestUpdate' responses: '200': description: Successful Response content: application/json: schema: $ref: '#/components/schemas/TestResponse' '422': description: Validation Error content: application/json: schema: $ref: '#/components/schemas/HTTPValidationError' security: - ApiKeyAuth: [] components: schemas: TestUpdate: properties: name: anyOf: - type: string - type: 'null' title: Name description: New test name. Omit to leave unchanged type: anyOf: - type: string enum: - response - tool_call - conversation - type: 'null' title: Type description: |- What the test judges: - `response`: judges the generated reply - `tool_call`: diffs the generated tool calls - `conversation`: judges the full conversation Immutable. Omit it, or send the current value config: anyOf: - additionalProperties: true type: object - type: 'null' description: >- The calibrate test config. Three top-level keys. - `history`: the required conversation up to the agent's turn. Each item is `{role, content}` with `role` one of `user`, `assistant`, `tool`. A `tool` message also carries `tool_call_id` and `name`. - `evaluation`: the required `{type, ...}`, where `type` matches the test's `type` below. - `settings`: an optional object, e.g. `{"language": "en"}`. `evaluation` by test type: - `response`: judge the agent's reply, graded by the linked evaluators. `{"type": "response"}` - `conversation`: append the reply and judge the whole conversation. `{"type": "conversation"}` - `tool_call`: diff the agent's tool calls against expected ones. Add `tool_calls`, a list of `{tool, arguments, accept_any_arguments?}`. For `tool_call`, each expected argument value is one of: - `{"match_type": "exact", "value": }`: must equal `value` - `{"match_type": "llm_judge", "criteria": "..."}`: judged against the criteria - `{"match_type": "any"}`: any value, only checks the argument was passed `response` / `conversation` example: ```json { "history": [{"role": "user", "content": "What is your return policy?"}], "evaluation": {"type": "response"}, "settings": {"language": "en"} } ``` `tool_call` example: ```json { "history": [{"role": "user", "content": "Book room 101 for tomorrow"}], "evaluation": { "type": "tool_call", "tool_calls": [ { "tool": "book_room", "arguments": { "room": {"match_type": "exact", "value": "101"}, "date": {"match_type": "llm_judge", "criteria": "tomorrow's date"} }, "accept_any_arguments": false } ] } } ``` Evaluators are linked via the separate `evaluators` field, not inside `config`. Replaces the stored config. Omit to leave unchanged examples: - evaluation: type: response history: - content: What is your return policy? role: user settings: language: en evaluators: anyOf: - items: $ref: '#/components/schemas/routers__tests__EvaluatorRef' type: array - type: 'null' title: Evaluators description: >- New evaluator links for the test. Omit to leave unchanged. An empty list clears them, except on `conversation` tests, which must keep at least one type: object title: TestUpdate TestResponse: properties: uuid: type: string maxLength: 36 minLength: 36 title: Uuid description: Unique ID for the test examples: - b1c2d3e4-f5a6-7890-bcde-f12345678901 name: type: string title: Name description: Name of the test type: type: string enum: - response - tool_call - conversation title: Type description: | What the test judges: - `response`: judges the generated reply - `tool_call`: diffs the generated tool calls - `conversation`: judges the full conversation config: anyOf: - additionalProperties: true type: object - type: 'null' description: >- The stored config: `history`, `evaluation`, and an optional `settings` created_at: type: string title: Created At description: When the test was created (ISO 8601 UTC) updated_at: type: string title: Updated At description: When the test was last updated (ISO 8601 UTC) evaluators: items: additionalProperties: true type: object type: array description: >- Linked evaluators, resolved to their current live version at read time default: [] type: object required: - uuid - name - type - created_at - updated_at title: TestResponse HTTPValidationError: properties: detail: items: $ref: '#/components/schemas/ValidationError' type: array title: Detail type: object title: HTTPValidationError routers__tests__EvaluatorRef: properties: evaluator_uuid: type: string maxLength: 36 minLength: 36 title: Evaluator Uuid description: Evaluator to attach to the test examples: - f47ac10b-58cc-4372-a567-0e02b2c3d479 variable_values: anyOf: - additionalProperties: true type: object - type: 'null' description: >- Values for the evaluator's `{{placeholder}}` variables, pinned on this test. Omit to inherit the evaluator version's defaults examples: - criteria: The reply must cite the refund window additionalProperties: false type: object required: - evaluator_uuid title: EvaluatorRef ValidationError: properties: loc: items: anyOf: - type: string - type: integer type: array title: Location msg: type: string title: Message type: type: string title: Error Type type: object required: - loc - msg - type title: ValidationError securitySchemes: ApiKeyAuth: type: apiKey in: header name: X-API-Key description: API key for authentication ````