Create annotation task
Annotation tasks
Create annotation task
Create an annotation task for annotators to label items against evaluators
POST
Create annotation task
Authorizations
API key for authentication
Body
application/json
Task name, unique within your workspace
Task type. Determines the shape of each item's payload.
stt: judge a transcript on its ownllm: judge one response with its conversation historyllm-general: judge a standaloneinput -> outputpairconversation: judge a full conversation
Available options:
stt, llm, llm-general, conversation, tts A description for the task. Omit for none
IDs of evaluators to link when the task is created, in order. Each must be one you created or a built-in default. Omit to create with no linked evaluators
Example: