Create evaluator
Evaluators
Create evaluator
Create an evaluator along with its first version, which is set live
POST
Create evaluator
Authorizations
API key for authentication
Body
application/json
Evaluator name, unique within your workspace
Minimum string length:
1The evaluator's first version. Set as live when you create the evaluator
Description. Omit to leave blank
What the evaluator judges:
tts: TTS audiostt: one transcriptllm: a reply with its conversation historyllm-general: a standalone input and output pairconversation: a full conversation
Available options:
tts, stt, llm, llm-general, conversation The modality the judge reads:
textaudio
Available options:
text, audio How the evaluator scores:
binary: pass or failrating: a numeric score, using the scale inoutput_config
Available options:
binary, rating