This is the local toolkit (
calibrate-agent) for benchmarking STT, TTS,
and LLM providers and running agent simulations on your own machine. For
the hosted CLI that runs agent tests against your deployed agents, see the
CLI tab.Installation
Get started
The interactive CLI requires Node.js to be installed on
your system.
Next steps
Speech to Text
Benchmark STT providers on your audio dataset
Text to Speech
Benchmark TTS providers on your text dataset
LLM tests
Test agent responses and tool calls
Simulations
Run text or voice simulations