Skip to main content

Installation

pip install calibrate-agent

Get started

The interactive CLI requires Node.js to be installed on your system.
calibrate
Launches the interactive main menu where you can select from all available options.
CommandDescription
calibrate sttInteractive STT evaluation — benchmark providers
calibrate ttsInteractive TTS evaluation — benchmark providers
calibrate llmInteractive LLM evaluation — test agent responses
calibrate simulationsInteractive text or voice simulations

Next Steps

Speech to Text

Benchmark STT providers on your audio dataset

Text to Speech

Benchmark TTS providers on your text dataset

LLM Evaluation

Test agent responses and tool calls

Simulations

Run text or voice simulations