Skip to main content

​
Get started

calibrate tts
The interactive UI guides you through the full evaluation process:
  1. Language selection — pick from 10+ supported Indic languages
  2. Provider selection — choose providers (only those supporting your language are shown)
  3. Input CSV — path to CSV file with id and text columns
The input CSV should have this format:
idtext
row_1hello world
row_2this is a test
row_3how are you doing today
Refer to this sample for a template.
  1. Output directory — where results will be saved (defaults to ./out)
  2. API keys — enter the API keys for the selected providers
The evaluation runs providers in parallel (max 2 at a time), showing the progress as audio files are generated.

​
Output

Once all the providers have completed, it displays a leaderboard measuring key metrics along with bar charts for better visualization.
TTS leaderboard
You can also view the generated audio and metrics for each row of your dataset including the LLM judge score and reasoning. Use the arrow keys to navigate rows and press Enter or p to play the generated audio.
TTS provider outputs

Learn more about metrics

Detailed explanation of all metrics and how LLM Judge works

​
Resources

Integrations

See the full list of supported providers and their configuration options