> ## Documentation Index
> Fetch the complete documentation index at: https://penseapp.vercel.app/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Text to Speech

> Learn how to evaluate and compare TTS providers with your data

[Calibrate](https://calibrate.artpark.ai) lets you evaluate multiple TTS providers simultaneously using your own text samples. This guide will walk you through creating an evaluation, managing reusable datasets, and sharing your results.

<iframe className="w-full aspect-video rounded-xl" src="https://www.youtube.com/embed/MM8rW0m-Vr0" title="Text-to-Speech Evaluation Walkthrough" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowFullScreen />

## Start a new evaluation

From the sidebar, click on **Text-to-Speech** to view all your evaluations and datasets. Click the **New evaluation** button to create a new evaluation.

<Frame>
  <img src="https://mintcdn.com/amandalmia/UFssmcyObcv9X1pQ/quickstart/images/tts_new.png?fit=max&auto=format&n=UFssmcyObcv9X1pQ&q=85&s=0a270b16dd44aa15a651165acd0e03b7" alt="Text-to-Speech Evaluations List" width="2504" height="502" data-path="quickstart/images/tts_new.png" />
</Frame>

## Add your dataset

On the **Dataset** tab, choose how to provide your text samples:

<Frame>
  <img src="https://mintcdn.com/amandalmia/Bm1K-yzOJzOii4rT/quickstart/images/tts_new_dataset.png?fit=max&auto=format&n=Bm1K-yzOJzOii4rT&q=85&s=8047a7f203ec043f31609d31f0b5308d" alt="New TTS Evaluation - Dataset Tab" width="2500" height="1068" data-path="quickstart/images/tts_new_dataset.png" />
</Frame>

<AccordionGroup>
  <Accordion title="Enter manually" icon="keyboard" defaultOpen>
    Create a new dataset inline. Give it a name, then add text samples in one of two ways:

    1. **Add samples inline** — Type the text to synthesize in each row. Click **+ Add another row** to add more entries.

    2. **Bulk upload via CSV** — Upload a CSV file with a `text` column:

    ```csv theme={null}
    text
    Hello, how can I help you today?
    Your appointment is confirmed for tomorrow at 3 PM.
    Thank you for calling. Have a great day!
    ```

    <Tip>
      Click **Download sample** to get a template with the correct format.
    </Tip>

    <Frame>
      <img src="https://mintcdn.com/amandalmia/Bm1K-yzOJzOii4rT/quickstart/images/tts_dataset_create.png?fit=max&auto=format&n=Bm1K-yzOJzOii4rT&q=85&s=1aa50707cf52968461314ef27905d9aa" alt="Use Existing Dataset" width="2508" height="1150" data-path="quickstart/images/tts_dataset_create.png" />
    </Frame>

    Your dataset is automatically saved so you can reuse it in future evaluations.
  </Accordion>

  <Accordion title="Use existing dataset" icon="database">
    If you've already created a dataset, switch to **Use existing dataset** to pick from your saved datasets.

    <Frame>
      <img src="https://mintcdn.com/amandalmia/Bm1K-yzOJzOii4rT/quickstart/images/tts_existing_dataset.png?fit=max&auto=format&n=Bm1K-yzOJzOii4rT&q=85&s=dab0a95e6e51de7f34eba13096e01c2a" alt="Use Existing Dataset" width="2504" height="872" data-path="quickstart/images/tts_existing_dataset.png" />
    </Frame>
  </Accordion>
</AccordionGroup>

<Tip>
  You can also create and manage datasets independently from the **Datasets**
  tab. See [Datasets](/docs/core-concepts/text-to-speech#datasets) to learn how to
  create reusable datasets and run evaluations directly from them.
</Tip>

## Configure settings

Switch to the **Settings** tab to select the language and the providers you want to compare:

<Frame>
  <img src="https://mintcdn.com/amandalmia/Bm1K-yzOJzOii4rT/quickstart/images/tts_settings.png?fit=max&auto=format&n=Bm1K-yzOJzOii4rT&q=85&s=e7b7df7bdd46030d58ad4df037c1a3a4" alt="TTS Settings - Language and Providers" width="2504" height="1118" data-path="quickstart/images/tts_settings.png" />
</Frame>

Select a **Language** from the dropdown and check the providers you want to evaluate. Each provider shows the model and **Voice ID** it uses.

## Run evaluation

Click the **Evaluate** button at the top to start the evaluation. You'll be redirected to the results page where you can monitor progress in real-time.

## View results

### Outputs

The **Outputs** tab shows per-provider results. Select a provider from the list on the left to see its overall metrics and per-sample results.

<Frame>
  <img src="https://mintcdn.com/amandalmia/OZ2gflgC-xZ7IvDP/quickstart/images/tts_outputs.png?fit=max&auto=format&n=OZ2gflgC-xZ7IvDP&q=85&s=8486ad2ebe0be01e9209471b584124ac" alt="TTS Outputs with Audio Playback" width="2436" height="1174" data-path="quickstart/images/tts_outputs.png" />
</Frame>

Each sample row includes:

* **Text** — The input text you provided
* **Audio** — An inline audio player to listen to the generated speech
* **LLM Judge** — Pass/Fail based on audio quality evaluation

### Leaderboard

The **Leaderboard** tab shows a side-by-side comparison across all providers with aggregated metrics and bar charts.

<Frame>
  <img src="https://mintcdn.com/amandalmia/OZ2gflgC-xZ7IvDP/quickstart/images/tts_leaderboard.png?fit=max&auto=format&n=OZ2gflgC-xZ7IvDP&q=85&s=5b0b5978f25abe849301a540e5a3dc3f" alt="TTS Leaderboard" width="2420" height="1232" data-path="quickstart/images/tts_leaderboard.png" />
</Frame>

## Sharing results publicly

Once your evaluation completes, you can make the results publicly accessible by clicking the **Share** button on the results page.

<Frame>
  <img src="https://mintcdn.com/amandalmia/Bm1K-yzOJzOii4rT/quickstart/images/tts_share.png?fit=max&auto=format&n=Bm1K-yzOJzOii4rT&q=85&s=43b24cba93cb44823da67f48a84a1a8a" alt="Share button on evaluation results" width="1044" height="546" data-path="quickstart/images/tts_share.png" />
</Frame>

This toggles the evaluation to **Public** and generates a shareable link. Anyone with the link can view the leaderboard and outputs without needing a Calibrate account.

<Frame>
  <img src="https://mintcdn.com/amandalmia/Bm1K-yzOJzOii4rT/quickstart/images/tts_public.png?fit=max&auto=format&n=Bm1K-yzOJzOii4rT&q=85&s=63b3ad9f9dff4f0cc62e04419f125b7c" alt="Public evaluation with copy link" width="3024" height="1522" data-path="quickstart/images/tts_public.png" />
</Frame>

Click the **Public** button again to make the evaluation private.

## Next steps

<CardGroup cols={2}>
  <Card title="Core Concepts" icon="chart-bar" href="/docs/core-concepts/text-to-speech">
    Learn about TTS metrics — LLM Judge Score and TTFB
  </Card>

  <Card title="Datasets" icon="database" href="/docs/core-concepts/text-to-speech#datasets">
    Save and reuse text samples across multiple evaluations
  </Card>

  <Card title="Simulations" icon="microphone" href="/docs/quickstart/simulations">
    Run simulated conversations with your agent
  </Card>
</CardGroup>
