> ## Documentation Index
> Fetch the complete documentation index at: https://penseapp.vercel.app/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Overview

> Command-line interface for evaluating AI agents

<Note>
  This is the **local** toolkit (`calibrate-agent`) for benchmarking STT, TTS,
  and LLM providers and running agent simulations on your own machine. For
  the hosted CLI that runs agent tests against your deployed agents, see the
  [CLI](/docs/cli/calibrate/overview) tab.
</Note>

## Installation

```bash theme={null}
pip install calibrate-agent
```

## Get started

<Note>
  The interactive CLI requires [Node.js](https://nodejs.org/) to be installed on
  your system.
</Note>

```bash theme={null}
calibrate-agent
```

Launches the interactive main menu where you can select from all available options.

| Command                       | Description                                       |
| ----------------------------- | ------------------------------------------------- |
| `calibrate-agent stt`         | Interactive STT evaluation — benchmark providers  |
| `calibrate-agent tts`         | Interactive TTS evaluation — benchmark providers  |
| `calibrate-agent llm`         | Interactive LLM evaluation — test agent responses |
| `calibrate-agent simulations` | Interactive text or voice simulations             |

## Next steps

<CardGroup cols={2}>
  <Card title="Speech to Text" icon="microphone" href="/docs/cli/speech-to-text">
    Benchmark STT providers on your audio dataset
  </Card>

  <Card title="Text to Speech" icon="volume-high" href="/docs/cli/text-to-speech">
    Benchmark TTS providers on your text dataset
  </Card>

  <Card title="LLM tests" icon="brain" href="/docs/cli/text-to-text">
    Test agent responses and tool calls
  </Card>

  <Card title="Simulations" icon="comments" href="/docs/cli/text-simulations">
    Run text or voice simulations
  </Card>
</CardGroup>