> ## Documentation Index
> Fetch the complete documentation index at: https://penseapp.vercel.app/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Agents

> Create AI agents to evaluate and improve

An agent is a core building block of Calibrate. Agents can:

* Respond intelligently using LLM models following the instructions given to them
* Use tools for structured data extraction
* Process voice conversations using Speech To Text (STT) and Text To Speech (TTS)

<Tip>
  Already have a deployed agent? You can connect it to Calibrate via its HTTP
  endpoint instead of rebuilding it here. See [Agent
  Connections](/docs/core-concepts/agent-connections) for the setup guide.
</Tip>

## Quickstart

### Navigate to agents

From the sidebar, click **Agents** to view your existing agents or create a new one.

<Frame>
  <img src="https://mintcdn.com/amandalmia/WOXUwe6MhHYVL0i7/core-concepts/images/agents-1.png?fit=max&auto=format&n=WOXUwe6MhHYVL0i7&q=85&s=2c58aca1a7f3dd3a5f62dbfd864d554e" alt="Agents List" width="1780" height="638" data-path="core-concepts/images/agents-1.png" />
</Frame>

### Create a new agent

Click the **New agent** button in the top right corner.

<Frame>
  <img src="https://mintcdn.com/amandalmia/WOXUwe6MhHYVL0i7/core-concepts/images/agents-2.png?fit=max&auto=format&n=WOXUwe6MhHYVL0i7&q=85&s=3f09b2699a76fd7313818c3eb5820d5f" alt="Create Agent" width="2482" height="276" data-path="core-concepts/images/agents-2.png" />
</Frame>

Select **Build your agent in Calibrate**, give it a name, and click Create.

<Frame>
  <img src="https://mintcdn.com/amandalmia/TsDdvjhyewlsTagk/core-concepts/images/agents-0.png?fit=max&auto=format&n=TsDdvjhyewlsTagk&q=85&s=a9dd4dd151855ad9d278c072826253f9" alt="Create Agent" width="2008" height="1284" data-path="core-concepts/images/agents-0.png" />
</Frame>

Once ready, you'll be taken to the agent configuration page with multiple tabs.

## Configure your agent

### Add instructions and select providers

Configure the core agent behavior.

<Frame>
  <img src="https://mintcdn.com/amandalmia/eLrf06LUyLtYJP_C/core-concepts/images/agents-3.png?fit=max&auto=format&n=eLrf06LUyLtYJP_C&q=85&s=0c0afae556f7fe7d639a3b137521640d" alt="Agent tab" width="2400" height="1522" data-path="core-concepts/images/agents-3.png" />
</Frame>

**System prompt**

Define the context for the agent, its persona, how it should behave, and any guidelines it should follow. Write clear instructions.

<Tip>
  Be specific about the agent's tone, capabilities, and limitations in the
  system prompt.
</Tip>

For detailed guidance on writing effective system prompts, see [ElevenLabs Prompting Guide](https://elevenlabs.io/docs/agents-platform/best-practices/prompting-guide) and [OpenAI Prompt Engineering Guide](https://platform.openai.com/docs/guides/prompt-engineering).

**Speech To Text**

Select the STT provider for the agent.

**Text To Speech**

Select the TTS provider for the agent.

**LLM**

Select the provider and model for the agent.

Click **Save** in the top right to save your configuration.

### Add tools

Add tools to enable structured outputs by the agent.

<Frame>
  <img src="https://mintcdn.com/amandalmia/eLrf06LUyLtYJP_C/core-concepts/images/agents-4.png?fit=max&auto=format&n=eLrf06LUyLtYJP_C&q=85&s=4386ad17328fed7dea75e1c3102e245c" alt="Tools tab" width="2400" height="1522" data-path="core-concepts/images/agents-4.png" />
</Frame>

Click **Add tool** to attach tools to your agent. See the [Tools guide](/docs/core-concepts/tools) for how to create tools.

**In-built tools**

The platform provides built-in tools like "End conversation" that are automatically available to all agents.

### Define data extraction fields

Define fields for extracting structured data from conversations.

<Frame>
  <img src="https://mintcdn.com/amandalmia/eLrf06LUyLtYJP_C/core-concepts/images/agents-5.png?fit=max&auto=format&n=eLrf06LUyLtYJP_C&q=85&s=7d92e0ca9cef09bfc547462cb73a8a88" alt="Data extraction tab" width="2400" height="1522" data-path="core-concepts/images/agents-5.png" />
</Frame>

Click **Add field** to define custom data specifications to extract from conversation transcripts.

### Add tests

Add tests to evaluate your agent's performance.

<Frame>
  <img src="https://mintcdn.com/amandalmia/eLrf06LUyLtYJP_C/core-concepts/images/agents-6.png?fit=max&auto=format&n=eLrf06LUyLtYJP_C&q=85&s=ef981ee537cb9657456d41aab84df16a" alt="Tests tab" width="2400" height="1522" data-path="core-concepts/images/agents-6.png" />
</Frame>

* Click **Add test** to attach tests to your agent
* Click **Run all tests** to execute all tests for this agent
* Click **Compare models** to benchmark different LLMs

See the [LLM Testing guide](/docs/quickstart/text-to-text) for how to create tests.

### Configure advanced settings

Configure advanced agent behavior.

<Frame>
  <img src="https://mintcdn.com/amandalmia/eLrf06LUyLtYJP_C/core-concepts/images/agents-7.png?fit=max&auto=format&n=eLrf06LUyLtYJP_C&q=85&s=b9bb0f5c4bc577996f226a253afc770b" alt="Settings tab" width="2400" height="1522" data-path="core-concepts/images/agents-7.png" />
</Frame>

**Agent speaks first**

Toggle whether the agent should initiate the conversation.

**Max assistant turns**

Set the maximum number of assistant turns before ending the call.

Click **Save** in the top right to save your configuration.

## Next steps

<CardGroup cols={2}>
  <Card title="Agent Connections" icon="link" href="/docs/core-concepts/agent-connections">
    Connect your existing deployed agent to Calibrate
  </Card>

  <Card title="Run LLM Tests" icon="flask" href="/docs/quickstart/text-to-text">
    Test your agent's responses and tool usage
  </Card>

  <Card title="Run Simulations" icon="play" href="/docs/quickstart/simulations">
    Simulate conversations with the agent to identify issues before deployment
  </Card>

  <Card title="Tools" icon="wrench" href="/docs/core-concepts/tools">
    Define tools for structured data extraction
  </Card>
</CardGroup>
