Skip to main content

Configuring Agents

Fine-tune your agent’s behavior with advanced settings.

Core Configuration Options

System Prompt

The most important configuration—defines your agent’s behavior, personality, and capabilities. Structure:
Example:

Temperature

Controls response randomness (creativity vs consistency). Scale: 0.0 to 1.0
  • 0.0-0.2: Deterministic, focused (code, data extraction)
  • 0.3-0.5: Balanced, reliable (most use cases)
  • 0.6-0.8: Creative, varied (content writing)
  • 0.9-1.0: Highly creative, unpredictable (brainstorming)

Max Tokens

Maximum length of responses.
  • 500-1000: Short, concise answers
  • 1000-2000: Standard responses (default)
  • 2000-4000: Detailed explanations
  • 4000+: Long-form content
Lower max tokens = faster responses and lower costs

Context Window

How much conversation history the agent remembers.
  • Small (4K): Fast, cheap, recent context only
  • Medium (16K): Balanced for most conversations
  • Large (128K-200K): Entire conversation history

Advanced Options

Text that signals the agent to stop generating.Example: ---END--- to end responses cleanly
Reduces repetition (0.0-2.0).
  • 0.0: No penalty
  • 1.0: Moderate reduction
  • 2.0: Strong reduction
Encourages topic diversity (0.0-2.0).Higher values = more topic variety
Alternative to temperature for randomness.
  • 0.1: Very focused
  • 0.9: More diverse (default)

Configuration Recipes

Technical Support Agent

Creative Content Writer

Code Assistant

Research Analyst

Knowledge Base

Add information your agent can reference:
  • PDFs, DOCX, TXT, MD
  • Product documentation
  • Policy guides
  • FAQ documents
  • Max 50MB total

Testing Your Configuration

  1. Test with varied inputs - Try different question types
  2. Check edge cases - What happens with unusual inputs?
  3. Verify tone - Does it match your brand?
  4. Review accuracy - Are responses factually correct?
  5. Monitor costs - Track token usage
Always test configuration changes before deploying to production!

Configuration Best Practices

Do:
  • Start with defaults and adjust incrementally
  • Document why you chose specific settings
  • Test thoroughly before deploying
  • Monitor performance and iterate
Don’t:
  • Set temperature to extremes without testing
  • Ignore token costs
  • Skip testing edge cases
  • Change too many settings at once

Next: Test Your Agent

Learn how to properly test your configured agent