Skip to main content
Bluejay supports multiple ways to test an agent depending on the channel, customer behavior, and system architecture you need to evaluate.

What You’ll Learn

  • The different simulation categories available in Bluejay
  • When to use each type based on your testing goals
  • Which integrations map to which simulation types

Voice Simulations

Voice simulations test phone-based customer journeys end to end. Bluejay places or receives calls through your telephony provider, runs the conversation with a Digital Human, captures the audio transcript, and evaluates it against your Custom Metrics.
IntegrationDescription
TelephonyDirect phone calls via your provider
SIPSIP trunk-based voice connections
LiveKitLiveKit room-based voice sessions

Text Simulations

Text simulations test messaging and webhook-based interactions. Bluejay exchanges messages with your agent over HTTP, WebSocket, or SMS and evaluates the full conversation transcript.
IntegrationDescription
HTTP WebhooksBidirectional HTTP messaging
WebSocketsReal-time bidirectional messaging
SMSSMS-based text agent flows

Regression Simulations

Regression simulations validate that changes to your agent — prompt updates, knowledge base revisions, model swaps — haven’t introduced new failures. Run the same simulation repeatedly and compare results over time to catch regressions early.

Scenario-Specific Simulations

Scenario-specific simulations target stress cases, compliance checks, or edge conditions. Pair a narrowly defined Digital Human with specific success criteria to test exactly one behavior path in depth.

Choosing the Right Type

GoalRecommended Type
Validate a new agent build before launchVoice or Text (based on channel)
Catch regressions after a prompt changeRegression
Stress-test escalation handlingScenario-specific
Benchmark across customer demographicsCommunity-based batch run

Next Steps

Simulations Overview

Learn how to create and run simulations.

HTTP Webhooks

Step-by-step guide for text-based simulations.