Telephony Integration
Bluejay makes it incredibly simple to test your voice agents using just a phone number. Provide a phone number, and Bluejay handles all the telephony infrastructure to connect with your agent.Quick Start
Testing your voice agent is straightforward:- Add Your Phone Number: Configure your agent with any valid phone number
- Create a Simulation: Set up test scenarios with customer personas
- Run the Test: Bluejay automatically handles the call setup
- Get Results: View detailed analytics, transcripts, and recordings
Inbound vs Outbound Testing
Understanding simulation testing directions is crucial for effective voice agent evaluation. Bluejay supports both testing approaches based on who initiates the call.Outbound Testing (Default)
In outbound testing, Bluejay calls your agent to simulate incoming customer calls.How It Works
- You provide your agentβs phone number or SIP endpoint
- Bluejay initiates calls to your agent using digital humans
- The simulated customer (persona) interacts with your agent
- Your agent responds as it would to real incoming calls
Characteristics
- Immediate Execution: Tests run as soon as triggered
- Multiple Iterations: Can repeat the same test multiple times
- High Control: Bluejay controls timing and execution
- Synchronous Results: Get results immediately after completion
- High Concurrency: Support for simultaneous calls
Use Cases
Perfect for testing:- Customer Service Lines: Support hotlines, help desks
- IVR Systems: Automated phone menus and call routing
- Receptionist Agents: Virtual assistants answering calls
- Emergency Response: Crisis hotlines, urgent support
- Product Support: Technical support scenarios
Inbound Testing
In inbound testing, your agent calls Bluejay to simulate outbound campaigns and proactive scenarios.How It Works
- Bluejay provisions phone numbers for each test case
- Your agent system initiates calls to Bluejayβs provisioned numbers
- Bluejay answers as the simulated customer (persona)
- Your agent conducts the outbound call scenario
Triggering Inbound Calls
Automatic Triggering (Recommended):- Configure an HTTP endpoint that Bluejay calls to trigger your agent
- Bluejay passes the provisioned number as
{{phoneNumberToDial}} - Your system initiates the call automatically
- Bluejay displays provisioned numbers in the simulation interface
- You manually trigger your agent to call the provided numbers
Characteristics
- Asynchronous Execution: Tests wait for your agent to initiate calls
- Agent-Controlled Timing: Your system decides when to call
- Single Iteration: One test per provisioned number
- Pending State: Test cases remain pending until called
- Timeout Management: Configurable timeouts for pending tests
Use Cases
Perfect for testing:- Sales Campaigns: Cold calling, lead follow-up
- Appointment Reminders: Medical, service appointments
- Survey Calls: Customer satisfaction, market research
- Collections: Payment reminders, account management
- Notifications: Alert calls, status updates
- Follow-up Workflows: Post-purchase, support follow-ups
Key Differences
| Aspect | Outbound Testing | Inbound Testing |
|---|---|---|
| Who calls who | Bluejay β Your Agent | Your Agent β Bluejay |
| Execution | Instant | When your agent calls |
| Concurrency | Unlimited | One per number |
| Primary use case | Customer service | Sales/outreach |
| Timing control | Bluejay controls | You control |
| Test state | Running/Complete | Ready/Running/Complete |
| Setup complexity | Simple | Requires triggering |
Choosing the Right Testing Direction
Choose Outbound Testing When:
- Testing customer service scenarios
- You need immediate results and feedback
- Running high-volume or load tests
- Testing response to incoming requests
- Validating IVR flows and call routing
- Testing agent availability and responsiveness
Choose Inbound Testing When:
- Testing sales or marketing campaigns
- Your agent initiates customer contact
- Testing dialer integrations and workflows
- Validating outreach scripts and processes
- Testing follow-up and reminder systems
- Simulating proactive customer engagement
Configuration Examples
Outbound Testing Configuration
Inbound Testing Configuration
Real-World Examples
E-commerce Customer Support
Insurance Claims Processing
Outbound Sales Campaign
Supported Phone Systems
Bluejay works with virtually any phone system:β Compatible Systems
- Traditional PBX: Any standard business phone system
- VoIP Providers: Twilio, RingCentral, 8x8, Vonage, etc.
- Cloud Contact Centers: Amazon Connect, Genesys Cloud, Five9, etc.
- SIP-based Systems: Any system supporting standard SIP protocols
- Mobile Phones: Direct mobile number testing
- Landlines: Traditional telephone lines
π Supported Number Formats
- US/Canada: +1XXXXXXXXXX
- International: Full international format required
- Extensions: Supported with comma-separated dialing
- Toll-Free: 800, 888, 877, 866, 855, 844, 833 numbers
Key Benefits
π Zero Infrastructure Setup
- No telephony infrastructure required
- Works with your existing phone system
- Start testing in minutes
π Complete Analytics
- Full conversation transcripts
- Audio recordings for quality review
- Performance metrics and automated scoring
- Success/failure analysis with detailed insights
π Realistic Testing Environment
- Actual phone call experience with real network conditions
- Natural conversation flow and timing
- Authentic customer interaction patterns
- Real-world audio quality and latency
π Enterprise-Scale Testing
- Run multiple simulations simultaneously
- Batch testing capabilities for large scenarios
- Automated recurring tests for continuous monitoring
- Load testing to validate system capacity
Technical Requirements
Customer Service Testing
- Concurrent Call Handling: Ensure your agent can handle multiple simultaneous calls
- Response Time: Monitor how quickly your agent answers and responds
- Rate Limiting: Configure limits to prevent system overload
- Network Reliability: Stable connectivity for consistent results
Sales Campaign Testing
- Call Triggering: Set up HTTP endpoint or manual calling process
- Timeout Configuration: Set realistic timeouts (default: 60 minutes)
- Dialer Integration: Configure your system to call Bluejayβs numbers
- Failed Call Handling: Implement graceful error handling
Best Practices
Getting Started
- Start Simple: Begin with customer service testing for immediate feedback
- Match Production: Choose the testing mode that matches your real-world usage
- Test Incrementally: Start with single calls, then scale to multiple scenarios
Optimization
- Monitor Performance: Track answer rates, call duration, and success metrics
- Scenario Variety: Test different customer personas and edge cases
- Quality Review: Regularly review recordings and transcripts
- Load Testing: Use customer service mode for high-volume testing
Advanced Monitoring
- Real-time Dashboards: Monitor active tests and results live
- Alert Configuration: Set up notifications for failures or performance issues
- Continuous Testing: Schedule regular tests to catch regressions early
Enhanced Analytics with SIP
For customers requiring deeper insights and metadata collection, consider upgrading to our SIP connectivity option. SIP Benefits:- Tool Call Tracking: Monitor every API call and external service interaction
- Custom Metadata: Collect business-specific metrics and outcomes
- Real-time Analytics: Push live performance data during calls
- Advanced Evaluation: Link conversation outcomes to specific agent behaviors
Getting Started
- Configure Your Agent: Add your phone number to your agent settings
- Choose Your Testing Mode: Select customer service or sales campaign testing
- Create Test Scenarios: Define customer personas and expected outcomes
- Run Your First Test: Execute a simulation and monitor results
- Analyze Results: Review transcripts, recordings, and performance metrics
- Iterate and Improve: Use insights to enhance your agentβs performance