Prerequisites: Complete Lesson 2: Testing with Simulations or be comfortable creating and running simulations.
What you’ll learn
By the end of this lesson you will be able to:- Connect production calls to Bluejay for automatic evaluation
- Create Custom Metrics tailored to your business needs
- Use Metrics Lab to prototype and refine metrics before promoting them
- Build dashboards that visualize agent quality trends
- Set up alerts and Slack notifications to catch quality regressions in real time
Topics
Topic 1: Setting Up Observability
Connect your production calls so every conversation is automatically evaluated.
Topic 2: Metrics, Dashboards & Alerts
Create evaluation criteria, build dashboards, and get notified when quality drops.