Most AI phone vendors will dazzle you with a demo, a logo wall, and a vague ROI promise.

The good ones will hand you a scorecard.

If you’re evaluating an AI voice agent — or trying to defend the spend on one you already have — there are 5 metrics that tell the whole story. Track these and you’ll never have to wonder whether the system is earning its keep. Ignore them and you’ll never know either way.

Here are the 5 numbers that matter, the benchmarks to target, and how to calculate each one cleanly.

Metric #1: Call-to-Booking Conversion Rate

Definition: Of all inbound calls answered by your phone system, what percentage resulted in a booked, dispatched job?

Formula: (Booked jobs from inbound calls ÷ Total inbound calls answered) × 100

Why it matters: This is the headline metric. Every other metric is downstream of this one. If your AI phone isn’t moving the conversion needle, nothing else matters.

Benchmarks:

  • Strong in-house CSRs: 55–65%
  • Average answering service: 12–22%
  • Modern AI phone (well-deployed): 55–75%
  • AI phone (poorly deployed): 30–45%

How to read the number: A 50% conversion rate sounds good on its own. It looks different when you compare it to your CSRs’ historical 62%. Always benchmark against your own historical conversion before the deployment, not against industry averages.

Common mistakes:

  • Counting “calls that reached a human” instead of “calls that were answered” — voicemail and abandons disappear from the math
  • Counting estimates as bookings (different funnel stage)
  • Mixing residential and commercial calls without segmenting

Real example: A pest control company in San Diego tracked their pre-AI conversion at 48%. After deployment, AI-handled calls converted at 67%. Total monthly bookings up 23%. The conversion lift, not the cost savings, was the real ROI story.

Metric #2: Cost Per Booked Call

Definition: What does it cost you, all-in, to book a single job through your phone system?

Formula: (Monthly phone system cost + integration cost + admin time) ÷ Number of bookings from inbound calls

Why it matters: This is the metric that lets you compare AI phones to answering services to in-house CSRs honestly. Monthly subscription cost alone is meaningless. Cost per booked call is comparable across every model.

Benchmarks:

  • In-house CSR (loaded cost): $14–$22 per booked job
  • Traditional answering service: $35–$70 per booked job
  • Modern AI phone: $4–$11 per booked job

How to read the number: Cost per booked call is where AI phone economics get unfair. The fixed cost of the platform divided by a higher number of bookings produces a per-booking cost that legacy services can’t approach.

Common mistakes:

  • Counting only the subscription fee (ignore integration, training, admin)
  • Not accounting for CSR redeployment value (when CSRs move to outbound, their cost doesn’t go away — it shifts)
  • Comparing different time windows (compare apples to apples)

Real example: A plumbing company in Charlotte was paying $1,820/month for a regional answering service that booked 38 jobs. That’s $47.89 per booked job. They switched to an AI phone platform at $1,200/month and booked 124 jobs in the first 30 days. New cost per booked job: $9.68. The platform paid for itself in week one.

Metric #3: After-Hours Revenue Capture Rate

Definition: Of all after-hours inbound calls (defined by your business hours), what percentage resulted in a booked job?

Formula: (After-hours bookings ÷ Total after-hours inbound calls) × 100

Why it matters: This is the metric where AI phones routinely deliver 5–10x improvements over traditional models. It’s also where the biggest revenue dollars live — because after-hours calls skew toward emergency and high-intent inquiries.

Benchmarks:

  • Voicemail-only after-hours: 4–9% capture rate (mostly next-day callbacks)
  • Traditional answering service: 18–30% capture rate
  • Modern AI phone: 65–85% capture rate

How to read the number: Multiply after-hours capture rate by your average ticket value. That’s your monthly after-hours revenue. Compare before and after deployment. The delta is the dollars you were leaving on the table.

Common mistakes:

  • Defining “after-hours” inconsistently between vendor and your team
  • Counting calls that didn’t connect (some legacy systems hide drops in the data)
  • Mixing emergency and non-emergency calls (emergency intent converts higher; segment if possible)

Real example: A roofing company in Dallas had an 8% after-hours capture rate with voicemail. After AI deployment, it jumped to 79%. Their average ticket was $4,200. With ~6 after-hours calls per night, that’s roughly $19,000/week in new revenue exposure. Most of it converted.

Metric #4: Missed Call Rate (and Where They Went)

Definition: The percentage of inbound calls that hit voicemail, hung up before reaching a human or AI, or got an “all agents busy” message.

Formula: (Voicemail + abandons + overflow drops ÷ Total inbound call attempts) × 100

Why it matters: Missed calls are pure revenue leakage. Every missed call is a customer who almost certainly called your competitor next.

Benchmarks:

  • Poor (most contractors): 18–30% missed call rate
  • Average: 8–14%
  • Strong (AI-supported): Under 3%
  • Best in class: Under 1%

How to read the number: Pair missed call rate with your average ticket value to calculate annual revenue exposure. A 15% missed call rate on 200 calls/day with a $380 average ticket and a 50% close rate is roughly $1.04M in annual exposure. That’s not theoretical loss — that’s competitor revenue.

Common mistakes:

  • Trusting your phone provider’s “answer rate” stat (it often excludes abandoned-before-IVR calls)
  • Counting voicemail as “answered”
  • Not tracking the time-of-day distribution (missed calls cluster at lunch, after 5 PM, and weekends)

Real example: An electrical contractor in Atlanta thought their missed call rate was 4%. A third-party audit pulled raw call logs from the carrier and found the true rate was 19%. The difference: their phone system was counting calls that abandoned during the IVR menu as “answered.” After AI deployment, the true rate dropped to 1.2%.

Metric #5: Average Booking Value

Definition: The average revenue per booked job, broken down by intake source.

Formula: Total revenue from booked jobs ÷ Number of bookings, segmented by source (AI phone, CSR, walk-in, web form)

Why it matters: This is the metric that catches the silent killer: low-quality bookings. An AI phone that books 30% more jobs but books smaller, lower-value jobs might not be a win. You need to know what kind of jobs your AI is producing.

Benchmarks:

  • This is highly trade-specific — no universal benchmark
  • The right comparison is: AI-sourced bookings vs. CSR-sourced bookings vs. your historical average

How to read the number: Compare average booking value across intake sources for the same time period. If AI is booking at a meaningfully lower value, dig into why. Usually one of three things:

  1. AI is booking jobs CSRs would have qualified out
  2. Membership offers aren’t being made consistently
  3. Upsell opportunities (filter replacement, safety inspections, etc.) aren’t being captured

Common mistakes:

  • Only measuring booked revenue, not collected revenue (some jobs cancel)
  • Comparing AI booking value to CSR booking value without controlling for time-of-day (CSRs handle business hours; AI handles overflow + after-hours)
  • Ignoring lifetime value impact (a first-time AI-booked customer who becomes a 3-year recurring member has very different LTV than a one-time job)

Real example: An HVAC company in Phoenix initially saw AI bookings averaging $312 vs. CSR bookings averaging $397. They worried the AI was producing lower-quality work. Closer analysis: AI was capturing after-hours emergency calls that skewed toward small repairs. When segmented to comparable call types and times, AI booking value was within 4% of CSR — and the membership offer rate (a leading LTV indicator) was 22 points higher.

How to Build Your Own AI Phone Scorecard

If you take nothing else from this article, build the scorecard.

A clean scorecard, updated monthly, looks like this:

MetricBaseline (Pre-AI)Current MonthTarget
Call-to-booking conversion rate__%__%+10 pts above baseline
Cost per booked call$__$__-50% vs. baseline
After-hours capture rate__%__%65%+
Missed call rate__%__%Under 3%
Avg booking value (AI vs. CSR)$__ / $__$__ / $__Within 10%

Pull this report on the 5th of every month. Review it with your operations lead. If the AI phone is earning its keep, the scorecard will tell you in 5 minutes. If it isn’t, the same scorecard will tell you exactly where to dig.

The Bigger ROI Story

Five metrics tell you whether your AI phone investment is working. But the real ROI story for contractors is usually bigger than the metrics on this list, because it includes:

  • CSR redeployment value (moved from reactive to outbound revenue work)
  • Owner time recovered (no more triaging escalations personally)
  • Brand consistency across multi-location deployments
  • Insurance/property management contract retention (in restoration)
  • Recurring membership signup lift
  • Faster ramp on new locations or new service lines

Track the 5 metrics. Then keep an eye on the second-order effects. The first 90 days tell you whether the platform works. The first year tells you what it actually does to your business.

Want a custom ROI projection for your contracting business based on your current call volume? Start a free trial of Caller Technologies — free until the AI books your first paying job, and you’ll be building this scorecard on your own real data within the first month.

See the numbers for your own business with the ROI calculator, or compare plans on pricing.


See who’s calling before you say hello. The Caller Technologies AI voice agent answers 24/7, qualifies every caller with 150+ demographic signals — owner or renter, home value, income — and books real jobs while your crew works. Start your free trial — free until you book a paying job, no credit card.