Skip to content

Call scorecardsAI

Every call graded against your checklist, with the quote to prove it.

AI grades recorded office calls, AI receptionist calls and consented in-home sales conversations against a scorecard you write, cites the exact line behind every score, and surfaces the calls that should have booked, so coaching starts from evidence instead of a hunch.

Call with Karen Baker · 4m 12s

CSR: Kim Alvarez · Booked

86

of 100

Greeted by company and own name

“Summit Heating and Air, this is Kim.”

Confirmed the service address

“Is that still 418 Maple Street?”

Offered the membership

Not mentioned on this call

Set an arrival window

“Between 10 and 12 tomorrow.”

Illustration: a recorded call graded against the shop's own scorecard

What it does

Everything call scorecards does for your shop

Your scorecard, your weights

Write up to 20 criteria per scorecard, each with a plain-English rubric and a weight from 1 to 10. One scorecard for CSR calls, one for in-home sales. Every save is a new version, and old grades keep the version they were graded with.

Evidence or it doesn't count

Every score must quote the transcript line it's based on. TradesWork checks each quote against that line; a score with no matching quote shows as Not counted and stays out of the overall score.

Should have booked

Calls that didn't book, that the AI judged winnable, and that weren't outside your area or for work you don't do, land on their own tab. That's your second-chance callback list.

Why calls didn't book

Each graded call records booked, not booked or not an opportunity, a not-booked reason (price, no availability, wants to think, shopping around and more), objections raised, and whether a membership was offered.

AI receptionist calls too

Calls answered by the AI receptionist can be graded on the same call scorecard as your CSRs, which shows exactly where the receptionist brief needs work.

In-home sales, with consent first

Technicians can record the kitchen-table conversation from the field app after the customer agrees. In all-party consent states the customer taps to agree on the screen. Audio is transcribed in pieces and never stored.

Coaching moments

Managers select up to 30 lines of a transcript and attach a note. The CSR or tech sees it on their own scorecard and marks it reviewed.

How it works

Step by step

  1. 1

    Turn on recording

    Choose a recording mode with the right consent notice in phone settings. Only recorded calls with a completed status can be graded.

  2. 2

    Write or adapt the scorecard

    Start from the default call scorecard (greeting, empathy, discovery, asks for the booking, membership offer, objection handling, closing) and edit the rubric and weights.

  3. 3

    Switch grading on

    In Settings › Phones › Call scorecards, turn grading on, choose the minimum call length (default 30 seconds) and the delay before grading (default 15 minutes).

  4. 4

    Coach from the insights page

    Each week, review should-have-booked calls, top objections and criteria averages, and flag one coaching moment per person.

Who it helps

CSR manager
Stop sampling five calls a week. Every recorded call is graded, and the ones worth a conversation are already sorted.
CSR
See your own scorecard, your 8-week trend and the exact lines your manager flagged, next to the team average. Never a teammate's calls.
Sales manager
In-home conversations graded on needs discovery, options presented, financing and asking for the decision, with the quotes behind each score.

What to measure

AI-verified booking rate
Calls the AI found booked ÷ graded opportunity calls. The insights page shows it next to the logged booking rate and counts mismatches.
Should-have-booked calls
Count of not-booked calls the AI judged winnable, per CSR, per week. The goal is a falling number.
Criterion averages
Average 0 to 4 score per criterion over 30 or 90 days. Coach the lowest-weighted-average criterion first.

Compared with ServiceTitan

How TradesWork call scorecards compares

ServiceTitan offers agent scorecards in Phones Pro, the same scorecards for its AI Virtual Agent, and custom scorecards for recorded in-home conversations in Field Pro, which records automatically on arrival. TradesWork grades against your own rubric with a verified quote behind every score and asks consent before any in-home audio.

 ServiceTitanTradesWork
CSR call scorecardsAgent scorecards in Phones ProYes, your own weighted rubric, AI-graded
AI receptionist calls scoredSame scorecards as CSRsYes, same call scorecard
In-home conversation scoringField Pro scores every call against your field processYes, with an in-home sales scorecard
In-home recording startAuto-records on arrival, with built-in consentStarts only after consent is logged; customer taps in all-party states

ServiceTitan details from its public help center and published pages; see sources below.

Most CSR coaching runs on two inputs: the manager's memory of a bad call and a five-call sample pulled on Friday afternoon. Say your booking rate slipped from 74% to 66% last month: neither one tells you why. Call scorecards grade every recorded call against a checklist you write, and they show their work.

What a graded call looks like

Take an example: a 4-minute call from Karen Baker about an AC that isn't cooling. Kim, the CSR, books it. The graded call shows:

  • Overall: 86 of 100.
  • Greeting (weight 1): Excellent. Quote: "Summit Heating and Air, this is Kim."
  • Discovery (weight 2): Good. Quote: "Is it blowing warm air, or not blowing at all?"
  • Asks for the booking (weight 3): Excellent. Quote: "I can get someone out between 10 and 12 tomorrow. Does that work?"
  • Membership offer (weight 1): Missed. Not mentioned on this call.
  • Outcome: Booked. Membership opportunity: yes, not offered.
  • Coaching notes: two to four specific suggestions, such as mentioning the Comfort Club when the customer says the unit is over ten years old.

The quotes aren't decoration. Each one is checked against the line it cites. If the AI claims Kim said something she didn't, that score is shown as "Not counted: no matching line" and stays out of the 86.

The default scorecards, and how to change them

TradesWork starts every company with two scorecards written for the trades. They're our own rubric, not a licensed sales script, and you're expected to edit them.

Call scorecardWeightIn-home sales scorecardWeight
Greeting1Rapport and agenda1
Empathy2Needs discovery3
Discovery2Findings explained2
Asks for the booking3Options presented3
Membership offer1Financing offered1
Objection handling2Membership offer1
Closing1Objection handling2
Asks for the decision2

Each criterion has a short key, a name, a rubric of up to 600 characters and the conversation types it applies to. The rubric is what the AI grades against, word for word, so write it the way you'd explain it to a new hire: "Offers a specific arrival window and asks the customer to confirm it. Saying 'someone will call you' does not count."

The membership offer on the call scorecard applies to human calls only, not AI receptionist calls, because you may not want the AI selling. Change that if you do.

Overall score

Σ (criterion score ÷ 4 × weight) ÷ Σ weight, over criteria that applied and had evidence, × 100

Saving creates a new version. Calls already graded keep the version they were graded with, so a rubric change doesn't rewrite last month's numbers, and trends follow each criterion's key across versions.

Which conversations get graded

Office calls. Inbound and outbound calls that were recorded and completed. Recording only starts after your consent notice plays, so a recording is itself the proof the notice played. Calls without one are skipped. Federal law allows recording with one party's consent, but several states require everyone on the call to agree, which is why TradesWork offers an explicit announcement for those states.1

AI receptionist calls. The AI receptionist tells callers the call is transcribed, and it keeps its own turn-by-turn transcript, so these calls can be graded even without a speech-to-text service. This is on by default once grading is on.

In-home sales conversations. Off until an owner turns it on. A technician assigned to the appointment taps record in the field app, and before any audio exists, the consent is logged: agreed or declined, how (customer tap or verbal yes confirmed by the tech), the state, and the exact wording shown. In all-party consent states, and wherever the state is unknown, the customer must tap to agree themselves. If they decline, nothing is recorded. Audio is uploaded in roughly five-minute pieces, transcribed straight away and never stored.

Skipped: voicemails, missed calls, calls under your minimum length (default 30 seconds), and calls whose transcript doesn't arrive within two hours.

The insights page

/conversations/insights is where the weekly coaching meeting starts. Filter to 7, 30 or 90 days, calls only or in-home only.

  • AI-verified booking rate next to the logged booking rate. If CSRs mark calls booked that the transcript says weren't, or the other way round, the mismatch count tells you.
  • Should-have-booked calls and missed membership offers: the two biggest piles of money left on the table.
  • Top objections: price, timing, need to think, spouse or partner, trust, other quotes, financing, warranty.
  • Why calls didn't book: price, no availability, wants to think, shopping around, decision-maker absent, outside service area, service not offered, caller ended.
  • Criteria averages and a people table.

Privacy and who sees what

Phone numbers and emails are replaced with [number] and [email] before a transcript reaches the AI. The audit trail stores scores and outcomes, not transcript text. CSRs and technicians see only their own conversations and their own scorecard with an 8-week trend next to the team average. Managers with coaching access see the team and can flag moments. Viewers see scores and line numbers, but no transcripts or quotes. Accounting has no access.

Graded calls also feed two office metrics in coaching: call score and AI booking rate.

How it compares to ServiceTitan

ServiceTitan's Phones Pro lists real-time call transcription and agent scorecards.2 Its AI Virtual Agent uses the same scorecards and dashboards as human CSRs.3 Field Pro auto-records every conversation on arrival "with built-in consent" and scores every call against your own field process.4

 ServiceTitanTradesWork
CSR scorecardsPhones ProYes, your rubric
Quote verified behind each scoreNot statedYes
AI calls graded like CSR callsYesYes
In-home recordingStarts on arrivalStarts only after logged consent
Manual score overrideNot statedNot built; re-grade only

Source: servicetitan.com/features/pro/phones and /features/pro/field

When it's not worth turning on

If you don't record calls and don't plan to, this has nothing to grade except AI receptionist calls. If you have one CSR and listen to most calls yourself, the insights page will tell you less than you already know. It earns its keep at two or more people answering phones, or once your techs are selling replacements in the home and you want to know why one closes at 45% and another at 20%.

Footnotes

  1. Digital Media Law Project, Recording phone calls and conversations. https://www.dmlp.org/legal-guide/recording-phone-calls-and-conversations ↩

  2. ServiceTitan, Phones Pro. https://www.servicetitan.com/features/pro/phones ↩

  3. ServiceTitan, AI Virtual Agent. https://www.servicetitan.com/features/pro/virtual-agent ↩

  4. ServiceTitan, Field Pro. https://www.servicetitan.com/features/pro/field ↩

Free download

Field Service KPI Scorecard

Track the 12 numbers that run a service business, week by week, with formulas already built in.

Get it free
  • 12 KPIs with definitions and formulas
  • 52-week tracker with trends
  • Targets and red / green flags
  • Per-technician view

Frequently asked questions

Every quote is checked against the transcript line it cites, ignoring only case and punctuation. If it doesn't match, the score is shown as Not counted and left out of the overall score. If the AI skips a criterion, the whole grade is rejected and retried.

Sources

Last reviewed October 15, 2026. Third-party sources are marked; some are written by competing vendors.

  1. 1.ServiceTitan: Phones Pro
  2. 2.ServiceTitan: Field Pro
  3. 3.ServiceTitan: AI Virtual Agent
  4. 4.Digital Media Law Project: Recording phone calls and conversations (third-party)

Ready to run a tighter shop?

Try TradesWork free for 14 days. Bring your customers and price book, or start fresh with a price book made for your trade.

  • No credit card
  • No contract
  • Cancel any time
Three workers in coveralls unloading equipment from a van