20 Guide

AI voice agents for follow-up

I shipped a voice agent for a roofing company. It does one thing extremely well and several things badly, and knowing which is which is the entire design.

A voice agent’s real advantage is not intelligence, it is availability. It answers in one ring at 9pm on a Sunday and asks the same three qualifying questions every time. Most inbound leads are lost to response time rather than to a bad conversation, and that is a problem a machine solves completely. Everything else about the design is about limiting what it tries to do.

The actual value

Speed. That is it, and it is enough.

A lead who calls a contractor and reaches voicemail calls the next contractor. The conversation quality that would have happened at 9am on Monday is irrelevant, because by then they have booked someone else. An agent that answers immediately and takes the job details has already captured most of the available value before it says anything clever.

The second-order benefit is consistency. A human answering the phone while on a roof asks two of the five questions. An agent asks all five, every time, and writes them down. That is not glamorous and it is where the compounding is.

What it does well

JobWhy it works
Answer instantly, any hourThe whole ballgame for inbound
Ask a fixed qualifying setNever skipped, never reordered
Capture details accuratelyWritten down while being said
Answer routine questionsHours, service area, whether you do X
Take a callback requestBetter than voicemail by a wide margin

What breaks it

Anything off-script. A caller who wants to explain a complicated situation, or who asks something the agent has no tool for, will get a fluent and confidently wrong answer. This is the failure that damages trust, because it sounds authoritative.

Real-world audio. Wind, a job site, a car, a speakerphone, an accent the recogniser handles poorly. Recognition degrades and the agent starts responding to what it thought it heard. Design for mishearing as a normal condition, not an exception.

Emotional calls. Somebody with water coming through their ceiling does not want a qualifying sequence. Route urgency to a human immediately, and make the urgency detection generous — a false positive costs you a phone call, a false negative costs you the customer.

Anything with money attached. Quoting, discounting, negotiating. An agent that guesses a price has made a commitment on your behalf.

Design the handoff first

The most common mistake is treating human handoff as the failure case. It should be a normal, well-lit path that the agent takes readily.

  • Explicit request. If the caller asks for a person, transfer immediately, with no attempt to resolve it first. Every extra turn here is a customer being annoyed.
  • Repeated misunderstanding. Two failed attempts at the same question is the ceiling. A third try does not fix an audio problem.
  • Anything outside the tool set. If the agent cannot actually do the thing, it should say so and hand over rather than discuss it.
  • Detected urgency or distress. Bias heavily toward transferring.

And when nobody is available to take the handoff, the agent should say that plainly and take a message with a real commitment about when someone will call. “I’ll have someone call you before 10am tomorrow” is a promise you can keep. Vagueness here is what makes people call your competitor anyway.

Disclosure

Say it is an AI, in the first sentence.

Callers work it out quickly regardless, and the moment of realisation is much worse if they feel it was concealed. Stated up front, most people simply adjust — they speak more clearly, they keep answers short, and they are notably tolerant of a machine that is obviously a machine and actually useful.

There are also disclosure rules in some jurisdictions, and call recording has its own requirements that vary by state and country. Check what applies where you operate before launching, not after.

Booking directly

Only against a real calendar with real availability rules, and only for simple appointments.

The failure mode is specific: a confidently booked slot that does not exist, or a double booking. That is worse than taking a message, because now you have a customer expecting you at a time you cannot make. If your scheduling has any real complexity — travel time, crew skills, equipment — have the agent capture the request and let a human place it.

Build notes

  • Keep the tool surface tiny. Check availability, capture a lead, transfer, take a message. Four things done reliably beat twelve done sometimes.
  • Never let a tool call await a long job. Silence on a phone call is much worse than silence in a chat. Anything slow needs to happen after the call, not during it.
  • Log the transcript and what the agent did. Most improvements come from reading calls that went badly, and you cannot do that without recordings you are entitled to keep.
  • Write the failure line. Give the agent an explicit sentence for “I do not know,” or it will invent something.
  • Test with bad audio deliberately. Call it from a car. That is the real condition.

FAQ

What is it good at?

Answering instantly at any hour and asking the same qualifying questions every time. Response speed is where most inbound leads are lost.

Will callers know?

Usually within a sentence. Say it up front — concealment is a bad trade, and disclosure rules may apply where you operate.

What breaks it?

Off-script questions, real-world audio, emotional calls, and anything involving price. Make handoff a first-class path.

Should it book directly?

Only against real availability and only for simple bookings. A confidently booked slot that does not exist is worse than a message.

Related: AI phone agent vs answering service, AI phone agents for roofing, and AI agent development.