Every AI ROI claim you have ever read had a baseline behind it, or it was made up. Before we build anything for a client, we spend a short, unglamorous stretch measuring how the workflow runs today. This is the method, step by step, with a hypothetical example so you can run it yourself before you talk to any vendor.
Why baseline first
WRITER's 2026 research found 79% of organizations face challenges adopting AI, and Anaconda and Forrester research puts the share of agent pilots that never reach production at 88%. A large part of that gap is that nobody defined what "working" meant before the pilot started, so nobody could prove it worked.
Our rule is that hours are the honest currency. Not "efficiency," not "productivity," not a percentage from a slide. Hours of human work the workflow consumes today, and hours the system absorbs after.
Step 1: pick one workflow
Not a department. One workflow with a clear trigger and a clear end state. "Handle inbound quote requests from the website form until a quote is sent" is a workflow. "Improve sales" is not.
Good candidates happen often, follow a recognizable pattern, and someone on your team is visibly tired of them. Pick the one whose owner can describe the steps without hesitating.
Step 2: count the volume
How many times did this workflow run last month? Pull it from the system that triggers it (form submissions, tickets, invoices received), not from memory. If you cannot count it, you have found your first problem.
Distribution matters too: twenty runs a day on weekdays with spikes on Monday is a different automation problem from six hundred runs on the first of the month.
Step 3: time each step
Break the workflow into its steps and time each one across several real runs. You are looking for two numbers per step: the active handling time and the wait time before the next step starts.
Wait time is where most of the money hides. A quote that takes 20 minutes of active work but sits in an inbox for two days is a two-day workflow, and the customer experiences it that way.
Step 4: find the leak
Multiply volume by per-step time. Which step consumes the most hours per month? Which has the longest wait? Those are usually different steps, pointing to different solutions.
- Highest active hours: candidate for automation or an agent.
- Longest wait: candidate for a response-time fix, which may be as simple as routing.
- Highest error rate: candidate for a validation step before anything else.
Step 5: name the metric
Pick one primary metric that the build must move. Hours absorbed per month is the default. For customer-facing workflows, time-to-first-response is often more valuable, because revenue follows response time: leads answered in minutes tend to convert better than leads answered in days. Pick one secondary guardrail metric that must not get worse, such as error rate or customer complaints.
Write the metric down with its current value and the date. This becomes the "before" line on every future report.
Step 6: set the exit criteria
Before building, decide what ends the pilot. Two explicit outcomes:
- Scale: the metric moves by at least X within Y weeks and the guardrail holds. Roll it out to the next workflow.
- Stop: it does not. Shut it down, write up why, and keep the baseline for next time.
A pilot without a stop condition is a subscription.
A worked example (hypothetical)
Suppose a 12-person marketing agency receives about 90 inbound project inquiries a month through its website form. This is an illustrative scenario with invented numbers, not a client result.
Timing five real runs, the team finds:
- Reading the inquiry and checking fit: 6 minutes active, average 9 hours wait.
- Looking up past similar projects for pricing: 15 minutes active.
- Drafting a tailored reply: 20 minutes active, average 26 hours wait.
- Logging in the CRM: 4 minutes active, frequently skipped.
Active handling is about 45 minutes per inquiry, or roughly 67 hours a month. Time to first response averages about a day and a half. The leak is the reply draft: high hours and the longest wait.
The metric: hours absorbed per month, with time-to-first-response as the secondary. The guardrail: no increase in replies the account lead has to rewrite. Exit criteria: absorb at least 40 hours a month within six weeks with first response under two hours, or stop.
The build that fits: an agent that reads the inquiry, retrieves the three closest past projects, drafts a reply, and queues it for a human to approve, with automatic CRM logging. The human stays in the loop exactly where the judgment is.
Instrument cost per task, not cost per license
Once the system runs, measure what each automated task costs: model usage, retrieval calls, infrastructure, and any human review time. Cost per task lets you compare the system against the baseline hours honestly, and tells you when a cheaper model tier is good enough.
Anthropic's Claude Opus 5, released July 24, 2026, is described by Anthropic as coming close to the frontier intelligence of Claude Fable 5 at half the price. If your evaluation shows the cheaper tier passes on your real inputs, the cost-per-task math changes immediately.
What "measured, not claimed" means
The report you show leadership has a before column and an after column, from the same counting method, with dates. The ROI figure is a division of two numbers you can show, not an estimate from a vendor deck. And the pilot can fail visibly, which is the only way successes are believable.
What to do this quarter
- Choose one workflow with a clear trigger and end state.
- Pull last month's volume from the source system.
- Time each step across at least five real runs; record active and wait time separately.
- Compute total hours per month per step and identify the leak.
- Write down the primary metric, the guardrail, and the current values.
- Set scale and stop criteria with a deadline before any build starts.
- Plan cost-per-task instrumentation as part of the build, not after.
How XISLABS approaches this
Baselining is the first deliverable in most of our engagements, whether the eventual build is AI automation, an AI agent, or a broader AI consulting roadmap. We prove value on one workflow, then scale with evidence, and every system we ship includes cost-per-task instrumentation and evaluation before launch. Human-in-the-loop is a design choice, not an afterthought.
For teams that want that measurement built in without standing up their own infrastructure, My Cloud Company runs managed agents with approval gates, hard budget caps, an audit trail, and a weekly report. If you already have a workflow in mind, send it to us with your best guess at the monthly volume, and we will help you run the baseline.
Sources