The most expensive AI tool in your business probably isn't on any invoice. It's the person checking its output.

Every AI pitch counts the hours a tool saves. Hardly anyone counts the hours spent reading what it produced, fixing the bits that are wrong, and redoing the bits that were confidently made up. That second number now has a figure on it, and it isn't small.

The numbers, from 12 October

Pax8, a cloud software distributor, published its Q3 2026 SMB AI Pulse Report on 12 October [1]. It surveyed 1,150 decision-makers at firms with 5 to 499 staff across the US, UK, Germany and Sweden, including 350 in the UK. The findings:

  • 69% of AI-engaged businesses say AI has freed up at least some capacity.

  • 55% of decision-makers spend three or more hours a week reviewing, editing or fact-checking AI-generated work. 7% spend ten or more.

  • 35% found AI tools, workflows or agents running without approval in the past six months.

  • 49% of those paying for AI had at least one bill or usage charge higher than expected.

  • Formal, documented review of AI the business has built itself ranges from 45% in Sweden down to 23% in the UK, the lowest of the four countries.

A caveat before anyone quotes this at a board meeting: Pax8 sells AI and cloud services through IT providers, so it has an interest in the answer being "you need help managing this". The UK margin of error is about ±5 points. Compare the Cloud's write-up gives UK-only splits for some figures (44% spending three-plus hours checking, 24% finding unapproved AI) that Pax8's own release doesn't break out, so treat those as reported rather than verified [2].

Even allowing for that, the shape is clear. AI is now ordinary: the ONS says 30% of UK businesses used at least one AI technology in September, up from 9% three years earlier [3]. The checking has grown with it, and in most businesses it sits nowhere in the numbers.

From the people doing the checking

The best evidence isn't in a survey. It's in what accountants say about their clients.

"An AI tool linked to Xero misclassified items and invented commentary." That's from AccountingWEB's editorial piece of 3 August 2026, "Accountants count the cost of clients' AI use", where Dom Noakes of HaysMac described what a client's AI add-on had done to their books [4]. Another practitioner described a client's AI-converted cash book with numerous transactions simply missing.

The 26 comments underneath are blunter. One reader (4 Aug) described AI "balancing" a set of books by inventing offsetting errors, and said AI-assisted clients had doubled the time it took to prepare their VAT returns. Another said AI-assisted data entry can double the fee because of the correction work. A third described an automated QuickBooks query email that wrongly accused a client of misreporting a foreign-currency transaction, and the apology that followed.

The survey behind that article was commissioned by Dext, which sells bookkeeping automation, and run by Censuswide in December 2025: 500 UK accountants and bookkeepers, half of whom had seen clients lose money after acting on incorrect AI advice. Most of those who meet these errors spend up to ten hours a month correcting them [5]. It's vendor-funded and ten months old, so take the direction, not the decimals.

And the question at the heart of all this was asked on UK Business Forums back in June 2023, in a thread titled "Do you encourage your team to use ChatGPT?" (old, but it has aged well). After several members described factually wrong answers, one asked whether having to verify everything elsewhere defeats the productivity gain [6]. Three years on, most firms still can't answer that with a number.

Run the sums on one firm

Take an 80-person wholesaler. Its finance and sales teams use AI for four jobs. Here's what each one looks like if someone writes down the time honestly for a month:

Use case

Hours saved a week (gross)

Hours checking

Hours fixing

Net hours a week

Customer email drafts

10

3

1

6

Supplier invoice coding

8

2

1.5

4.5

Sales call notes to CRM

5

0.5

0.5

4

Month-end variance commentary

4

3

2

-1

Total

27

8.5

5

13.5

Illustrative figures, not survey data.

The vendor dashboards would say 27 hours a week. The truth is 13.5. Half the time "saved" goes on checking and fixing.

At a loaded cost of £35 an hour over 46 working weeks, that's the difference between about £43,500 a year of claimed value and £21,700 of real value. Still worth having. But one line costs more than it saves: the month-end commentary, where the person checking has to rebuild the reasoning from scratch because the AI wrote a plausible explanation for a margin dip that didn't match the ledger.

That's the one to fix or switch off, and nobody would know without the table.

The build: an AI ledger

This is a small model in Power BI or Excel, built in about two days, and it treats AI like any other cost centre: what it consumes, what it produces, how often it's wrong.

1. Sources

  • An AI use register (one sheet, kept by hand): use case, tool, business owner, what data it touches (customer, financial, personal), approved yes/no, and the review level required (every item, a sample, or none).

  • A sampled check log: each week, the reviewer for each use case records items produced, items checked, items corrected, minutes spent, and a severity for each correction (cosmetic / wrong but caught / would have reached a customer, HMRC or the bank). A Microsoft Form or Google Form feeding a sheet is enough.

  • A monthly two-question pulse to users: "Roughly how many hours did this save you?" and "How many did you spend fixing it?"

  • Spend and shadow-AI signals: card and bill lines from Xero or QuickBooks matched to a list of AI vendors, plus the enterprise app consent list from Entra ID (Microsoft 365) or the third-party app access report in Google Workspace. If you built a software spend tracker for the Copilot meter, reuse its vendor table.

2. Model

  • Dim_UseCase (use case, tool, owner, data class, approved, review level)

  • Fact_Checks (week, use case, produced, checked, corrected, minutes, severity)

  • Fact_Pulse (month, use case, hours saved, hours fixing)

  • Fact_AISpend (month, vendor, amount, approved flag)

  • Dim_Date

3. Measures

  • Net hours saved = gross hours saved − checking hours − fixing hours. This is the headline.

  • Checking ratio = (checking + fixing) ÷ gross saved. Above 50% means the tool is mostly creating work.

  • Error rate = items corrected ÷ items checked, by use case, trended weekly.

  • Severe error rate = corrections that would have reached a customer, HMRC or a lender ÷ items checked. One of these matters more than fifty typos.

  • Cost per net hour = AI spend for the use case ÷ net hours saved.

  • Unapproved AI spend = spend on vendors not in the register.

4. Alerts

  • Any severe error: the owner hears the same day.

  • Error rate above your threshold (say 5%) for two weeks running.

  • Checking ratio above 50% for a month.

  • A new AI vendor appears on a card or bill, or a new AI app gets user consent.

5. Dashboard

One page is enough: a keep / fix / kill grid with net hours saved on one axis and severe error rate on the other, each use case as a dot, plus a table underneath with owner, review level and cost per net hour.

Sampling, not surveillance. You don't need to check everything. Start by checking 20 items in every 100 for a new use case. When the error rate has stayed low for a month, drop to 5 in 100. When it rises, go back up. Auditors have worked this way for decades, and it turns "we trust it" into "we checked 400 of them and found 3".

Caveats. The pulse hours are self-reported and soft: use them for direction, not decimals. Keep the check log about the output, not the person, or it becomes a performance tool and people stop logging honestly. And if staff names go into the log, your privacy notice needs to cover it.

The no-build version

Not going to build a model? Do these this month:

  1. List every AI tool in use. Ask the team, not IT: shadow AI won't be in IT's records.

  2. Give each one a named owner and a review rule: every item, a sample, or none.

  3. Ban unchecked AI output from anything that goes to HMRC, a lender, an auditor or a customer contract.

  4. For two weeks, have each owner jot down the time spent checking and fixing. Compare it with the hours the tool claims to save.

  5. Switch off, or change, any use case where checking and fixing take more than half the time saved.

  6. Check last quarter's card statements for AI subscriptions nobody approved.

How this backfires

Measuring hours and ignoring severity. A tool that saves ten hours and once a quarter sends a wrong figure to the bank isn't a ten-hour win. Weight the severe errors.

Checking everything forever. Full review on a mature, low-risk use case is waste, and it's how a good tool gets a bad reputation. Let the sample rate fall as the evidence builds.

Blaming the tool for a process problem. If invoice coding errors cluster on three suppliers with messy master data, fix the data. The AI is just finding the mess faster.

Turning the log into a stick. The first time someone gets told off because the log showed they spent four hours fixing AI output, the log goes quiet. Reward the people who find errors.

Before you go

AI isn't failing small businesses. It's being measured on the half of the ledger that flatters it. Put the checking time next to the time saved and most firms will find two or three use cases that pay off handsomely, and one that's quietly costing them a day a week.

If you'd like that picture drawn properly, covering your tools, data and controls with a keep / fix / kill list at the end, that's what our AI & Analytics Maturity Audit does. Reply and I'll send the outline.

— Aksel

Sources

  1. Pax8, "Pax8 publishes new quarterly SMB AI Pulse Report" (Q3 2026; 1,150 respondents at firms with 5–499 staff in the US, UK, Germany and Sweden; UK n=350, ±5.2 points), 12 Oct 2026. https://www.pax8.com/en-us/?p=64797

  2. Compare the Cloud, "Only 23% of AI-engaged UK small businesses formally review the AI they build, Pax8 survey finds", 13 Oct 2026. https://www.comparethecloud.net/news/only-23-of-ai-engaged-uk-small-businesses-formally-review-the-ai-they-build-pax8-survey-finds

  3. ONS, "Business insights and impact on the UK economy: 8 October 2026" (official statistics in development). https://www.ons.gov.uk/businessindustryandtrade/business/businessservices/bulletins/businessinsightsandimpactontheukeconomy/8october2026

  4. AccountingWEB, David Prosser, "Accountants count the cost of clients' AI use" (editorial, with reader comments 3–10 Aug 2026), 3 Aug 2026. https://www.accountingweb.co.uk/practice/general-practice/accountants-count-the-cost-of-clients-ai-use

  5. Dext, "UK businesses losing money to ChatGPT-style tax and financial advice, accountants warn" (Censuswide survey of 500 UK accountants and bookkeepers, vendor-commissioned), 18 Dec 2025. https://dext.com/en/news/uk-businesses-losing-money-to-chatgpt-style-tax-and-financial-advice-accountants-warn

  6. UK Business Forums, "Do you encourage your team to use ChatGPT?", 29–30 Jun 2023 (older thread). https://www.ukbusinessforums.co.uk/threads/do-you-encourage-your-team-to-use-chatgpt.422951/