Tech Reads
AI Strategy8 min read

When Not to Automate: The Decision Nobody Writes About

Four months into a supplier dispute resolution automation project, we stopped. The ROI model looked fine on paper. The technology worked. We stopped because the process we were automating was wrong — not technically, but economically. Nobody in the industry writes the article that says "don't automate this." This is that article.

Every AI and automation vendor has the same incentive structure: they get paid to build, so they advocate for building. We have the same incentive — we charge for implementations. Which is exactly why we have stopped three projects mid-build and told clients to walk away. Delivering a system the client should not have built is not a good outcome, even if the invoice clears.

What follows is the framework we use to decide whether an automation project is worth doing. It is not a complex framework. But it requires honesty about numbers that most project kickoffs do not produce.

The three conditions that make automation worthwhile

Automation earns its cost when three conditions are simultaneously true. They are rarely all three true at once, which is why most automation assessments produce optimistic forecasts and disappointing outcomes.

Volume: the process happens frequently enough that the fixed cost of automation is recovered by the cumulative savings across repetitions. The break-even calculation should use the actual current volume, not the projected future volume after growth. We have seen projects where the break-even assumed 3x growth that never materialised. Use what exists today, model growth scenarios separately, and be honest about which scenario is likely.

Consistency: the process behaves the same way most of the time. Specifically, the inputs are structurally consistent, the decision logic is documentable, and the exceptions are a minority of cases rather than the norm. A process where 60% of instances require human judgment is not a process to automate — it is a process to redesign. Automating it produces a system that handles the easy 40% and routes everything else to human review, which often creates more overhead than the process had before.

Cost of error: the consequences of an automation error are tolerable and recoverable. Automating a process where a single mistake costs $50,000 to correct requires a reliability standard that is expensive to achieve. The error rate calculation needs to include not just the probability of the error but the cost to detect it and the cost to fix it — including human time, customer impact, and regulatory exposure if applicable.

3 projectswe have stopped mid-build because the economics did not work — each one had passed an initial business case review

Processes that look automatable but are not

Supplier dispute resolution was the fourth project where we should have stopped sooner than we did. It looked automatable: structured claim forms, defined resolution criteria, a database of prior outcomes. We got three months in before we understood why the human team was so effective at it. The resolution process was not about the data in the forms. It was about relationship capital — knowing which suppliers would accept a partial credit without escalating, which ones needed a call from the procurement director, and which disputes were actually proxies for a renegotiation the supplier wanted.

Negotiation is the clearest category of un-automatable work. Not because AI cannot generate negotiating positions — it can — but because negotiation outcome depends on relationships, credibility, and the other party's read of the room. Automating the negotiation means the counterpart is now negotiating with a system that cannot make judgment calls. Suppliers and customers notice. The relationship cost of poorly handled disputes and negotiations regularly exceeds the labour cost of doing them manually.

Regulatory grey zones are another category where automation creates more risk than it removes. A process where the correct decision requires interpreting ambiguous regulations — or where the regulator's position on edge cases is not yet established — should not be automated. Not because the technology cannot produce an answer, but because the regulatory exposure for a systematic error across thousands of cases is categorically different from the exposure for a human making occasional judgment errors. The ZATCA e-invoicing rollout in Saudi Arabia produced months of grey-zone cases where clients who had automated their classification were reviewing and correcting at the same rate as clients who had not. We advised two clients to hold off on automating their tax classification logic until the regulatory guidance stabilised.

Exception handling that depends on relationships is a subtler version of the same problem. A three-way match exception where the discrepancy is $180 on a $90,000 PO is technically an exception case. In practice, a human AP clerk calls the supplier contact they have known for six years and gets it resolved in ten minutes. Automating exception handling for that kind of case requires building escalation logic, contact routing, communication templates, and response tracking — to replace a ten-minute phone call that works well.

Watch out

If the "exception rate" in your automation business case is above 20%, you are not automating a process — you are building an expensive routing system for work that still requires human judgment.

The sunk cost trap

The hardest moment to stop an automation project is after six months of work. The system is built. The demos are impressive. The team has invested time, political capital, and budget. Stopping now means admitting that the initial assessment was wrong.

We have been in this position twice with our own projects. The moment we recognised it in both cases was when the "go live" plan started requiring more exceptions handling, more manual review steps, and more human oversight than the original process had. The system was technically working. It just was not saving time — it was reorganising time. Same human hours, different tasks.

The sunk cost trap is particularly dangerous in AI and automation because the technology is genuinely impressive. A working demo generates enthusiasm that crowds out the economics question. The right question at month four is not "is this technically impressive?" It is "if we knew today what we know about this process, would we have started this project?" If the answer is no, the right decision is to stop — not to ship a system that will require ongoing maintenance to produce marginal value.

We have never regretted stopping an automation project that failed the economics test. We have regretted shipping two systems that passed the technical test but failed the economic one — both are still running, still requiring maintenance, and still not delivering the ROI the business case projected.

The question to ask before any automation project starts

One question does most of the work: "If we had to keep doing this manually forever, what would we change about how we do it manually?"

The answer reveals whether the process has structural problems that automation will inherit and amplify, or whether the process is fundamentally sound and automation will genuinely make it faster. Processes where the answer is "nothing, it works fine but it takes time" are good automation candidates. Processes where the answer is "we'd redesign the whole thing" need redesigning first. Automating a broken process produces a fast, consistent, expensive, broken process.

Our take

Before any automation scoping session, spend two hours mapping the current process with the people who actually do it — not the manager who oversees it. Ask where they get stuck. Ask what they know that the system does not. That conversation will tell you more about automation viability than any ROI model.
Share

Related reading