AI READINESS ASSESSMENT

AI Readiness Assessment for Manufacturers

By Jason Osajima — former VP of AI at a $250M manufacturer · LinkedIn ·
Quick answer

An AI readiness assessment for manufacturers from an operator who shipped it: the 4 pillars, a scoring rubric, and the data/access gaps that kill projects.

An AI readiness assessment for manufacturers is a structured check of whether a green-lit AI project will actually ship to production or stall after the demo. It scores four things: the quality of your master data, whether agents can read and write to your systems of record, which workflows are worth automating, and whether a named human owns each one. The lowest score is your real ceiling, and for most mid-market plants it's data or integration access, not the AI model.

I ran AI into production at a $250M manufacturer, and I've watched plenty of plants spend six figures discovering after the fact what a one-week assessment would have told them up front. The data backs up the caution. MIT's NANDA initiative found that roughly 95% of enterprise generative AI pilots deliver no measurable P&L impact (2025), and the root cause was organizational, not technical. This is the assessment I'd run before spending a dollar.

Why most AI projects stall before production

The failure rate is not a rumor, and it's getting worse, not better. Gartner predicted that at least 30% of generative AI projects would be abandoned after proof of concept by the end of 2025, citing poor data quality, weak risk controls, and unclear business value.

Agentic AI is no safer by default. Gartner now projects that over 40% of agentic AI projects will be canceled by the end of 2027 for the same reasons. None of those reasons is "the model wasn't smart enough."

Here's the pattern I see on the floor. The demo works on a clean slide deck. Then someone tries to wire it into the real ERP, the real item master, the real exception queue, and the whole thing falls apart. A readiness assessment surfaces those landmines in week one instead of month three. If you want the deeper version of why pilots die, read why AI pilots fail at manufacturers.

What an AI readiness assessment actually checks

Forget maturity-model wall charts with 47 dimensions. For a mid-market manufacturer, readiness comes down to four pillars. Score each one honestly, because the lowest score is your real ceiling.

A 9-out-of-10 on strategy and a 2-out-of-10 on data access gets you a 2. That math is the whole point of the exercise.

Pillar 1: Data readiness

AI agents are only as good as the data they read. Dirty data doesn't break the demo. It breaks production, quietly, three months in.

This pillar isn't a Takumi opinion. Deloitte's 2025 survey found that nearly 70% of manufacturers name data problems, including quality and contextualization, as the biggest obstacle to AI. For a full inventory of what to check, use our data readiness for AI checklist.

Pillar 2: Systems and integration access

This is the pillar that quietly fails the most projects, and the one vendors gloss over. The question is whether an agent can read and write to your systems of record.

If an agent can't write its decision back into the system of record, it's a research tool and a human still re-keys everything. No write-back, no production. Settle this in week one, not week twelve. The mechanics of doing it right are covered in integrating AI agents with your ERP and MES.

Pillar 3: Process fit

Not every workflow is worth automating. The assessment ranks candidate workflows by automation value across four dimensions.

Dimension The question What good looks like
Volume Transactions per month? High and repeating
Handle time Minutes per touch? Long enough to matter
Exception rate Where do humans spend time, clean flow or exceptions? Exception-rich
Rule clarity Can you describe the decision logic? Articulable, not pure tribal knowledge

The sweet spot is high volume, high handle time, exception-rich, with decision logic you can actually describe. If you can't name the rule, an agent can't follow it.

Pillar 4: People and ownership

The pillar everyone skips, and the one MIT pinned the failure rate on. Agents without owners drift.

This is why IT-led pilots get adopted by nobody. The fix is structural, and we go deep on it in AI change management for plant and ops teams.

A scoring rubric you can run this week

Score each pillar 1 to 5. Your readiness is gated by the minimum, not the average. Here's the rubric I use.

Score Data Integration Process fit People
1 Master data a mess, no idea of duplicate rate No API, no path, locked systems Can't name a high-volume workflow No owner, no bandwidth
3 Master data usable, some cleanup needed API exists, write-back access takes weeks Candidate workflows identified, logic partly tribal Owner exists but stretched
5 Clean master, cross-refs mapped, unstructured mapped Read/write access available now Top workflow baselined, logic documented Named owner, willing team, bandwidth allocated

How to read your score:

The three gaps that actually kill projects

Across the plants I've seen, the same three readiness gaps account for most failures. Notice that none of them is about the model.

  1. Dirty master data. The agent surfaces every wrong lead time and duplicate SKU. "AI failed" is often "your data was always wrong, and now it's visible." Gartner expects organizations to abandon 60% of AI projects unsupported by AI-ready data through 2026.
  2. No write-back access. Writing decisions back into the ERP is the hard, unglamorous part. Teams discover the permission wall in month three instead of week one.
  3. No owner. A workflow with no human owner gets an agent nobody tunes, trusts, or adopts.

The model is the easy part now. Readiness is about your data, your access, and your people. McKinsey's 2025 research reaches the same conclusion: workflow redesign, not model choice, has the biggest effect on whether a company sees EBIT impact from AI.

How to run the assessment in one week

You don't need a consultant for the first pass. You need a calendar, a few exports, and a willingness to be honest about what's broken.

Day 1-2: Pull the evidence

Day 3-4: Score and rank

Day 5: Decide the next dollar

For a heavier governance layer once you're past the floor, map your controls to a recognized framework. The NIST AI Risk Management Framework (2023) gives you Govern-Map-Measure-Manage functions, and ISO/IEC 42001:2023 defines a full AI management system if you need certifiable structure for customers or auditors.

Readiness assessment vs. jumping straight to a pilot

Skip the assessment Run the assessment first
Time to start Faster (days) 1-2 weeks slower
Risk of stall High Low
Cost of failure Six-figure dead pilot One week of analysis
Knows its first agent Guesses Ranked, evidence-based
Finance buy-in Hard (no baseline) Easier (gated plan)

The one to two weeks an assessment costs is the cheapest insurance you'll buy on the whole program. Once you've scored ready, the next step is sequencing, and the AI adoption roadmap for mid-market manufacturers lays out what to build first, second, and third.

Get your readiness scored for free

If you run ops or IT at a $100M-1B manufacturer, the smartest first move isn't picking a vendor. It's scoring your readiness across these four pillars so you know whether your next AI dollar will ship or stall.

Our free First 5 Agents teardown does exactly that. We run the readiness assessment on your real data, systems, and workflows, then name the five agents that pay back first for your operation. Book a 30-minute call and bring a sample of your item master and one workflow's exception report. You'll leave with a readiness score and a ranked shortlist, not a sales pitch.

Frequently asked questions

What is an AI readiness assessment for manufacturers?

It's a structured check of whether an AI project will reach production instead of stalling after a demo. It scores four pillars: data quality, systems and integration access, process fit, and people and ownership. The lowest pillar score, not the average, sets your real ceiling, so the assessment tells you exactly what to fix before you spend.

How long does an AI readiness assessment take?

A focused first pass takes about one week. Days one and two are spent pulling evidence like an item-master export and a 90-day exception report, days three and four scoring and ranking candidate workflows, and day five deciding where the next dollar goes. A full external assessment with stakeholder interviews typically runs one to two weeks.

What is the most common AI readiness gap in manufacturing?

Dirty master data and missing write-back access tie for first. Deloitte found nearly 70% of manufacturers cite data problems as their biggest AI obstacle, and integration permissions are the second wall teams hit. Both are invisible in a demo and fatal in production, which is why the assessment forces you to measure them in week one.

Do we need to be AI-ready before running a pilot?

You need a minimum pillar score of 4-5 to scope a 90-day pilot with confidence. A score of 3 means fix the gating pillar first, usually integration access or master data, before building anything. A score of 1-2 means a pilot will stall, so the next dollar should go to the data or access floor instead.

How does an AI readiness assessment differ from a maturity model?

A maturity model rates where you sit on a long, abstract spectrum, often across dozens of dimensions. A readiness assessment is a go/no-go decision tool built around four pillars and a single gating score. The output isn't a grade; it's a ranked list of workflows and the specific gap to fix before you spend.

Let's see what's worth building first.

A 15-minute call: tell me where your AI or planning is stuck, and I'll tell you the one thing worth building first — and whether it's worth doing at all.

More field notes

An AI Strategy Playbook for the Manufacturing COOHow to Prioritize Your First AI Use CaseAI Change Management for Plant and Ops TeamsThe AI Maturity Model for Manufacturing Ops