Most mid-sized companies that stall on an AI rollout did not pick the wrong model. They picked the wrong first problem, or they hired a partner who had never read a batch record. If you run a regulated manufacturer (pharmaceutical, device, dietary supplement, cosmetics, food) the second mistake is the expensive one, because your quality system has to be able to explain what the tool did and why you trusted it.
I have come to think the partner decision matters more than the licensing decision. Buying access to Claude is an afternoon. Deciding which records it may touch, who reviews its output, and how you will show an auditor that it behaves the same way next month is the real project. This article walks through how I would sequence a rollout, what a partner should be able to show you, and where regulated manufacturers get into trouble.
What does a Claude rollout actually involve?
A rollout has five parts, and a partner who only talks about two of them is selling you a demo.
- Use-case selection. Which workflows are worth automating, and which are too risky for a first pass.
- Data and access. What the model can see, where that data goes, and what the vendor agreement says about retention and training.
- Validation and controls. How you establish that the tool is fit for its intended use and stays that way.
- Training and change management. Who uses it, how they are taught, and what they are told not to do.
- Governance. Who owns the risk, who approves changes, and how you monitor performance.
Most vendors are strong on the first and fourth. Regulated manufacturers live or die on the third and fifth.
Where should a regulated manufacturer start?
Start where the work is high-volume, text-heavy, and reviewed by a human before anything is released. Two workflows fit that description better than almost anything else in a quality department: document control and batch record review.
AI for document control
Document control is mostly reading, comparing, and checking. Think of the tasks a document control specialist does every week: checking a revised SOP against the change request, confirming references to other procedures still point to the right revision, catching formatting and numbering errors, and summarizing what changed between versions for approvers.
ISO 13485:2016 clause 4.2.4 requires documents to be reviewed, approved, and controlled, and ISO 9001:2015 clause 7.5.3 asks for the same discipline around documented information. Neither standard says a person must do the cross-checking by hand. They require that the control is effective. A language model that flags a broken cross-reference before the approver sees the document is supporting that control, not replacing it.
The key design rule is that the model drafts and flags, and a qualified person approves. Keep the approval signature, and the accountability behind it, with a human.
AI for batch record review
Batch record review is the second candidate, and it is best run as a later pilot rather than the first (see below). Under 21 CFR 211.188, a batch production and control record has to document each significant step, and under 21 CFR 211.192 the production record review must determine that discrepancies have been investigated and resolved before a batch is released. Reviewers spend hours looking for missing signatures, out-of-range entries, uninitialed corrections, unexplained blanks, and calculations that do not match.
A model can do a first-pass read of a completed record and produce a list of exceptions for the quality reviewer to confirm. That is a screening aid. The batch disposition decision stays with quality unit personnel, which is where 21 CFR 211.22 places responsibility for approving or rejecting batches. Device manufacturers have an equivalent step in device history record review; under the QMSR it rests on the production and records requirements of ISO 13485:2016 (clauses 7.5.1 and 4.2.5), and the same screening-aid logic applies.
For that reason, start with document control, and I would not make batch record review your first pilot unless your record formats are already digital and consistent. Scanned handwritten records introduce an error source (reading handwriting) that has nothing to do with the language model, and you do not want to blame the wrong thing when results disappoint.
What I would keep out of phase one
- Anything that makes or recommends a release, rejection, or CAPA closure decision without a human reviewer.
- Complaint handling and adverse event triage, until you have run the lower-risk workflows long enough to trust your own validation approach.
- Anything where the model's output goes directly to a regulator or customer unreviewed.
What do the regulations say about using AI in a quality system?
There is no regulation titled "using a large language model in your quality system." What exists is a set of general requirements that apply to any software supporting regulated activity, and your partner should be fluent in them.
- 21 CFR Part 11, section 11.10(a) requires systems to be validated to ensure accuracy, reliability, consistent intended performance, and the ability to discern invalid or altered records. Section 11.10(e) requires secure, computer-generated, time-stamped audit trails for records created, modified, or deleted.
- ISO 13485:2016 clause 4.1.6 requires you to validate computer software used in the quality management system, proportionate to the risk, and before first use. Clause 7.5.6 covers validation of production and service provision processes, and the same risk-based thinking applies to software used there.
- 21 CFR Part 820 was amended so that the Quality Management System Regulation, which incorporates ISO 13485:2016 by reference, took effect on February 2, 2026 (final rule published at 89 Fed. Reg. 7496). Device manufacturers who have not mapped their software validation approach to clause 4.1.6 are now working against a live requirement rather than a coming one.
- FDA's final guidance on Computer Software Assurance for Production and Quality System Software, issued in September 2025 and available on FDA.gov, supports a risk-based approach that focuses assurance effort on software features that could affect product quality or patient safety. It is a useful framework for deciding how much testing a document-summarizing assistant needs compared with a tool that touches release decisions.
- ISPE GAMP 5 (Second Edition, 2022) gives a lifecycle and risk-based vocabulary many pharmaceutical auditors expect to hear.
For companies that sell into Europe, Regulation (EU) 2024/1689, the EU AI Act, adds obligations depending on how an AI system is classified and used. Most internal quality productivity tools will not be high-risk systems under that regulation, but your partner should be able to explain why, in writing, for your specific use.
A rollout in a regulated plant is defensible when the intended use is written down, the risk is assessed, the testing matches the risk, and a human remains accountable for the decision. Everything else is detail.
How do I evaluate an implementation partner?
Here is where I would push. Most proposals will list the same capabilities. The difference shows up in the questions you ask and how specific the answers are.
Questions that separate partners quickly
- "Show me a validation package you wrote for an AI-assisted workflow." Redacted is fine. You want to see an intended use statement, a risk assessment, test cases with acceptance criteria, and a plan for revalidation when the model version changes.
- "What happens when the underlying model is updated?" Model providers release new versions and retire old ones. A serious partner has a change control approach: pin the version where the platform allows (Claude models are served under specific versioned model identifiers, and Anthropic publishes deprecation schedules), rerun a regression set of representative documents, and record the result.
- "Which of our records would the model see, and where does that data go?" You want a data flow diagram and a reading of the vendor's commercial terms on retention and training use, not a reassurance. For Claude, that includes which deployment route you use (Anthropic's own platform or a cloud provider's) and the retention terms attached to it, which you should confirm against the current agreement.
- "Who on your team has worked in a GMP, ISO 13485, or similar environment?" The person reviewing your batch record prompts should know what a deviation looks like.
- "What do you do when the model is wrong?" Good answers involve measured error rates on your documents, defined escalation, and sampling plans. Bad answers involve the word "hallucination" followed by a shrug.
- "What do we own at the end?" Prompts, test sets, validation documents, and training materials should be yours.
Partner types compared
| Partner type | Strengths | Typical weaknesses for a regulated manufacturer | Best fit |
|---|---|---|---|
| Large systems integrator | Scale, enterprise IT integration, security teams | Generic playbooks, junior staff on the delivery team, little GMP or ISO 13485 context | Very large rollouts with heavy infrastructure work |
| AI-focused boutique or developer | Fast prototyping, strong prompt and tooling skills | Light on validation, change control, and audit readiness | Internal tools where regulated impact is low |
| Quality and regulatory consultancy | Knows the standards, auditors, and validation expectations | May need a technical partner for custom integrations | Mid-sized manufacturers whose main risk is compliance |
| Your own IT team | Knows your systems and data | Limited bandwidth, rarely has validation or AI governance experience | Narrow pilots with strong quality oversight |
| Hybrid (quality consultancy plus technical partner) | Covers both validation and build | Needs clear ownership of who is accountable for what | Most regulated mid-sized companies |
A note on self-interest: we are a quality and regulatory consultancy, so the table's lean toward that model is what you would expect, and you should discount it accordingly. Weigh the options by your regulatory exposure: the more your use cases touch release decisions, patient safety, or regulated records, the more weight validation experience deserves over build speed. On that basis, a mid-sized regulated manufacturer is usually best served by the hybrid model, with the quality-side partner owning the intended use statements, risk assessment, and validation, and a technical resource handling integration. If you do it the other way around, you tend to discover the compliance gaps at the first customer or regulatory audit.
How do I sequence the rollout?
I would use four phases, and I would resist the pressure to compress them. The week ranges below are illustrative, not benchmarks. Messy or scanned records, slow access approvals, a long security or legal review, or a high-risk use case that demands heavier validation will all lengthen them.
Phase 1: Readiness and use-case selection (weeks 1 to 4)
Inventory candidate workflows. Score each on volume, text intensity, regulatory impact, and the availability of a human check. Pick one or two. Document the intended use of each in a sentence a new hire could understand.
This is also the right moment to run a gap assessment against whatever framework you intend to govern AI under. If you are considering ISO/IEC 42001:2023, clause 6.1.2 requires an AI risk assessment process, and clause 6.1.4 addresses AI system impact assessment. Doing that work now gives you a structure for every later use case. We cover this in more depth on our ISO 42001 pages for GMP manufacturers.
Phase 2: Controlled pilot (weeks 5 to 10)
Build the workflow with a small group of trained users. Create a test set from real, de-identified or appropriately handled documents, including the nasty ones: the batch record with three late corrections, the SOP with a circular reference, the redline that changes a limit. Measure how often the model catches what a human reviewer catches, and how often it flags things that are not problems.
Both numbers matter. A tool that misses real exceptions is a risk. A tool that floods reviewers with false flags gets switched off by week six.
Phase 3: Validation and controlled release (weeks 11 to 16)
Match the depth of testing to the risk, which is what the FDA's computer software assurance guidance encourages. For a drafting assistant where a human reviews every output, lighter assurance may be appropriate. For anything that influences a release decision, expect more rigor, including documented acceptance criteria and a periodic review.
Write the procedures: how the tool is used, what users must not do, how output is reviewed, how errors are reported, and how model changes are handled. Train against those procedures and keep the records. Then extend the tool from the pilot group to the wider department.
Phase 4: Expansion and monitoring (month 5 onward)
Add use cases one at a time, each with its own intended use and risk assessment. Set a review cadence. Track exception detection rates, reviewer time saved, and reported errors. Feed those into management review, the same place ISO 9001:2015 clause 9.3 and ISO 13485:2016 clause 5.6 already expect quality data to go.
What are the common failure modes?
Treating it as an IT project. The IT team can deploy the tool. They cannot decide whether a missed exception on a batch record is tolerable. That decision belongs to quality, and the project should be sponsored there.
Skipping the intended use statement. Without one, you cannot define what "validated" means, and an auditor will notice immediately.
Ignoring model version changes. A workflow that passed validation on one model version is not automatically valid on the next. If your partner has no answer for this, keep looking.
Letting shadow use run ahead of the program. If employees are already pasting SOPs into consumer chat tools, your first deliverable is an acceptable use policy, not a pilot. Controlled access to a sanctioned tool is the cure for uncontrolled use.
Measuring only time saved. Speed is easy to show. Escaped errors are harder, and they are what auditors care about. Track both from the start.
Over-trusting confident prose. Language models write fluently when they are wrong. A reviewer who has gotten used to correct output will eventually accept an incorrect one. Sampling and periodic challenge tests, where you deliberately plant an error and see if it is caught, keep the human check honest.
What should the contract and governance look like?
Your agreement with the partner should name deliverables that survive the engagement: the intended use statements, risk assessments, test sets and results, procedures, training records, and a change control plan for model updates. It should say who is accountable for each, and it should leave your quality unit, not the partner, as the approver of record.
Governance does not need to be heavy. A small cross-functional group (quality, IT, operations, and someone from regulatory or legal) that approves new use cases, reviews performance data quarterly, and owns the acceptable use policy is enough for most mid-sized companies. If you later decide to pursue formal certification to ISO/IEC 42001:2023, that group becomes the core of your AI management system, and a specialist ISO 42001 consultant can help you map the work you have already done to the standard's requirements.
A short checklist before you sign
- The partner has written validation documentation for a regulated environment and will show you a sample.
- Someone on the delivery team has worked inside a GMP, ISO 13485, or comparable quality system.
- There is a written approach to model version changes.
- Data flows and vendor terms on retention and training use have been reviewed by your IT security and legal teams.
- Your quality unit signs off on intended use and validation.
- Prompts, test sets, and procedures belong to you.
- The first use case keeps a qualified human as the decision maker.
If a proposal cannot tick most of those boxes, the issue is not price. It is that the partner has not yet done this work in a plant like yours.
Last updated: 2026-10-12
Frequently Asked Questions
Does using Claude for batch record review require validation under 21 CFR Part 11?
If the tool creates, modifies, or maintains electronic records subject to Part 11, section 11.10(a) requires validation. If it only produces a screening list that a reviewer confirms and your official record is held elsewhere, the validation burden is usually lighter, but you should document that reasoning in a risk assessment. FDA's September 2025 computer software assurance guidance supports scaling effort to risk.
Can AI replace a document control specialist or batch record reviewer?
In a regulated environment it should not. Requirements such as 21 CFR 211.192 put production record review and disposition on the quality unit. A model can pre-screen documents and flag exceptions, but a qualified person remains accountable for the decision and the signature.
Do I need ISO/IEC 42001 certification before rolling out Claude?
No. ISO/IEC 42001:2023 is a voluntary management system standard. Many companies use its clause 6.1.2 risk assessment approach as a governance framework for their rollout without pursuing certification, and some pursue certification later.
What kind of implementation partner is best for a mid-sized regulated manufacturer?
Usually a hybrid: a quality and regulatory partner who owns intended use, risk assessment, and validation, working with a technical resource for integration. Large integrators and AI-only boutiques often lack GMP or ISO 13485 validation experience.
What happens to validation when the underlying model is updated?
A model update can change behavior, so it should go through change control. A sound approach pins the model version where possible, reruns a regression set of representative documents, records the results, and revalidates if performance falls outside acceptance criteria.
Jared Clark
Principal Consultant, Certify Consulting
Jared Clark is the founder of Certify Consulting, helping organizations achieve and maintain compliance with international standards and regulatory requirements.