I work in a Class II device shop with a small QA/RA team and a backlog of CAPAs. The slowest part of an investigation isn’t the lab work — it’s the paperwork: manually typing incident summaries, hunting for related records, and drafting half-baked root-cause hypotheses that then get edited into oblivion. Over the last 9 months I’ve been experimenting with AI-assisted autofill in our QMS forms to speed investigations without degrading auditability. This is what worked (and what I guarded against).
Why autofill helps — and what it must not be
Forms are where quality data begins (and where errors usually start). Smart autofill speeds entry by:
- Reducing repetitive typing (incident summary, affected lot numbers, timestamps).
- Surfacing related records so you don’t miss prior CAPAs, complaints, test reports.
- Giving investigators a structured starting point for root-cause brainstorming.
But in a regulated environment you can’t allow opaque suggestions. The assistance must be controlled, reviewable, and traceable — think “AI-assisted draft” that a named investigator must accept and justify before it becomes part of the controlled record (ISO 13485, 21 CFR part 820 expectations on record integrity).
Practical walkthrough: from trigger to accepted CAPA draft
Here’s a step-by-step pattern I used. YMMV depending on your eQMS and whether you have an internal model or an external LLM.
- Trigger
- Source: a complaint intake form, a Jira bug labeled "customer-impact", or a supplier NCR.
- Action: webhook sends minimal context (record ID, short summary, product/SKU, dates).
Example webhook payload (generic):
{
"source": "complaint_form",
"record_id": "C-2026-0421",
"summary": "intermittent power loss during use",
"product_sku": "MD-110",
"lot": "L-2026-03",
"timestamp": "2026-08-05T14:22:00Z"
}
- Intake & autofill
- QMS receives webhook, pulls linked metadata (device history, previous CAPAs for MD-110, recent supplier shipments).
AI assistant populates a new CAPA draft: incident summary (polished), affected product/lot fields, suggested severity classification, list of related records, and a first-pass list of possible root causes in plain-language bullets.
Investigator review
The investigator sees the draft in a “suggestions” area. Each suggested field shows provenance (e.g., “auto-suggested from complaint C-2026-0421” or “matched to CAPA 2025-117 by similarity”).
Required actions: edit/accept/reject each field. The system logs which suggestions were accepted, who accepted them, and when.
Link & enrich
Investigator uses one-click linking to related documents (test reports, complaint trend charts, supplier certificates).
The assistant can propose a shortlist of records (ranked by similarity score), but only the investigator links them.
Lock & create controlled record
Once accepted, the CAPA form becomes a controlled record with the normal approval workflow. The AI suggestions remain stored as an auditable draft.
There’s a short demo I referenced while building this workflow that shows a similar flow: https://www.youtube.com/watch?v=UoErqQW-hOo
What to autofill (practical field list)
Start small. These fields give the best ROI for saved time and reduced errors:
- Incident summary (one-paragraph draft)
- Affected product/SKU, lot/batch numbers, serial numbers
- Event dates/times (from intake metadata)
- Linked records suggestions (previous CAPAs, complaints, deviations, test reports)
- Initial severity and risk-level suggestion (checkbox picklist, investigator must verify)
- Initial “possible root causes” bullets (short, nonconclusive phrases)
Avoid autopopulating final corrective actions or CAPA effectiveness criteria — those must be investigator-driven.
Surfacing root-cause ideas safely
LLMs can be great at brainstorming hypotheses (e.g., “possible connector break”, “supplier incoming inspection variance”, “firmware watchdog timeout”), but they can also hallucinate specifics. I enforced these guardrails:
- Label every hypothesis as “AI-suggestion — needs verification”.
- Require citation: suggestions that reference a document must include the matching record ID or text excerpt. If the model can’t cite, flag it.
- Track provenance: each suggestion has an origin tag and a timestamp.
- Encourage structured language (short bullets, avoid absolute claims).
This turns AI output into a reviewable seed — helpful to speed thinking without pretending it’s factual.
Linking related records: pattern matching, not magic
We used a two-layer approach:
- Exact metadata matches: lot numbers, serials, complaint IDs.
- Similarity search: vector embeddings of complaint summaries, test report abstracts, previous CAPA descriptions. Return top-N similar records with a score.
Present these as suggestions; the investigator decides which to attach. This reduced missed relationships in our investigations and saved hours that would otherwise be spent manually searching multiple modules.
Auditability, traceability, and compliance
Key requirements I enforced from day one:
- Immutable storage of AI suggestions (timestamped, user-visible).
- User acceptance logs (who accepted what and why).
- Versioning of the CAPA form prior to and after acceptance.
- Retention of raw input used to generate suggestions (for future review by an auditor).
This keeps the assistance within the “controlled assistance” framing: useful but auditable.
Pitfalls and tips
- Watch for hallucinations. Train the team to treat suggestions as hypotheses, not facts.
- Start with internal models or small LLM contexts that can cite your document store.
- Limit data sent to external APIs to avoid PII/PHI exposure; follow your DPA and data residency rules.
- Use dropdown enrichment (e.g., known SKUs) rather than free text when possible to reduce variance.
- Measure investigator time savings and error reduction, but don’t rely on claims without your own logging.
Closing
In our setup, AI autofill didn’t replace investigative thinking — it removed the busywork and nudged investigators toward records they otherwise would have missed, while keeping everything reviewable for an auditor. If you’ve tried similar automation in a regulated QMS, what validation or guardrails did you find essential before rolling it out to investigators?
Top comments (0)