SystemManufacturing & Quality

Validation Review Panel

Validation document review in minutes — every finding located, a quality reviewer decides

Every validation document comes back marked up in minutes, each finding located.

See one case, screen by screen ↓
demo11findingson an 11-page TMV report — 2 critical, each with page, section and the quoted passage
demo96.8%critical recall on the answer key — 61 of 63 seeded critical defects found
target14minper review, from upload to a marked-up document
target< 10%of findings raised turn out to be false alarms
The problem

Why a validation review takes hours, and still misses things

A TMV report, a DV protocol or an executed OQ lands in the quality reviewer’s queue with a due date. Before any judgement on the method or the result, the reviewer has to walk every section against the controlled template, look up every cited SOP and standard to see which revision was in force when the testing ran, and trace each requirement to a test step and a recorded result — then write it all up as comments on the document.

That mechanical part is where the misses are: a procedure cited at a revision superseded two months before testing, a calibration due date left blank, a requirement in the product specification that no test covers, a correction on the data sheet with no initials. Two qualified reviewers rarely return the same list, and when a controlled document gets a new revision, nobody goes back to the open reviews that still cite the old one.

demo≈ 3.5hper review by hand
demo4reviewsstill citing SOP-MET-0031 rev D after rev E became effective
demo35%of findings raised by only one of the three reviewers, after reconciling
Where a review’s hours goestimated
By hand3.5 days
With the solution0.2 days
  • Template sections, fields and statistics1 → 0.0 d
  • Every citation checked at the test date1 → 0.0 d
  • Requirements traced to tests and results0.8 → 0.0 d
  • Writing comments and redlines0.5 → 0.0 d
  • Deciding what goes back to the author0.3 → 0.1 d

Estimated split for one TMV report of about 11 pages, by hand and with the panel. Hours of reviewer time.

How it works

How a document moves

Five specialist agents review, reconcile and mark up every document; a quality reviewer decides.

What comes in
Documents in5 document types · with template + library
Agents at work
Template reviewer
Citation reviewer
Traceability reviewer
Then
Reconcilermerge + grade
Then
Markup writerWord + PDF
A person decides
Quality revieweraccepts or dismisses
What comes out
Redlined document
Findings by severity
Traceability matrix
One case, step by step

One TMV report, from received to returned

Sam Patel has finished the test method validation report for the tip-to-shaft bond pull-force test on the Corventa 7F delivery catheter. Here is its review, screen by screen, in the working solution.

  1. 01Morning

    Her queue, with the findings already waiting

    Dana Okafor · Quality reviewer, validation

    Dana opens the solution to 5 documents waiting for review, 3 critical findings open and a median of 14 minutes per review. Below her queue, the library changes that touch open reviews: SOP-MET-0031 rev E is effective, and 4 open reviews still cite rev D.

    “They are markup for you to judge — the panel never approves.”

  2. 02New review

    The document is read before the panel starts

    Dana Okafor · Quality reviewer, validation

    She drops in TMV-0193_TipPullForce_TMV-Report_Rev01.docx — 11 pages. The solution has already recognised it: a test method validation report on template TPL-TMV-002 rev F, product Corventa 7F delivery catheter, Plant 3 — Leiden, test dates 18–20-Aug-2026 taken from the data sheets.

    “You decide what goes back to the author.”

  3. 03In parallel

    Three reviewers read the same document at once

    Template, citation and traceability reviewers

    The template reviewer maps 14 sections and 41 required fields and finds a blank field and no ndc. The citation reviewer reads 7 references and 4 instruments, resolves each revision at the test date and finds SOP-QA-0112 rev C superseded on 15-Jun-2026. The traceability reviewer collects 8 requirements from PRS-CV7-001, TMS-0193 and SOP-QA-0112 and finds R-4.2.3 has no test.

  4. 04About a minute and a half

    21 raw flags become 11 findings

    Reconciler

    The reconciler merges duplicates, re-reads every passage and drops 2 flags the document does not support — Quality is named in §4.0 after all, and TMS-0193 rev B is in the library as a test method. What is left is graded and located: 2 critical, 4 major, 5 minor, marked on the pages of the report.

    “11 findings · 2 critical — ready for your review”

  5. 05F-01 · critical

    A procedure cited at a revision that did not govern the work

    Citation reviewer

    §2.0 cites SOP-QA-0112 Test method validation at rev C. Rev D became effective on 15-Jun-2026, two months before testing began, and a timeline shows it. The finding explains why it matters: rev D requires ndc to be reported and be ≥ 5 — the gap the old reference hides is F-04.

  6. 06Her decision

    Evidence side by side, then accept, edit or dismiss

    Dana Okafor · Quality reviewer, validation

    Under the finding sit both revisions of SOP-QA-0112 with the passages highlighted, the suggested edit — rev C struck, rev D inserted — and who raised it: all three reviewers, confidence 98. Dana accepts it; the finding is marked Accepted and will go to Sam with the redlined copy.

  7. 07Traced both ways

    A requirement no test covers

    Traceability reviewer

    The matrix lists 8 requirements: 6 traced, 1 partly traced, 1 untraced. R-4.2.3 — pull force ≥ 15.0 N after 2 h hydration at 37 °C — is in the product requirements and in the test method’s own scope, but no test in the report addresses it; the water bath WB-0306 is listed in §5 and never used. Criterion 6.2, ndc ≥ 5, has no reported result — from the reported components, ndc ≈ 7.

    “The method would be released for a condition it was never validated for.”

  8. 08The package

    A redlined Word, never the controlled original

    Markup writer

    Five files come back: the redlined Word with 11 tracked changes and 11 comments, an annotated PDF, the findings table, the pass/fail checklist and the traceability matrix. Each is stamped as advisory, and the controlled original is unchanged.

    “Advisory review markup — not an approval”

  9. 09Returned

    Back to Sam, with a clear ask

    Dana Okafor · Quality reviewer, validation

    Dana returns TMV-0193 to Sam Patel with the redlined Word, checklist and matrix. The message is drafted for her: cite SOP-QA-0112 rev D, and give R-4.2.3 a test or a justified exclusion, then resubmit as rev 02. Returning is her decision, recorded in the audit trail under her name.

  10. 10Every night

    The panel, scored against an answer key

    Omar Haddad · Quality manager

    Every night the panel is run on a locked pack of 36 seeded documents with 412 seeded defects. The September run: critical recall 96.8 % against a 95 % target, false positives 7.4 % against a 10 % limit. In the last 30 days, 38 reviews were completed. A new panel version ships only if critical recall stays at 95 % or above.

Who it’s for

Built for everyone who touches a validation document.

The same report, seen by the four people around it — what review looked like before, and what it looks like now.

DO
Dana OkaforQuality reviewer, validation
Quality reviewer
Before
Spends most of a review on the template, the reference list and the matrix before she gets to the science.
Now
Starts from located findings with the evidence beside them, and spends her time deciding.
SP
Sam PatelValidation engineer
Author
Before
Gets comments in whatever form the reviewer had time for, some of them days apart.
Now
Gets one redlined Word — a tracked change or a comment at each location — and a message saying what must change for rev 02.
MC
Maya ChenDocument control
Library owner
Before
Makes a new revision effective and has no way to see which open reviews still cite the old one.
Now
Sees every controlled document with its effective dates, and which open reviews cite an old revision.
OH
Omar HaddadQuality manager
Panel owner
Before
Has no measure of how consistent the reviews are, or what they miss.
Now
Sees critical recall and false positives against the answer key every night, and sets the grading rules.
Built on the engine

5 agents. Each with one job, and hard limits.

Five specialist agents review, reconcile and mark up every document; a quality reviewer decides.

Template reviewer

Identifies the controlled template from the document type and revision, maps every section and required field, and raises anything missing, blank or out of order — including statistics and signature blocks.

  • Advisory only — never approves or signs
  • Every finding carries page, section and a quoted passage
  • Never judges the science
Citation reviewer

Resolves every reference against the document library by ID and revision, checks standards editions, and looks up the calibration record of every instrument.

  • Uses the test date, not today, to judge whether a revision was current
  • Advisory only — never approves or signs
Traceability reviewer

Builds the requirement → test → result matrix from the product requirements, the test method and the governing SOP, in both directions.

  • Every gap names the requirement and its source
  • Flags untraced requirements, orphan tests and criteria with no result
  • Advisory only — never approves or signs
Reconciler

Merges the three reviewers into one finding set: combines duplicates, re-reads each passage, applies your grading rules and records which reviewers agreed.

  • A finding without page, section and quote is dropped
  • Says why it dropped a flag
  • Advisory only — never approves or signs
Markup writer

Writes the redlined Word with tracked changes and comments, the annotated PDF, the findings table, the pass/fail checklist and the traceability matrix.

  • Never edits the controlled original — writes a copy
  • Every output carries the advisory label
  • Keeps the author’s formatting
Quality reviewer

Accepts or dismisses each finding. The agents propose; a named person decides.

Ask in plain words

Ask about any review, in plain words

Reviewers can ask about any review, finding or library document — or tell it what to change. Answers cite the library.

Why is F-01 on TMV-0193 critical?

Because the report cites a procedure revision that did not govern the work. TMV-0193 cites SOP-QA-0112 rev C, but rev C was superseded by rev D on 15-Jun-2026, and testing ran 18–20-Aug-2026. Rev D requires ndc to be reported, and the report does not report it — that is F-04. Your grading rule makes “governing procedure not current on the test date” critical.

Which open reviews have an untraced requirement?

Three: TMV-0193, R-4.2.3 · pull force after 2 h hydration; DV-0421, UR-2.3.1 · activation force after 24 h at 5 °C; PQ-0266, URS-14 · recovery to ISO 7 within 15 min. All three are graded critical.

Grade outdated standard editions as critical

Done. “Outdated edition of an external standard” is now graded Critical (was Major), saved as panel rules v13 under your name in the audit trail. It applies to new reviews; open reviews keep their grades. The next nightly answer-key run will show whether it moves the false-positive rate.

How does the panel score against the answer key?

On the locked answer key — 36 seeded documents, 412 seeded defects — the September run scored critical recall 96.8 % (61 of 63), major recall 93.1 % and false positives 7.4 %. The two missed criticals were both statistics claims on scanned data sheets.

Every screen

The working solution, as it ships.

13 screens from the working solution, on its sample data. Pick one to see it large.

HomeWhat needs the quality reviewer today: documents waiting, critical findings open, library changes that touch open reviews, and the panel at work.
A new reviewThe document read on arrival — type, template, product, test dates and site — before the panel starts.
The panel at workTemplate, citation and traceability reviewers reading in parallel, then the reconciler merging and grading.
Findings on the documentEleven findings marked on the pages, with the review summary, reviewer agreement and the five files that come back.
A critical citation findingWhat the panel found, why it matters, and the revision in force on the test date.
Accept, edit or dismissBoth revisions with the passages highlighted, the suggested edit, who raised it and the confidence.
Traceability matrixEvery requirement to a test and a result, both ways — one untraced, one partly traced.
Pass/fail checklistSeventeen checks against the template and SOPs, each failure linked to its finding.
The review packageRedlined Word, annotated PDF, findings table, checklist and matrix — each stamped advisory.
Return to authorThe findings go back with a drafted message; returning is the reviewer’s recorded decision.
Document libraryEvery controlled document and revision with effective dates, and the open reviews that cite an old one.
DashboardCritical recall and false positives on the answer key, reviews completed and findings by kind.
SettingsWho is on the panel, how findings are graded, who decides each document type and what comes back.
Governance

Advisory by design: located, decided, on the record.

Advisory only, and lockedThe panel marks up and explains. It can never approve, sign or move a document to Approved — that setting is locked.
Every finding is locatedEach finding carries its page, section and the quoted passage, with the library evidence beside it. A finding without them is dropped.
Currency judged on the test dateA citation is current only if its revision was in force on the first test date — not on the day of the review.
The controlled original is never touchedRedlines go on a copy. Every file that comes back is stamped “Advisory review markup — not an approval”.
A named reviewer decides each findingEach finding is accepted, edited or dismissed by the reviewer named for that document type. Dismissing needs a reason, and every decision is in the audit trail under the reviewer’s name.
Scored every nightThe panel runs nightly on a locked answer key. A new panel version ships only if critical recall stays at 95 % or above.
Configuration

Your quality system’s rules, not ours

Who reviews, how findings are graded and who decides are settings your panel owner changes.

SettingDefaultChoose from
Reviewers on the panelTemplate, citation, traceabilityEach on or off · statistics reviewer in preview
When only one reviewer raises a findingKeep it, marked “one reviewer”Keep it, marked “one reviewer” · Drop unless two agree
Governing procedure cited at a revision not current on the test dateCriticalCritical · Major · Minor
Requirement with no test that traces to itCriticalCritical · Major · Minor
Outdated edition of an external standardMajorCritical · Major · Minor
Correction without initials, date or reasonMajorCritical · Major · Minor
Who decides findings on TMV protocols and reportsDana OkaforDana Okafor · Omar Haddad · Lena Ortiz
What comes backAll five filesRedlined Word · annotated PDF · findings table · checklist · matrix
Connections

Works with the documents you already control

Validation documentsDV, TMV, IQ, OQ and PQ protocols and reports, Word or PDF
Controlled templatesthe section and field map each document is checked against
Document librarySOPs and specifications, every revision with its effective dates
Standards registerthe edition of each standard in force on the test date
Calibration recordscertificates and due dates for every instrument used
Requirement specificationsproduct requirements and test methods, traced to tests
What it changes

The difference, in numbers.

Every figure is labelled: a target the solution is built to, an estimate, a typical published result, or a proven one.

target
14min
per review, from upload to a marked-up document
By hand≈ 3.5 h
With agents≈ 14 min
target
95%+
of critical findings caught, scored on an answer key
critical recall, checked every night
target
< 10%
of findings raised turn out to be false alarms
Under 1 in 10
findings dismissed as false

“demo” = seen in the working solution, on its sample documents and answer key · “target” = the design goal, measured in the live solution · “estimated” = our estimate. People, companies and products named on this page are fictional — characters and sample data in the working solution.

Questions

What validation and quality teams ask us.

What is the Validation Review Panel?

A panel of AI reviewers that reads a validation protocol or report — DV, TMV, IQ, OQ or PQ — and returns a markup: findings graded by severity, a redlined Word, an annotated PDF, a pass/fail checklist and a traceability matrix. It is advisory only; a named quality reviewer decides every finding.

Does it approve or sign validation documents?

No. The panel can never approve, sign or move a document to Approved, and that setting is locked. It writes on a copy, and every file it returns is stamped “Advisory review markup — not an approval”.

How does it check whether a citation is current?

The citation reviewer resolves every reference against your document library by ID and revision and reads the test dates from the data sheets. A citation counts as current only if its revision was in force on the first test date. When a new revision becomes effective, open reviews that cite the old one are re-checked and the reviewer is told.

How does it build the traceability matrix?

The traceability reviewer collects requirements from the product requirements, the test method and the governing SOP, matches each to a test step and a recorded result, and maps every test back to a requirement. It flags requirements with no test, tests with no requirement and criteria with no reported result.

How accurate is it?

It is scored every night on a locked answer key of 36 seeded documents with 412 seeded defects. In the working solution’s September run, critical recall was 96.8 % and false positives 7.4 %, against a target of 95 % and above and a limit of 10 %. A new panel version ships only if critical recall stays at 95 % or above.

What happens when the panel gets a finding wrong?

The reviewer dismisses it with a reason — not supported by the document, covered by a deviation, already fixed in a later revision, or their own words. Dismissals are recorded under their name and count toward the false-positive measure.

Can we set our own grading rules and reviewers?

Yes. Which reviewers sit on the panel, what happens when only one reviewer raises a finding, how each kind of finding is graded, who decides each document type and which files come back are all settings.

How long does it take to go live?

The Agentic Solution Engine builds and deploys it from your requirements and documents — your templates, document library and a sample of past validation documents — and it goes live once every quality gate has passed. We will walk you through it on your own documents first.

See it on
your protocols and reports.

We’ll run the review panel on a sample of your own validation documents, against your templates and library.