WorkflowClinical Development

Protocol Design Review & Amendment-Risk Check

Clinical protocol review that finds the avoidable amendments before the committee meets

Every draft protocol checked against past amendments, so avoidable changes are fixed before the committee meets.

See one case, screen by screen ↓
demo148past amendments every draft is checked against, with the sponsor’s design standards and three ICH guidelines
demo73→54%amendment risk on a Phase 3 draft after its owner accepted three cited fixes
target24%average chance of an amendment at committee sign-off, down from 72% at first draft
target71%of findings accepted by owners; the rest rejected with a reason
The problem

Why avoidable amendments still get past protocol review

Most amendments that cost a study months were visible in the draft: an inclusion criterion stricter than the target label, a screening window too short for a centrally read colonoscopy, a primary estimand that leaves intercurrent events to the analysis plan, a Schedule of Activities that disagrees with the synopsis. The sponsor has usually made the same mistake before — the summary of changes is sitting in the TMF.

But nobody on a protocol team has time to read 148 summaries of changes, four design standards and the ICH guidelines against a 148-page draft before the committee date. So review comes down to whoever remembers what went wrong on the last study, and the lesson is relearned after first participant in — with re-consent, ethics resubmissions and months added to the timeline.

typical$535Kmedian direct cost of one Phase 3 amendment — and the study runs about 3 months longer
demo$1.46Mexpected cost of avoidable amendments across eight drafts in review, with 9.3 months of delay
demo46%of past amendments in the sample archive judged avoidable by the teams who wrote them
Where a draft’s review days goestimated
By hand17 days
With the solution4 days
  • Reading the draft, section by section5 → 0.5 d
  • Finding past amendments and standards that apply4 → 0.5 d
  • Cross-checking synopsis, body and Schedule of Activities2 → 0.5 d
  • Getting a decision from each owner4 → 2 d
  • Writing the committee pack2 → 0.5 d

Estimated split for one Phase 3 draft before the review committee, by hand and with the solution.

How it works

How a draft moves

Six reviewer agents read every section and rank the risks; protocol owners decide each finding and the lead signs.

What comes in
Draft in1 draft protocol · + past amendments and design standards
Agents at work
Eligibility reviewer
Schedule & burden reviewer
Endpoint & estimand reviewer
Safety monitoring reviewer
Feasibility reviewer
Then
Lead reviewerrank + assign
A person decides
Protocol ownersaccept or reject each finding; the lead signs
What comes out
Ranked, cited findings
Signed decision log
Committee pack
One case, step by step

One Phase 3 draft, from crew review to signed dispositions

VLT-305, a Phase 3 induction and maintenance study of Veltrimab in Crohn’s disease — draft v0.9, 148 pages, 640 participants at about 180 sites in 22 countries — goes to the Protocol Review Committee on Oct 14. Seven days out, here is how the protocol lead takes it from crew review to signed dispositions, screen by screen, in the working solution.

  1. 01Morning

    Every draft and its amendment risk, on one screen

    Dr. Maya Chen · Clinical scientist, protocol lead

    Maya opens the solution to 8 draft protocols in review, 4 of them reaching the committee in the next two weeks, and 26 findings waiting for an owner — 6 of them hers. Each draft shows where it is likely to need an amendment, section by section. VLT-305 stands out: 73% amendment risk, committee in 7 days.

    “Expected cost of avoidable amendments: $1.46M and 9.3 months of delay across drafts.”

  2. 02One click

    Five reviewers read the draft at once

    The review crew

    Maya presses Re-run crew. The draft is split into its sections, the synopsis and the Schedule of Activities, and five reviewers read in parallel — eligibility, schedule and burden, endpoints and estimands, safety monitoring and operational feasibility. Then the lead reviewer compares the synopsis, body text and Table 2, merges 4 duplicate findings, estimates each finding’s likelihood from the 148 past amendments and ranks 12 findings.

    Owners assigned by area: “eligibility → protocol lead · estimands → biostatistics · safety → safety physician”.

  3. 03Ranked

    The top finding, with the line, the precedent and the standard

    Eligibility reviewer

    At the top, 22% likely to force an amendment: Inclusion 3 requires failure of at least two prior biologic classes. In VLT-204 the same criterion held enrolment at 41% of plan after six months. It also clashes with the stratum “prior biologic exposure (yes or no)” — every participant would be “yes”. The finding quotes the protocol line, the VLT-204 amendment, standard NWB-STD-014 §3.2 and ICH E8(R1) §3.3, and proposes the redline.

    Suggested change: “conventional therapy (corticosteroids or immunomodulators) or at least one biologic class”.

  4. 04One click on the citation

    The summary of changes behind the flag

    Dr. Maya Chen · protocol lead

    Maya opens the precedent: VLT-204 Amendment 2, March 2024, $162K direct cost and 4.1 months. Inclusion 3 was broadened after 58% of screen failures were traced to it, and investigators at 31 of 52 sites reported eligible patients being referred elsewhere. 64 participants re-consented; 52 ethics committee approvals followed.

    “The original criterion was not required by the target label and was not supported by the Phase 1b data.”

  5. 05Accepted · 73% → 67%

    Accept the change, and watch the risk fall

    Dr. Maya Chen · protocol lead

    She accepts. The new wording goes into the draft as a tracked change, and the risk meter moves from 73% to 67% — expected cost of avoidable amendments from $656K to $556K, expected delay from 3.7 to 3.1 months. The decision, her name and the time go straight onto the record.

    “Change applied to the draft · amendment risk 73% → 67%”

  6. 06Next three findings

    Screening window, washout — and the estimand goes to the committee

    Dr. Maya Chen · protocol lead

    Maya accepts a 35-day screening window (the median wait for a colonoscopy slot in VLT-204 was 19 days, plus 6 days of central reading) and a washout of 5 half-lives or 12 weeks instead of 12 months. Risk is now 54%. The primary estimand says intercurrent events “will be handled as described in the statistical analysis plan”; ICH E9(R1) expects each strategy in the protocol, and CRV-301 was amended for exactly this — $610K and 4 months. She raises it for the committee.

  7. 07Consistency

    Synopsis, body and Table 2, compared visit by visit

    Lead reviewer

    The co-primary ileocolonoscopy is at Week 12 in the synopsis and §8.2, but Table 2 places it at Week 10 — and sites follow the table. NXL-115 had the same mismatch and recorded 18 deviations before its amendment. Five more gaps sit beside it: calprotectin at Week 8, ECG at Week 12, PK at Week 2, antibodies at Week 24 and the annual TB test. The Week 4 visit runs 6.5 hours against a 4-hour standard. One click fixes all six in Table 2.

    “38.0 hours in total · burden index 1.38× the Crohn’s study median”

  8. 08Generated

    The lead reviewer drafts the committee pack from the decisions

    Lead reviewer

    Generate pack collects the decisions and reasons, draws the risk profile by section, writes the summary and the questions for the committee, and checks that every citation resolves. The pack lists the five accepted changes with their precedents, two questions for the committee — the estimand, and the placebo endoscopic response assumption Priya Raman raised — and every finding still open.

    “Committee pack ready · 5 sections, every statement linked”

  9. 09Send to committee

    Sign the disposition log

    Dr. Maya Chen · protocol lead

    Send to committee only opens once every high finding has a decision. Maya signs 7 dispositions for VLT-305 draft v0.9 with her password, choosing the meaning of her signature: “I confirm these dispositions as protocol lead”.

  10. 10Signed · Oct 7, 09:33

    On the record, and on the agenda

    Dr. Maya Chen · protocol lead

    VLT-305 moves to Committee for Oct 14. The decisions log shows every finding, its likelihood, who decided it, when and why — the record the committee and inspectors see. Beneath it, the audit trail lists each step by people and agents, from the eligibility reviewer’s first citation to Maya’s signature. Medium findings still open stay listed for their owners.

    “Every finding, who decided it, when and why — the record the committee and inspectors see.”

Who it’s for

Built for everyone who signs off a protocol.

The same draft, seen by the people who own its findings and the chair who receives it — what review looked like, and what it looks like now.

MC
Dr. Maya ChenClinical scientist
Protocol lead
Before
Defends the draft at committee on memory of what went wrong last time, and finds out after first participant in.
Now
Walks in with every finding decided, each one tied to the protocol line and the past amendment behind it, and the disposition log signed.
PR
Priya RamanBiostatistician
Owner · endpoints and estimands
Before
Gets the protocol late, when the estimand wording is already set and the sample-size assumptions are hard to reopen.
Now
Gets every estimand and assumption finding routed to her with the guideline clause and benchmark studies; raises the open ones for the committee.
OH
Dr. Omar HaddadSafety physician
Owner · safety monitoring
Before
Checks stopping rules against the investigator brochure by hand, one draft at a time.
Now
Receives every safety finding matched to the earlier signal — like the Phase 2 liver signal that calls for liver stopping rules in VLT-305.
DO
Dana OkaforMedical writer
Owner · consistency
Before
Proofreads the synopsis against the body and Table 2, and still misses a visit that moved.
Now
Sees every procedure compared across synopsis, body text and Table 2, with each gap fixed in one click.
SP
Dr. Sam PatelChair, Protocol Review Committee
Committee chair
Before
Reads a long draft the night before and argues findings nobody has sourced.
Now
Gets a five-section pack: risk by section, decisions taken, the questions only the committee can answer, and every precedent cited.
Built on the engine

6 agents. Each with one job, and hard limits.

Six reviewer agents read every section and rank the risks; protocol owners decide each finding and the lead signs.

Eligibility reviewer

Reads inclusion and exclusion criteria, washouts and population definitions, and compares each with the target label, the eligibility design standard and every past amendment that changed a similar criterion.

  • Every finding cites a protocol line and a source
  • No real patient data in prompts
  • Proposes changes; never edits the controlled document
Schedule & burden reviewer

Totals participant hours and invasive procedures for each visit in the Schedule of Activities, compares burden with the therapy-area median and flags visits over 4 hours.

  • Cites the visit and procedure
  • Burden figures shown with their basis
Endpoint & estimand reviewer

Checks objectives and estimands against ICH E9(R1), flags intercurrent events without a stated strategy and sample-size assumptions without a benchmark source.

  • Statistical suggestions go to the biostatistician
  • Assumptions cite benchmark sources
  • Never changes the analysis
Safety monitoring reviewer

Matches stopping rules, monitoring and reporting to the risks seen in earlier studies of the product and the investigator brochure.

  • Safety findings always go to the safety physician
  • Cites the earlier signal
Feasibility reviewer

Compares screening windows, sample shipping, vendor turnaround and country plans with site feasibility history.

  • Cites the site or vendor evidence
Lead reviewer

Compares every endpoint and procedure across the synopsis, the body and Table 2, merges duplicates, estimates each finding’s likelihood of forcing an amendment, ranks them, assigns owners and writes the committee pack.

  • Ranks; never decides
  • Every pack statement links to a finding
Protocol owners

Decide each finding; the lead signs. The agents propose; a named person decides.

Ask in plain words

Ask about any draft, in plain words

Ask about any draft, finding or past amendment — or say what to change. Every answer cites the protocol line, the amendment or the standard.

Has this biologic criterion forced an amendment before?

Yes. VLT-204 Amendment 2 (Mar 2024) broadened the same criterion — failure of at least two biologic classes — to conventional therapy or one biologic. Enrolment was 41% of plan at month 6, and 58% of screen failures came from that criterion. It cost $162K directly and 4.1 months. VLT-305 inclusion 3 repeats the wording; the eligibility reviewer estimates a 22% chance it forces an amendment.

What is wrong with the VLT-305 estimand?

Section 3.2 says intercurrent events “will be handled as described in the statistical analysis plan”. ICH E9(R1) expects the strategy for each intercurrent event to be stated in the protocol. CRV-301 did the same and the agency asked for the strategies after first participant in — Amendment 2, $610K and 4 months. Suggested: a composite strategy for rescue medication or stopping for lack of efficacy, and treatment policy for other reasons. Owner: Priya Raman.

Do the synopsis and the schedule agree?

Not yet. The lead reviewer found 6 gaps between the body text and Table 2. The one that matters most: the co-primary endoscopy is at Week 12 in the synopsis and §8.2, but Table 2 places it at Week 10. The others are missing time points: calprotectin at Week 8, ECG at Week 12, PK at Week 2, antibodies at Week 24 and the annual TB test.

Add a rule: flag screening windows under 35 days when an endoscopy is needed

Done. A review rule for the Feasibility reviewer: flag any screening window under 35 days when screening needs an endoscopy with central reading. It is based on VLT-204, where the median wait for a colonoscopy slot was 19 days plus 6 days of central reading. It applies from the next crew run, already matches VLT-305, and you can switch it off in Settings.

Every screen

The working solution, as it ships.

13 screens from the working solution, on its sample data. Pick one to see it large.

HomeDrafts in review, findings waiting for an owner, the committee runway and where each draft is likely to need an amendment, by section.
The review crew at workFive reviewers read the draft in parallel; the lead reviewer compares synopsis, body and schedule, merges duplicates, ranks and assigns.
The protocol reviewThe draft with every flagged line highlighted, the amendment risk meter, and each finding with its protocol line, precedent, standard and redline.
The precedentThe summary of changes behind a finding — what changed, why, what it cost and how long it took.
A change acceptedThe suggested wording applied as a tracked change; amendment risk, expected cost and expected delay update at once.
Estimand findingIntercurrent events left to the analysis plan, cited against ICH E9(R1), the CRV-301 amendment and the estimands standard.
ConsistencyEvery procedure compared across synopsis, body text and Table 2, with hours on site per visit against the 4-hour standard.
The committee packSummary, risk by section, decisions taken, questions for the committee and sign-off — every statement linked to its finding.
Electronic signatureThe protocol lead signs the disposition log with a password and the meaning of the signature.
The decisions logThe finding-by-finding record, and beneath it the audit trail of people and agents — from the first citation to the protocol lead’s signature.
PrecedentsThe amendment archive — area of change, avoidable or not, direct cost, delay and how many current findings cite each one.
The portfolio dashboardAmendment risk at draft and at sign-off, findings by area, decisions by reviewer and where findings cluster by section and therapy area.
Your review rulesThe six reviewers on the crew, each live or paused, the minimum likelihood for raising a finding, the committee block and re-runs on every new draft version.
Governance

Built for controlled documents: cited, decided, signed.

No finding without a line and a sourceEvery finding quotes the protocol line it is about and cites the past amendment, design standard or ICH clause behind it. Click a citation to read the summary of changes itself.
The protocol stays your controlled documentThe reviewers propose changes; they never edit the draft. An accepted change goes into the draft as a tracked change, under the owner’s name.
A named owner decides every findingEach finding goes to its owner by area — safety to the safety physician, statistics to the biostatistician. Accept, reject or raise for the committee; a rejection needs a written reason.
High findings decided before the committeeSend to committee stays closed while any high finding is open, so the committee never receives a draft with an undecided high risk.
The protocol lead signs the dispositionsThe disposition log is signed with a password and the meaning of the signature, with the signer’s name and the time recorded together.
Every step on the audit trailEach reviewer’s run, each ranking and each human decision is on the protocol’s audit trail — people and agents, with who, what and when.
Configuration

Your review rules, not ours

How the crew works and who decides are settings, changed by the protocol team — not a project.

SettingDefaultChoose from
Minimum likelihood of an amendment3%3 · 5 · 10 % — below it, a finding goes to a watch list
Block “Send to committee” while high findings are openOnOn · Off
Re-run the crew on every new draft versionOnOn · Off — decisions carry over when the line is unchanged
Reviewers on the crewAll six livePause any reviewer
Who decides eligibility and schedule findingsDr. Maya ChenDr. Maya Chen · Priya Raman · Dr. Omar Haddad · Lena Ortiz · Dana Okafor — the protocol lead can reassign
Who decides endpoint and estimand findingsPriya RamanDr. Maya Chen · Priya Raman · Dr. Omar Haddad · Lena Ortiz · Dana Okafor
Who decides safety monitoring findingsDr. Omar HaddadDr. Maya Chen · Priya Raman · Dr. Omar Haddad · Lena Ortiz · Dana Okafor
Review rulese.g. “Flag visits longer than 4 hours”Add in plain words
Connections

Works with the documents you already keep

Draft protocolseach DOCX version, split into ICH M11 sections
Your amendment archivesummaries of changes from the TMF, added as each study is amended
Design standards and SOPseligibility, schedule and burden, estimands, safety monitoring
ICH guidelinesE6(R3), E8(R1) and E9(R1), cited clause by clause
Site feasibility historyscreening times, colonoscopy waits, courier times
Investigator brochuresearlier study signals the safety rules are checked against
What it changes

The difference, in numbers.

Every figure is labelled: a target the solution is built to, an estimate, a typical published result, or a proven one.

target
24%
average chance of an amendment at committee sign-off, down from 72% at first draft
At first draft72%
At sign-off24%
typical
$535K
saved for each Phase 3 amendment avoided, plus about 3 months
target
71%
of findings accepted by owners; the rest rejected with a reason
findings accepted by owners

“demo” = seen in the working solution, on its sample protocol data · “target” = the design goal, measured in the live solution · “estimated” = our estimate · “typical” = published figures (Tufts CSDD protocol amendment studies, 2016 and 2024 — a Phase 3 amendment has a median direct cost of $535K and adds about 3 months). ICH E6(R3), E8(R1) and E9(R1) are named as the guidelines the reviewers cite. People and studies named on this page are characters and examples in the working solution.

Questions

What protocol teams ask us.

What is a protocol amendment-risk check?

A review of a draft clinical protocol that looks for the design choices most likely to force a substantial amendment later — eligibility criteria, visit burden, estimands, safety monitoring, operational feasibility and internal consistency. This solution does it with six reviewer agents that cite the sponsor’s own past amendments for every flag, and gives each finding a likelihood.

How does it estimate the chance of an amendment?

The lead reviewer estimates each finding’s likelihood of forcing a substantial amendment from the amendment archive — 148 summaries of changes in the working solution — and combines the open findings into one amendment risk for the draft. Expected cost and delay add up each open finding’s likelihood times the median direct cost of an amendment in that phase ($535K for Phase 3) and about 3 months of extra study time.

Which guidelines does it check a protocol against?

ICH E6(R3) for quality by design and feasibility, ICH E8(R1) for critical-to-quality factors and ICH E9(R1) for estimands, plus your own design standards. Drafts are split into ICH M11 sections.

Does the AI change our protocol?

No. The reviewers propose changes and never edit the controlled document. An owner accepts a change, and only then is it applied to the draft as a tracked change, under their name.

Do people stay in control of the decisions?

Yes. A named owner decides every finding — accept, reject with a written reason, or raise for the committee. The lead reviewer ranks but never decides, high findings must be decided before the draft can go to the committee, and the protocol lead signs the disposition log.

Does it check the synopsis against the Schedule of Activities?

Yes. The lead reviewer compares every endpoint and procedure across the synopsis, the body text and Table 2, and shows each mismatch side by side — for example an endoscopy at Week 12 in the body and Week 10 in the table — with a one-click fix in Table 2.

Can we add our own review rules?

Yes, in plain words — for example “Flag visits longer than 4 hours” or “Flag primary estimands without an intercurrent-event strategy”. The likelihood threshold for raising a finding, who decides each area and whether the committee is blocked while high findings are open are settings too.

How long does it take to go live?

The Agentic Solution Engine builds and deploys it from your requirements and documents — your design standards, SOPs and past summaries of changes — and it goes live once every quality gate has passed. We will run it on one of your own drafts first.

See it on
your next protocol.

We’ll run the review crew on one of your drafts, against your own past amendments.