A clinical trial follows a written plan called a protocol, and three in four of those plans get formally changed after they are approved. Each change goes back to regulators and ethics committees, often for most of a year. Protocol design optimization means reading the draft for the changes you could see coming, such as a rule that shuts out too many patients, while fixing it still takes a sentence.
This guide is for anyone who designs, reviews, signs or pays for clinical trial protocols: clinical scientists, biostatisticians, medical monitors, clinical operations and feasibility leads, medical writers, protocol review committee chairs, and the leaders deciding whether to automate the review. No background needed.
Imagine you are a clinical scientist at a mid-size biotech with an antibody for Crohn's disease, Veltrimab. It is Wednesday, October 7, 2026. You lead VLT-305, the large late-stage study known as Phase 3: 640 participants, about 180 trial sites, 22 countries. Draft 0.9 runs to 148 pages, and your company's protocol review committee meets in seven days. You have settled the comments from six departments, page by page.
Inclusion rule 3 says a patient must have failed at least two classes of biologic medicine, drugs made from living sources. It looks careful. In 2024, VLT-204, an earlier Phase 2 study of the same drug, used the same rule. Nobody on your team has reread what happened next.
VLT-305 draft · section 5
Inclusion 3
At least two prior biologic classes
Also in 4.2
Patients grouped by prior biologic: yes or no
Status
Draft 0.9
VLT-204 · Amendment 2 · Mar 12, 2024
Same rule
Broadened to conventional therapy or one biologic
Why
Enrollment at 41% of plan at month 6; the reason for 58% of people turned away at screening
Cost
$162K, 4.1 months, 64 people asked to consent again
A rule that already failedOne sentence changedcaught in the draft, before any site saw it.
Side by side, the two show a second problem. If everyone must have failed a biologic, the "yes or no" grouping in section 4.2 has only one group. You accept new wording: conventional therapy or at least one biologic class. It takes less than a minute, and the rule never reaches a regulator as an amendment.
A careful design review finds the amendment you already paid for once, while it is still one sentence in a draft.
Protocol design review: which amendments can be seen coming, and what a draft must answer before a committee signs it
What a design review checks, which rules ask for it, what amendments cost, how eligibility, schedules, estimands and feasibility go wrong, and how teams run the work today. No product is named in this part. If you are new to clinical research, start here.
01 · In plain words
Why a trial's plan gets changed after it starts, and why some of those changes could have been seen coming
Before a medicine is tested in people, the company responsible, called the sponsor, writes down how the test will run. That document is the protocol. It says who may join, what each person receives, what happens at each visit and how the result will be judged. A Phase 3 protocol, the large late-stage kind, averages about 116 pages and 21 planned visits.1 Regulators and ethics committees approve it, and every hospital and clinic in the trial follows it, often for years.
Sometimes the plan has to change once the trial is running. That formal change is called an amendment. The changed plan goes back to regulators and ethics committees. Sites retrain. People already in the trial may be asked to sign a new consent form. In a study of 950 protocols, 76% were amended at least once, an average of 3.3 times where amendments were needed, and each amendment took an average of 260 days from spotting the need to the last approval.2,3
Many of those changes nobody could have prevented. A regulator asks for something new, or the company's strategy moves. Others were knowable on the day the protocol was written: a rule about who may join that shuts out most of the people it was meant to find, a visit so long that participants stop coming, a table that says Week 10 where the text says Week 12. Sometimes the same mistake had already appeared in an earlier study at the same company, recorded in a file called a summary of changes that nobody had time to reread.
Protocol design optimization is the work of finding those choices while the plan is still a draft. A group of specialists reads the draft against past amendments, company standards and international guidance, and each problem gets fixed, accepted or argued out before the sponsor's internal committee signs. Fixing a sentence in a draft takes minutes. Fixing the same sentence in a running trial takes months.
One Phase 3 protocol, from a clinical team's question to its first amendment
The team sets the questionVeltrimab worked in Phase 2 in Crohn's disease, a long-term inflammation of the gut. The next study needs 640 participants at about 180 sites in 22 countries.
A clinical scientist drafts the protocolDraft version 0.9 runs to 148 pages. Six departments comment by email and in tracked changes.
The draft is reviewed for design riskEach section is read against past amendments, design standards and guidance. This is where a criterion that already failed in another study is caught, or carried forward.
The protocol review committee decidesThe sponsor's internal committee meets on October 14 and approves the design, or sends it back.
Regulators, ethics committees and sites receive itFrom here, any substantial change is an amendment, with its own approvals, its own wait and sites working from different versions.
Step 3 is the subject of this guide. The people, drugs, studies and figures in this example are fictional.
Four findings about protocol amendments that surprise newcomers
Amendments have become more common
The share of protocols with at least one amendment rose from 57% to 76% since 2015, despite a decade of industry attention to the problem.2
Most are now called unavoidable
In the 2024 study from the Tufts Center for the Study of Drug Development (Tufts CSDD, or just Tufts below), 77% of amendments were deemed unavoidable, and regulator requests and strategy changes were the top reasons for amending. The older figure of 45% avoidable dates from 2016.4,2
More internal review went with more amendments
In 187 protocols, the number of internal reviews before finalizing was positively correlated with amendment frequency.5 Harder studies may simply get more review, but extra rounds alone are no protection.
The wait outlasts the fix
Sites run on different versions of the protocol for an average of 215 days while an amendment works through approvals, across countries that approve at different speeds.2
Substantial amendment, summary of changes, critical to quality, estimand: the words to know
Substantial amendment
A change to an approved protocol big enough to need review by regulators or ethics committees. The EU and the UK say "substantial modification".
Summary of changes
The document filed with an amendment that says what changed and why. A sponsor's collection of them is a record of its own design mistakes.
Critical to quality factor
A part of a study whose integrity is fundamental to protecting participants or trusting the result, as ICH E8(R1) defines it.6
Estimand
The exact question the trial answers, including what counts when a participant's course is interrupted, say by needing an extra rescue medicine when symptoms worsen.
Fourteen terms are defined in the one-page summary. ICH is the International Council for Harmonisation, which writes shared guidance for regulators and industry.
02 · What a review checks
Six questions a protocol design review puts to a draft, section by section
In shortA design review asks whether the study can be run as written, and whether a past study shows otherwise. It covers who may join, what each visit asks, what is being measured, how participants are watched over, whether sites can deliver it, and whether the document agrees with itself. Feasibility assessment is one part of it. Writing the protocol is separate work that comes first.
Two guidelines set the tone. ICH E8(R1) says "Study designs should be operationally feasible and avoid unnecessary complexity."6 ICH E6(R3), the good clinical practice guideline, says the sponsor "should not place unnecessary burden on participants and investigators."7 Neither tells you what is unnecessary in your study. A review supplies that judgment, one line of the protocol at a time.
Area
The question
Section in ICH M11, the shared protocol template
Who usually answers
Eligibility
Does each rule for joining have a scientific reason, and how many people does it shut out?
5, Trial Population
Clinical scientist
Schedule and burden
Does each procedure serve an endpoint (a result the trial measures) or participant protection? How long is the longest visit?
1.3 schedule, and 8
Clinical scientist, clinical operations
Endpoints and estimands
Is the question stated exactly, with a strategy for each interrupting event, in the protocol itself?
3 and 10
Biostatistician
Safety monitoring in the trial
Does each risk known from earlier studies have a test and a rule for when to stop dosing?
7, 8 and 9
Medical monitor
Operational feasibility
Can sites do this inside the windows given, in every country planned, with the vendors named?
4, 8 and 11
Clinical operations lead
Internal consistency
Do the summary, the body text and the schedule table say the same thing about every endpoint and visit?
1.1, 1.3 and all others
Medical writer
Eligibility and feasibility hit enrollment first; estimands and consistency hit the result
Where each kind of design problem usually lands first
LittleSomeLargeSevere
EnrollmentParticipants' timeCredibility of the resultSite workloadEligibility rule too strictSevereLittleSomeSomeScreening window too shortSevereSomeLittleLargeLongest visit too longSomeSevereLittleLargeEstimand left to the analysis planLittleLittleSevereSomeStopping rule missingLittleSomeLargeLargeSchedule disagrees with textLittleSomeSevereLarge
Our reading of the sources8,9,7,6,10 · Our reading of the guidelines and studies cited. No study scores these against each other.
Show the numbers
Enrollment
Participants' time
Credibility of the result
Site workload
Eligibility rule too strict
Severe
Little
Some
Some
Screening window too short
Severe
Some
Little
Large
Longest visit too long
Some
Severe
Little
Large
Estimand left to the analysis plan
Little
Little
Severe
Some
Stopping rule missing
Little
Some
Large
Large
Schedule disagrees with text
Little
Some
Severe
Large
A review needs three kinds of evidence. The first is general: guidelines and published benchmarks. The second is the sponsor's own standards, such as a rule that no visit should exceed a set number of hours. The third is the most useful and the most neglected: the sponsor's own past amendments, each with its reason, its cost and its delay. A reviewer who can say "this exact criterion cost another study of this drug four months" wins an argument that general advice loses.
03 · Rules and dates
ICH E6(R3), E8(R1), E9(R1), M11 and the UK's 2026 rules: what each asks of a draft protocol, and since when
In shortGuidelines ask for feasible, clear protocols built around what matters most. Laws decide what happens once you change one. We found no rule that requires a protocol review committee or names a method. Regulatory status below is as of November 2026.
You will meet the phrase quality by design. ICH E8(R1) describes it as ensuring a study's quality is "driven proactively by designing quality into the study protocol and processes".6 In plain words, the thinking happens before the study starts.
Quality by design moved from advice into the core guideline between 2021 and 2026
May 2021FDA finalizes E9(R1)
The estimand framework, adopted by ICH in November 2019.
Oct 6, 2021ICH E8(R1) adopted
Critical to quality factors, identified early, with patient input.
Jan 6, 2025ICH E6(R3) adopted
Principles and Annex 1. In effect in the EU on July 23, 2025; FDA final in September 2025.
Nov 19, 2025ICH M11 adopted
A shared protocol template. FDA final in May 2026.
Apr 28, 2026UK modification rules in force
Amendments become modifications, with two routes.
Jul 2026FDA oncology washout guidance final
Time-based washouts should be justified in the protocol.
"Clinical trials should be described in a clear, concise, scientifically sound and operationally feasible protocol." Annex 1 adds that protocols should be "clear, concise and consistent". Appendix B says acceptable ranges for protocol provisions "can reduce the number of deviations or in some instances the requirement for a protocol amendment".7
FDA final, September 2025.12 EU principles and Annex 1 since July 23, 2025; Annex 2 takes effect January 15, 2027.11
ICH E8(R1), general considerations
Critical to quality factors should be identified for each study, as part of designing quality in. Section 3.3.3 says investigators and potential participants have "valuable insights" into enrolling people under proposed criteria and into visits that "may be overly burdensome".6
"A trial protocol should define and specify explicitly a primary estimand". A change to the estimand "should usually be reflected through amendment to the protocol".10
Sets where content goes. It carries an amendment details block with a primary reason and a question on impact. Its authors say it does not "provide instruction on the development of a well-designed trial".14,18
A Phase 2 or 3 change that significantly affects safety, scope or scientific quality needs a protocol amendment. It may start once submitted to FDA and approved by the institutional review board, the US form of an ethics committee, in either order.19
Binding. A change to remove an apparent immediate hazard may start at once.19
Regulation (EU) 536/2014
A substantial modification "may only be implemented if it has been approved". The sponsor assesses each change case by case.20,21
Binding. A Biotech Act proposal would cut assessment from 96 to 47 days.22 It is not law: Parliament's file reads "Awaiting committee decision".23
UK clinical trial rules
Modifications are substantial (Route A or Route B), of an important detail, or minor. Route A: joint decision within 35 days of validation. Route B: automatic approval confirmed within 14.16
FDA guidance is not binding; 21 CFR is. The European Commission's own example of a substantial modification is "inclusion of a new exclusion criteria in the protocol due to a potential liver toxicity described in section x of the IB", the investigator's brochure.21 Where the brochure already described that risk when the protocol was written, this is the kind of amendment a design review exists to catch. Step 4 is the stage at which ICH's final text is recommended to regulators for adoption.6
04 · How often, how avoidable
Protocol amendment rates: 76% of protocols amended, and how much of that is avoidable
In shortThree in four protocols are amended, on average 3.3 times, and it takes most of a year to land each change. The share called avoidable fell from 45% in 2016 to about 23% in 2024. Quote the date with the number. Even the lower share adds up to most of one avoidable amendment for each amended protocol.
76 in every 100 protocols are amended at least once
76 in 100
protocols across Phases 1 to 4 had at least one amendment in the 2024 Tufts study, up from 57% in the 2016 study. Oncology runs higher, at 91.1%
protocols across Phases 1 to 4 had at least one amendment in the 2024 Tufts study, up from 57% in the 2016 study. Oncology runs higher, at 91.1%
76 of 100
The mean number of amendments per protocol rose from 2.1 to 3.3
Tufts studies, 2016 and 2024
2015 baseline2022 data
Mean amendments per protocol2.13.3
Source2,3 · Different samples of sponsors and contract research organizations, the firms sponsors hire to run trials. The 2022 data covers the pandemic years, when this mean and the share amended were both higher. The 2024 abstract says 3.3 "per protocol"; a Tufts report quoted in a WCG Clinical webinar deck says the 3.3 counts protocols that were amended.
Show the numbers
2015 baseline
2022 data
Mean amendments per protocol
2.1
3.3
Oncology protocols are amended more often than the rest
Share of protocols with at least one amendment, 950 protocols
The 45% avoidable from 2016 and the roughly 23% from 2024
Fewer amendments are now called avoidable
Share of amendments deemed avoidable or unavoidable in each study
AvoidableUnavoidable
2016 study (substantial amendments)45%55%
2024 study (amendments)23%77%
Source4,2 · The 2024 abstract states 77% unavoidable; the 23% is our subtraction. Different samples and wording, so read the change with care.
Show the numbers
Avoidable
Unavoidable
2016 study (substantial amendments)
45%
55%
2024 study (amendments)
23%
77%
Both figures are judgments made after the fact, on data the participating companies supplied, and each company draws the line in its own way. A better test asks one question of each amendment: was the information that would have prevented this change available to the sponsor when the protocol was written? A risk in the investigator's brochure was. A competitor's result published two years later was not.
Regulator requests lead the 2024 reasons, along with strategy changes,2 and some regulator requests can be anticipated too: a question about an estimand left to the statistical analysis plan, a separate document, is a good example.
The arithmetic that makes this worth doing: 3.3 amendments multiplied by a 23% avoidable share comes to about 0.76 avoidable amendments on each amended protocol. That is our multiplication of two published figures, and rough, but it says the typical amended protocol carries most of one change a better draft could have stopped.2
A single amendment takes 260 days to clear, and sites run different versions for 215
Average days, 950 protocols and 2,188 amendments
From identifying the need to last oversight approval260 days
Sites working from different protocol versions215 days
From identifying the need to last oversight approval
260 days
Sites working from different protocol versions
215 days
Why people say amendments happen, in their own words
A study of 242 approved amendments in 53 UK studies sponsored by the National Health Service (NHS) found "addition of sites" the most common change, with 61 amendments, and "to achieve the trial's recruitment target" the most common reason, with 39.8
Eleven staff at one NHS trust, interviewed for that study, named the root causes of avoidable ones: rushing the first application knowing an amendment would follow, not involving the right people at the start, and finding the plan unworkable once delivery began.8 Those are NHS-sponsored studies, and a commercial sponsor's mix will differ, though a commercial team may well recognize the three causes.
05 · What an amendment costs
What a protocol amendment costs: $535,000 in 2016 dollars, and everything that figure leaves out
In shortThe figure everyone quotes is a median direct cost from 52 protocols, published in 2016. It leaves out the delay, the approvals and the lost enrollment. A later Tufts report, read only second-hand, credits earlier Tufts studies with nearly $1 million. Compute your own number from your own amendments, and treat these as a cross-check.
A Phase 3 amendment cost nearly four times a Phase 2 one to implement
Median direct cost per substantial amendment
Phase 3$535K
Phase 2$141K
Source4,3 · Estimated from 52 protocols. Published 2016, never adjusted for inflation. A later Tufts report, read only as quoted in a WCG deck, credits "previous CSDD studies" with "nearly $1 million" for a typical Phase 3 amendment, with no method shown.
Show the numbers
Phase
Median direct cost
Phase 3
$535K
Phase 2
$141K
Direct cost means the work a sponsor can invoice to the change: redrafting, consent forms, submissions, fees, site retraining, and updates to data collection and the systems that assign treatment. Four costs sit outside it.
Time
Tufts reports an average of 260 days from need to last approval.2
Approvals
The last approval comes from the slowest ethics committee and regulator, so an average hides the wait that matters.
Re-consent
People already in the trial may be asked to sign again. US rules require consent forms to state, where appropriate, that "significant new findings developed during the course of the research which may relate to the subject's willingness to continue participation will be provided to the subject".25 Whether someone signs again usually comes down to the ethics committee.
Enrollment that never returns
In the 2016 study, amended protocols had fewer screened and enrolled patients relative to plan, though they were also larger and longer, so part of that gap belongs to the kind of study that attracts amendments.4
Pricing one Phase 3 amendment: direct cost against days of delay
Three months of running cost can dwarf the amendment's own bill
One Phase 3 amendment, worked through from published figures
Median direct cost of the amendment$535K
90 days of direct trial cost, at $40,000 a day$3.6M
Our reading of the sources4,26 · $40,000 × 90 = $3,600,000. An upper bound: a trial rarely stands still for the whole wait, so count only the days your trial lost.
Show the numbers
Item
Amount
Median direct cost of the amendment
$535K
90 days of direct trial cost, at $40,000 a day
$3.6M
Tufts estimates that a day of a Phase 2 or 3 trial costs about $40,000 in direct cost.26 Lost sales are a much larger and softer number: the same research gives about $500,000 a day in its journal article and about $800,000 in its August 2024 white paper, from one set of 645 drugs.26,27 That figure applies only if the delay moves the launch, and it varies by disease.
Which amendments are worth paying for. Plenty of them. A change that follows a regulator's new advice, or that adds a country for a filing, may be the right decision on the day. The target is the amendment whose cause sat in your own files when the protocol was written.
06 · Eligibility and screen failures
Eligibility criteria and screen failure rates: how one rule shrinks the pool you planned on
In shortA Phase 3 protocol averages about 30 rules for joining. About 3 in 10 people screened are never enrolled, and in Crohn's disease trials the figure is about half. Rules multiply: each one looks reasonable alone, and together they remove most of the people you planned on. A review asks each rule for its reason and an estimate of its effect.
Crohn's disease trials lose about half of the people they screen
Mean share of screened people who fail screening, from separate studies
Crohn's disease, 5 trials53%
Ulcerative colitis, 12 trials43%
Phase 3 benchmark, all areas (our subtraction)29.3%
Prostate cancer Phase 326%
Kidney cancer Phase 325%
Bladder cancer Phase 2 and 319%
Source9,1,28 · Different samples and years, so compare with care. The Crohn's and colitis trials were all run by one contract research organization. The Phase 3 benchmark is 100% less the reported randomization rate of 70.7%.
Show the numbers
Group
Screen failure
Crohn's disease, 5 trials
53%
Ulcerative colitis, 12 trials
43%
Phase 3 benchmark, all areas (our subtraction)
29.3%
Prostate cancer Phase 3
26%
Kidney cancer Phase 3
25%
Bladder cancer Phase 2 and 3
19%
A screen failure is someone who goes through screening and is never enrolled. Each costs staff time, tests and a disappointed patient, and contributes no data.
In 17 Phase 2 or 3 inflammatory bowel disease trials, all run by one contract research organization and covering 16,913 screened people, not meeting the disease activity score was the top reason in Crohn's disease, at 23.1% of screen failures, and intestinal infections and tuberculosis screening were other major reasons.9 Reasons like these are visible in earlier trials, which is why they can be reviewed for before a new one starts.
How five reasonable eligibility rules compound
Five reasonable rules can remove most of a referred population
Out of 1,000 people referred to a Crohn's disease study
Referred with active disease1,000
Disease activity score in range720
Endoscopy confirms it520
Prior treatment rule met300
No long washout conflict230
No excluded history200
Illustrative · replace with your own numbers · Illustrative numbers, to show the shape. Run the same arithmetic on your own screening logs.
Show the numbers
Stage
Count
Referred with active disease
1,000
Disease activity score in range
720
Endoscopy confirms it
520
Prior treatment rule met
300
No long washout conflict
230
No excluded history
200
Four eligibility problems reviewers see, and what the evidence says
Problem
Why it happens
What to ask
Stricter than the intended label, the uses the sponsor hopes to have approved
The team wants a clean population or copies a harder study.
Does the rule match who the medicine is meant for? What does it cost the eligible pool?
A long time-based washout
A long gap since an earlier treatment feels safer.
How long does the earlier drug stay in the body? FDA's final cancer trial guidance of July 2026 says time-based washouts "should be scientifically justified", with the justification "clearly specified in the protocol".17,29 That text covers oncology, and the question travels.
A blanket history exclusion
"Any history of" is short to write and easy to defend.
Who is shut out by treated, minor forms of the condition?
A rule that conflicts with the design
Eligibility and randomization were written by different people.
If everyone must have failed a biologic, what does a yes-or-no biologic grouping do?
Broadening has evidence behind it, in one disease. A study emulating completed lung cancer trials on 61,094 patients found that many common criteria had a minimal effect on the hazard ratio, the measure of how much treatment changed survival, and a data-driven broadening more than doubled the eligible pool on average.30 So a strict rule may protect the result less than its authors assume. Some narrow rules protect people or the science, and those should stay. The review's job is to make each one state its reason.
07 · Schedule and burden
Participant burden in the schedule of activities: the visits and procedures a trial could live without
In shortProcedures grew far faster than endpoints. Nearly a third of procedures and data collected per protocol serve no core purpose or repeat more often than needed. Burden is real and rising, though Tufts' own workshop found no significant link between its burden score and dropout, so measure it for what it is: time and effort you are asking of people.
266
procedures across an average Phase 3 protocol, with 21.1 planned visits.1
Getz and colleagues, 2023; a sample of 187 protocols
5.9M
datapoints collected on average per Phase 3 protocol, up 11% a year since 2020.31
Getz and colleagues, 2026; 105 protocols
30%
of participant and site burden, at most, sits with non-core or non-essential procedures.31
Getz and colleagues, 2026
Countries and procedures grew far faster than endpoints
Growth in Phase 2 and 3 protocol means, 2009-2012 to 2017-2020
A newer Tufts study with 15 sponsor companies looked at where those procedures go. Non-core procedures, which support only lesser or exploratory endpoints, make up 16.2% of the Phase 3 total.
Among Phase 3 procedures that do support core and standard endpoints, 12.6% were judged non-essential, meaning they run more often than the result needs.31 Nearly half of those non-core procedures in Phase 2 and 35% in Phase 3 gather exploratory or future-use data.31 These are the first procedures a review questions, and the ones most often defended by someone who remembers why they went in.
Reading one heavy schedule: hours on site at each visit
Week 4 asks 6.5 hours of a participant, the longest visit in the sample schedule
Hours on site per visit in the fictional VLT-305 draft. Total: 38 hours. Scr is screening, F-up is follow-up
3.5Scr
5Wk 0
1.5Wk 2
6.5Wk 4
4.5Wk 8
1Wk 10
5.5Wk 12
2Wk 24
2Wk 36
5.5Wk 52
1F-up
Fictional example from this guide
Show the numbers
Visit
Hours
Scr
3.5
Wk 0
5
Wk 2
1.5
Wk 4
6.5
Wk 8
4.5
Wk 10
1
Wk 12
5.5
Wk 24
2
Wk 36
2
Wk 52
5.5
F-up
1
The sample sponsor's own standard says no visit should exceed 4 hours unless the reason is written down. Weeks 0, 8, 12 and 52 go over with a reason: a long observation period, or sedation and recovery after an endoscopy. Week 4 goes over with none, because two blood samples, the full efficacy assessment and a diary review all landed on the same day.
A home nurse could collect the later sample, and the visit falls to about 4 hours. We found no published rule that sets a 4-hour limit: this is one company's choice, and yours may differ.
What the evidence on burden and dropout says
Overall burden for patients in Phase 2 and 3 trials has risen steadily since 2011, across 156 protocols from 14 companies, driven by questionnaires, lab and blood work and routine procedures at each visit.32
The tempting next sentence, that lower burden means lower dropout, is less settled. A multi-company workshop on 66 protocols reported that "correlational analysis did not reveal a significant correlation" between the burden score and dropout, and the authors note the sample size may be why.33 Earlier work by the same group linked the score with study conduct and the number of substantial amendments.33 ICH E8(R1) gives the simpler reason to care: investigators and participants can tell you when visits "may be overly burdensome and lead to early dropouts".6 Ask them.
08 · Endpoints and estimands
Estimands and intercurrent events in a protocol: stating the exact question before the first patient
In shortAn estimand says exactly what the trial measures, including what counts when something interrupts a participant's course. ICH E9(R1) says the protocol should specify the primary estimand. Published reviews find most protocols do this badly, and a change later usually means an amendment.
Suppose a participant in a Crohn's disease trial gets worse and takes a rescue medicine at Week 8, then is free of symptoms at Week 12. Did the study drug work? That depends on the question. An event like this, which happens after treatment starts and affects how the result reads, is called an intercurrent event.
ICH E9(R1) names five things an estimand must pin down: the treatment, the population, the variable measured, how intercurrent events are handled, and the summary across the group.10 It offers strategies for each event, including treatment policy (count the result regardless), composite (count the event as a failure) and hypothetical (estimate what would have happened otherwise).10
The same trial, two estimands, two answers
How you count rescue medicine can move the result several points
Share in remission at Week 12, out of 100 participants on a study drug
Treatment policy (count it anyway)Composite (rescue counts as failure)
Illustrative result44%38%
Illustrative · replace with your own numbers · Illustrative: 38 in remission without rescue, 6 more in remission after rescue. Neither answer is wrong. They answer different questions, so the choice belongs in the protocol.
Show the numbers
Treatment policy (count it anyway)
Composite (rescue counts as failure)
Illustrative result
44%
38%
The sentence reviewers look for. "Intercurrent events will be handled as described in the statistical analysis plan." Written that way, the protocol leaves its main question open. E9(R1) says "A trial protocol should define and specify explicitly a primary estimand that corresponds to the primary trial objective".10 Better: "Rescue medication or stopping for lack of efficacy before Week 12 counts as not in remission; stopping for other reasons is handled with a treatment policy strategy." Sample wording, for your statistician to judge.
How well protocols describe estimands, in two published reviews
Most protocols published in late 2020 did not let a reader work out the estimand
Share of 50 trial protocols published in October 2020 in two journals
Estimand could not be inferred at all74%
Handling of intercurrent events could not be inferred60%
The UK review searched 29,212 protocols held by the Health Research Authority and found 122 that mention the word "estimand", under 1% of the database. Of the 81 that attempted a primary estimand, 76 were industry sponsored, and 8 listed an intercurrent event that did not meet the definition, most often missing data.35
The earlier review read protocols published in two journals, in the first year after the guideline, and found none stated the estimand outright.34 Practice has moved since then. These two studies are a warning about what to check.
This matters for amendments directly. E9(R1) says "Changes to the estimand during the trial can be problematic and can reduce the credibility of the trial."10 The M11 template tells sponsors to list changes to the primary estimand or endpoints as a change of strategy in an amendment's reasons.18
09 · Monitoring rules in the protocol
Stopping rules and monitoring in a trial protocol: why a risk known from an earlier study belongs in the draft
In shortIf an earlier study of the drug showed a problem, the new protocol should say how it will be watched and when dosing stops. Adding that later is close to the textbook amendment, and it can mean asking hundreds of people to consent again.
A medical monitor is the doctor who watches over participants on the sponsor's side of a trial. In a design review, this person reads the draft against earlier study results and the investigator's brochure, the reference file on the drug. For each risk known so far, two questions follow: is there a test at the right visits, and does the protocol say what happens when the result crosses a line?
An independent data monitoring committee, where one exists, assesses the trial at intervals and recommends whether to continue, modify or stop it.7 FDA's guidance on those committees is still a draft from February 2024.36
The rules treat a late addition as a formal event. Under US rules, "the addition of a new test or procedure that is intended to improve monitoring for, or reduce the risk of, a side effect or adverse event" is one of the listed examples of a change needing an amendment.19 The European Commission's example of a substantial modification is a new exclusion criterion for a liver risk described in the investigator's brochure.21
The same liver rule, added in the draft and added by amendment
3.4 months
from the decision to the last approval, for a rule that one sentence in the draft could have set.
Fictional study VLT-204, Amendment 4
211
participants asked to consent again. Had the rule been in the first draft, nobody would have been.
Fictional study VLT-204, Amendment 4
$204K
direct cost. In the sample, the sponsor's own standard already asked for stopping rules, which is what made it avoidable.
Fictional study VLT-204, Amendment 4
Reviewers also watch for the opposite problem. A rule copied from another drug may stop dosing for a change that means nothing here, and every extra test adds visits and blood. Medical judgment decides this, so a good review routes each question to the medical monitor by name and never settles it by default.
10 · Feasibility
Protocol feasibility assessment: screening windows, sample shipping and the sites that have to make it work
In shortEvery added country and site makes a protocol harder to run: both correlate with more amendments, longer timelines and more dropout. Feasibility review asks whether real sites can meet each window, using what they told you last time. The arithmetic is simple and usually unwritten.
Tufts tested 10 design variables against 11 performance measures across 187 protocols. The number of countries and the number of sites were each positively correlated with amendment frequency, longer screening and study duration, and dropout.5 In statistical models, endpoints, eligibility criteria, procedures per visit, countries and sites predicted cycle time, enrollment, retention and amendment frequency, even after controlling for phase and therapeutic area.5 These are correlations: big studies are hard for many reasons. But they name the design choices that are worth arguing about before anyone commits.
A Phase 3 protocol reaches about twice the countries and sites of a Phase 2
Benchmark means per protocol
Phase 2Phase 3
Countries6.113.7
Investigative sites35.182.2
Source1 · A convenience sample of 187 protocols with wide variation, so use the means with caution.
Show the numbers
Phase 2
Phase 3
Countries
6.1
13.7
Investigative sites
35.1
82.2
Worked through: why 28 days of screening was too short
A 28-day screening window leaves 3 days once the colonoscopy and the central read are done
Days, at the median, in fictional study VLT-204
Wait for a colonoscopy slotCentral readingDays left in the window
28-day window19 days6 days3 days
35-day window19 days6 days10 days
Fictional example from this guide · Half of patients wait longer than the median. The draft also asks for a 7-day symptom diary, which has to fit too. In the sample, 22% of screen failures were recorded as window expired.
Show the numbers
Wait for a colonoscopy slot
Central reading
Days left in the window
28-day window
19 days
6 days
3 days
35-day window
19 days
6 days
10 days
A colonoscopy read by a central reviewer needs a slot at the hospital and time at the reading vendor. A window set from a template ignores both. The same arithmetic applies to a blood sample that must reach a central laboratory within 72 hours at room temperature, when couriers in some planned countries cannot do it. It applies too to training for the staff who score the disease, if that training expires whenever a site opens late.
E6(R3) offers one way out: "Building adaptability into the protocol, for example, by including acceptable ranges for specific protocol provisions, can reduce the number of deviations or in some instances the requirement for a protocol amendment."7
Simple to check, easy to miss: five feasibility questions for a site panel
Windows
Can the slowest quarter of sites finish screening inside the window? Ask for the wait time at the sites you plan to use.
Shipping
Which planned countries cannot meet the stability limit? Ask couriers before the table is final.
Equipment
Does every site have the scanner or imaging the schedule assumes, or can some use a nearby center?
Standard care
Which standard treatments differ by country, so that a rule on prior therapy reads differently from place to place?
People
Who at each site does the assessment, and does training start before or after activation?
11 · Internal consistency
Synopsis, body text and schedule of activities: when a protocol disagrees with itself, sites follow the table
In shortA protocol states the same facts in several places, and they drift apart across drafts. The fix is cheap and the check is mechanical, yet people do it by eye. Sites act on the table, so a mismatch turns into deviations, departures from the protocol at a site, and those are rising fast.
Six mismatches in one draft schedule
Procedure
Synopsis or body text
Schedule table
Colonoscopy, read centrally
Week 12, in the synopsis and section 8.2
Week 10
Fecal calprotectin
Weeks 0, 4, 8 and 12
Weeks 0, 4 and 12
ECG
Screening, Week 12, Week 52
Screening and Week 52
PK sample (drug level)
Every induction visit
Weeks 0, 4, 8, 12 and 52
Anti-drug antibodies
Weeks 0, 12, 24 and 52
Weeks 0, 12 and 52
Tuberculosis test
Repeated annually
Screening only
From the fictional VLT-305 draft. The first row matters most: Week 12 is a main result, so a site following the table does the colonoscopy two weeks early.
E6(R3) asks that protocols and operational documents be "fit for purpose, clear, concise and consistent".7 In the NHS study from section 04, interviewees named duplicated text across documents as a cause of inconsistency, and recommended that research staff own document checks.8 The M11 template repeats "Ensure alignment with every other section of the protocol" in more than one section's instructions, because no layout can stop two people typing different weeks.18
Phase 3 deviations rose from 119 to 296 per protocol between two Tufts samples
Source37,3 · Separate samples. The later figures come from a Tufts report quoted in a WCG deck, read only there.
Show the numbers
Earlier Tufts sample, 187 protocols
Primary completion 2023-2025
Phase 2
75
141.8
Phase 3
119
296.3
A deviation is a departure from the protocol at a site; FDA's December 2024 draft guidance, still a draft, uses the ICH E3(R1) wording, "any change, divergence, or departure" from the protocol's design or procedures.38 In the earlier Tufts sample, deviations involved nearly one-third of patients enrolled, and procedures per visit, countries, endpoints and especially sites were associated with them.37 We found no study that counts how many amendments begin as an inconsistency, so count them in your own summaries of changes.
12 · Measuring amendment risk
Can you predict a protocol amendment? Complexity scores, past amendments and what the evidence supports
In shortComplexity correlates with longer trials and harder enrollment, and a structured review can reduce it. Predicting a specific amendment from protocol text has barely been tested: one 2026 preprint reaches moderate accuracy, on eligibility criteria only. Any likelihood on a screen is an estimate. Test it against your own past protocols before you lean on it.
Approach
What it does
What was found
What to remember
Regression on design variables
Tests counts such as endpoints, criteria and countries against performance.
Significant predictors of cycle time, enrollment and amendment frequency, on 187 protocols.5
Points to risky protocols and stops short of naming a line.
Trial Complexity Score
Machine reading of features from 16,790 trials, combined into one score.
A 10-point increase correlates with 33% to 36% longer trials, by phase.39
Consultancy authors; duration only.
Protocol complexity tool
26 questions across 5 domains, answered by a cross-functional team.
Complexity fell in 12 of 16 trials after a pass; scores correlated with site activation and enrollment.40
Authors work at one sponsor; small sample.
Text-based amendment prediction
Learns from public registry edits whether eligibility criteria will change.
Best area under the curve 0.714, where 0.5 is a coin toss, on 6,067 human-labeled trials.41
A preprint, tested on registry text alone.
Large language model review
GPT-4o read 15 trials' analysis plans and pharmacology sections.
Clear summaries, "some limitations in contextual accuracy".42
A small test; no measure of amendments avoided.
The best model in the one study we found beats chance, with a long way to go
Area under the curve for predicting eligibility amendments, public registry data. 0.5 is a coin toss, 1.0 is perfect
How a section-by-section risk figure is built, and three reasons to treat it with care
A common way to make one number from many findings is to give each a likelihood, then multiply the chances that each does not happen. Take the 12 findings on the fictional VLT-305 draft, from 22% down to 4%. Multiply (1 − 0.22) × (1 − 0.18) and so on through all 12, and you get about 0.26. So the chance of at least one is about 74%. Adding up the 12 likelihoods gives 1.26 expected amendments, and multiplying by a cost per amendment gives an expected cost.
Four findings of twelve carry the most amendment risk on the sample draft
Likelihood that each finding forces an amendment, fictional VLT-305 draft
Eligibility: two failed biologic classes22%
Feasibility: 28-day screening18%
Eligibility: 12-month washout16%
Estimand left to the analysis plan14%
Monitoring: no liver stopping rules11%
Eligibility: malignancy with no exceptions9%
Schedule: 6.5-hour visit8%
Consistency: Week 10 and Week 127%
Operations: fixed steroid taper7%
Operations: 72-hour shipping6%
Tuberculosis retest4%
Placebo assumption4%
Fictional example from this guide
Show the numbers
Finding
Likelihood
Eligibility: two failed biologic classes
22%
Feasibility: 28-day screening
18%
Eligibility: 12-month washout
16%
Estimand left to the analysis plan
14%
Monitoring: no liver stopping rules
11%
Eligibility: malignancy with no exceptions
9%
Schedule: 6.5-hour visit
8%
Consistency: Week 10 and Week 12
7%
Operations: fixed steroid taper
7%
Operations: 72-hour shipping
6%
Tuberculosis retest
4%
Placebo assumption
4%
It assumes findings are independent. Three eligibility problems may share one cause, and one amendment often fixes several things at once, so the sum overstates the count.
It depends on the archive. A likelihood drawn from 148 past amendments means little until you have checked how often those estimates came true.
It can run high. Tufts figures imply about 0.76 avoidable amendments on an amended protocol (our multiplication), so 1.26 expected on one draft deserves a question.2
A test you can run. Take 20 past protocols as they stood before their first amendment. Have the method estimate risk with no sight of what happened. Then compare it with what did happen: did the high-likelihood findings show up in real summaries of changes, and how many real amendments did it miss? We found no published study that runs this test on full protocols, so your result will be the best evidence you have.
13 · AI and regulators
AI in clinical trial design: what automation can do for a draft, and what FDA, EMA and the EU expect
In shortAutomation suits reading, matching and counting. People keep design decisions, statistics and medical judgment. We found no regulator's rule on AI in protocol review. FDA's January 2025 draft excludes tools for operational efficiency unless they affect patient safety, drug quality or the reliability of study results, and a design tool sits near that line, so keep humans deciding and every change traced.
Reading and counting fit automation; design choices stay with people
How much reading it takes →
Automate
Assist
Manual
People decide
Compare sectionsPast amendmentsAdd up hoursJudge a criterionSet sample sizeSet a stopping rule
How much judgment it takes →
Our reading of the sources42,41,43 · Our judgment, drawn from the sources cited. None of these has been measured against people on full protocols.
Show the numbers
Item
How much judgment it takes (0–1)
How much reading it takes (0–1)
Compare sections
0.10
0.80
Past amendments
0.10
0.70
Add up hours
0.10
0.60
Judge a criterion
0.80
0.54
Set sample size
0.80
0.30
Set a stopping rule
0.80
0.14
Source
Says
Status as of November 2026
FDA draft guidance on AI for regulatory decisions
Covers AI that produces information supporting regulatory decisions. Excludes tools "for operational efficiencies (e.g., internal workflows, resource allocation, drafting/writing a regulatory submission) that do not impact patient safety, drug quality, or the reliability of results". Asks sponsors who are unsure to talk to FDA early.43
Good manufacturing practice (GMP) rules. The draft Annex 22 says generative AI and large language models "should not be used in critical GMP applications".48 EMA reports that consultation comments favored allowing them under a documented control strategy, with no revised text published.49 A protocol is a clinical document, so this does not govern protocol review.
Drafts. EudraLex, the EU's published set of medicines rules, lists Annex 11 at January 2011 and no Annex 22.50
FDA Computer Software Assurance
Scope is computers and automated data processing in medical device production or quality systems. It does not cover protocol review.51
From Part 11, FDA's rule on electronic records and signatures: signed electronic records show the signer's printed name, the date and time, and the meaning of the signature.52
Three practical limits follow. A model can sound sure about a citation it invented, so every finding should show its protocol line and its source, and a person should open them. It also has no idea what your team said in last week's meeting, so its output is a set of questions for people who do. And a change suggested by a tool can move the study's question or a participant's risk, so statistical and medical suggestions go to the statistician and the medical monitor.
No rule certifies a tool for any of this. What you can get from a vendor is controls that support your compliance, which you then validate for your own use.
14 · How teams do it today
Who reviews a draft protocol today, from first circulation to the protocol review committee
In shortSix departments comment by email, one person reconciles the comments, the summary and the table get checked by eye, and a pack goes to committee. Almost nobody rereads past amendments. No public figure says how many days this takes, so the split below is an estimate to replace with your own.
The people who comment on a draft protocol, and what each one owns
Clinical scientist, protocol lead
Owns the draft. Collects every comment, defends the design and signs what was decided.
Biostatistician
Owns estimands, sample size and assumptions. Often finds a gap late, in someone else's section.
Medical monitor
Owns stopping rules and monitoring. Remembers what happened on the last study of this drug.
Clinical operations lead
Owns windows, countries and vendors. Hears from sites what the last schedule cost them.
Medical writer
Owns the document and its consistency. Keeps the template and the wording.
Committee chair
Runs the protocol review committee. Needs a pack that can be read in ten minutes, with the decisions already taken.
Five steps and four hand-offs from a first draft to a committee decision
1Draft circulated
Full protocol goes out for comment.
Protocol leadDay 0
2Comments return
Email and tracked changes from six departments.
Each departmentAbout two weeks
3Comments reconciled
Conflicts settled, some by a meeting.
Protocol leadDays
4Consistency checked
Summary, body and table compared by eye.
Medical writerA day or two
5Pack sent, committee decides
Slides or a memo, then a meeting.
Protocol lead and chairCommittee date
Illustrative · replace with your own numbers · A typical shape, in our words. Companies differ.
Show the numbers
Step
What happens
Who
Time
Draft circulated
Full protocol goes out for comment.
Protocol lead
Day 0
Comments return
Email and tracked changes from six departments.
Each department
About two weeks
Comments reconciled
Conflicts settled, some by a meeting.
Protocol lead
Days
Consistency checked
Summary, body and table compared by eye.
Medical writer
A day or two
Pack sent, committee decides
Slides or a memo, then a meeting.
Protocol lead and chair
Committee date
Where a Phase 3 draft's 23 review days might go
Collecting comments takes almost half of the by-hand days in this estimate
Working days for one Phase 3 draft, first circulation to committee: 23 in all
Collect comments10 days
Decide and redraft5 days
Check against past amendments and standards4 days
Reconcile summary, body and table2 days
Write the pack2 days
Illustrative · replace with your own numbers · One estimate for one fictional team. We found no study of review days. The four days for checking are usually the first to go when a committee date moves.
Show the numbers
Step
Days
Collect comments
10 days
Decide and redraft
5 days
Check against past amendments and standards
4 days
Reconcile summary, body and table
2 days
Write the pack
2 days
Those four days are the telling ones. Past summaries of changes usually sit in the trial master file, the official record of each study, by study and by date, with no way to ask what happened the last time a criterion like this one went into a protocol. So the memory lives in people, who move on.
In-house committee, benchmark software, outside panel or consultants: four ways to run protocol design review
Way
What it does well
Where it falls short
In-house review and committee
Knows the drug, the standards and the strategy. Decisions stick.
Depends on who is in the room and who remembers. Past amendments rarely get read.
Benchmark, simulation and complexity software
Compares a design with an outside dataset: burden, enrollment, similar trials.
Speaks to trials in general. May not reach your own history, or a line of your text.
Outside feasibility, patient or site panels
E8(R1)'s advice, in practice: people who will do the work tell you what fails.6
Takes weeks and money, and usually sees a summary, so it happens once and early.
Consultants and contract research organizations
Experienced readers with cross-company memory, on demand.
Cost per protocol. Your lessons stay in their heads.
Part B · See it working
Botminds Protocol Design Optimization on one Phase 3 Crohn's disease draft
Part A described the work without naming a product. This part shows how Botminds does it, on VLT-305, a fictional Phase 3 study by the fictional sponsor Northwind Bio. Every person, study, drug, past amendment and number on these screens is sample data. Doses and dosing weeks are left off the screens. Where a screen quotes an ICH guideline, the words are the guideline's own.
15 · VLT-305, start to finish
From a 148-page draft to a signed disposition log: a protocol amendment risk review at work
In shortThis is the example from the top of the page, inside the product. Dr. Maya Chen opens a board of eight drafts. VLT-305 meets the committee in seven days, with 12 findings. She reads one finding beside the past amendment it resembles, accepts the new wording, and watches the estimated risk fall. Other owners decide their own findings, and the draft cannot go to the committee until every high finding has a decision.
1
Eight draft protocols on one board, each section colored by risk
Each column is one draft in committee order, from NWB-118 on October 9 to VLT-307 on November 13. Each has a risk dial and a strip of its sections, colored by the strongest open finding: red for high, amber for medium, blue for low, green for decided. Across the board, 18 of 26 open findings cite a past amendment.
VLT-305 is at 73%, in seven days. The Population cell is selected, with three open findings. The section names are this sponsor's short forms of the ICH M11 headings: "Safety" stands for M11's section on adverse events, for example.18
The protocol board. Every draft before the committee, its risk and its date. A dash and a button mark a draft nobody has read yet.
2
Three eligibility findings, each beside the amendment it resembles
Below the board, §5 Population shows each finding next to its evidence. Requiring two failed biologic classes, 22% likely to force an amendment, sits beside VLT-204 Amendment 2: 4.1 months, $162K, 64 re-consented. The 12-month washout sits beside CRV-301 Amendment 1, with its 112 screen failures. "History of any malignancy" sits beside VLT-302 Amendment 1, where 37 screen failures were treated basal cell carcinoma.
Findings beside their amendments. The likelihood and the quoted line on the left, the past amendment's cost and delay on the right.
3
One click opens the summary of changes itself
VLT-204 Amendment 2 reads as the team wrote it. The criterion was not required by the target label. Investigators at 31 of 52 sites reported eligible patients being referred elsewhere. It took 52 ethics committee approvals. A reviewer can check the evidence for themselves here, because the finding links to the document.
One summary of changes. What changed, why, and what it cost, with the live findings that cite it.
4
The finding shows its line, its amendment, its standard and its guideline
The review shows the draft with every finding highlighted, and a card for each on the right. Four sources sit in the card for inclusion 3: the protocol line, the past amendment, sponsor standard NWB-STD-014 §3.2, and ICH E8(R1) §3.3. It also notes that the rule clashes with the "prior biologic exposure" grouping in section 4.2.
On the left, the dial reads 73%, with $656K of expected cost and 3.7 months of expected delay. It read 74% at first; accepting the small tuberculosis finding took it to 73%. Part A explains how a dial like this is built and why it is an estimate.
The review. The risk dial and section list, the draft with its highlights, and the finding with its four numbered sources.
5
She accepts the wording, and the risk falls from 73% to 67%
Maya accepts. "Conventional therapy (corticosteroids or immunomodulators) or at least one biologic class" goes in as a tracked change. The dial moves to 67%, expected cost to $556K and expected delay to 3.1 months. If every suggested fix were accepted, the dial would read 17%.
The arithmetic: an accepted finding keeps 15% of its likelihood, and the expected cost adds the 12 likelihoods and multiplies by $535,000, the 2016 public median for a Phase 3 amendment.4 Both are this sample's assumptions, and a buyer should replace them with their own.
Accepted as a tracked change. The old words struck through, the new ones marked, and the dial and costs updated.
6
Week 12 in the synopsis, Week 10 in Table 2
The lead reviewer compares the synopsis, the body and the schedule for every procedure and visit. A main result, the colonoscopy, is at Week 12 in the synopsis and section 8.2, and at Week 10 in the table. NXL-115 recorded 18 deviations from the same kind of mismatch before its amendment. There are six mismatches in all, each with a button to fix it in the table.
The dosing row is left blank here because the sample's dosing weeks come off the screens.
Synopsis, body and schedule compared. A red dot marks the wrong visit, a dashed ring the missing one. Hours per visit run beneath, against this sponsor's 4-hour standard.
7
The estimand goes to the biostatistician, the liver rule to the medical monitor
Each finding goes to the person who owns that area. Priya Ranvelle owns the primary estimand, which leaves interrupting events to the analysis plan. The card cites ICH E9(R1) A.6 and CRV-301 Amendment 2, where the agency asked for the strategies after the first participant was in: $610K and 4 months.
Dr. Omar Haddad, the medical monitor, owns the missing liver stopping rule, set beside VLT-204 Amendment 4, which re-consented 211 participants. A safety monitoring finding always reaches the medical monitor and is never downgraded below Medium.
An estimand finding. The sentence that leaves the question open, the suggested strategies, and the sources behind them.
8
The committee pack builds itself from the decisions
Maya clicks "Generate pack". The writer collects the decisions and reasons, draws risk by section, writes the summary and the questions for the committee, and checks that every citation resolves. The pack for Dr. Sam Patel, the committee chair, reads 74% at draft and 67% now: two accepted, one raised for the committee, nine still open, ten past amendments cited.
The committee pack. Risk by section, decisions with their amendments, and only the questions the committee must answer.
9
High findings hold the draft back until each one has a decision
Maya tries to send it. The screen stops her and lists what is still open, each with its owner and likelihood: the 28-day screening window, the 12-month washout, the primary estimand. A rejection needs a written reason. Accepting, rejecting or raising each one to the committee all count as a decision.
High findings first. The rule is a setting, on by default in this sample.
10
The protocol lead signs with her name, the time and the meaning
Once the high findings are decided, she signs the disposition log, the record of how each finding was decided. The record shows the signer, the time and the meaning: "I confirm these dispositions as protocol lead". The chair then takes the committee's decision on the protocol itself.
Signing the disposition log. The name, the time and what the signature means are recorded.
Select any screen to open it larger. The "likelihood" and "amendment risk" figures are sample estimates. They have not been validated against real outcomes, and your own back-test is the evidence to rely on. See section 12.
16 · The other screens
The amendment archive, the decision log, the design quality dashboard and your review rules
In shortAround one draft sit the screens a clinical development team uses all year: the runway of committee dates, every protocol's stage, an archive of past amendments, the log of decisions, a portfolio dashboard, and settings that hold your thresholds, owners, rules and sources.
The committee runway. Five weeks of committee dates, each draft pinned by risk, so a chair can see what is coming.
Any cell, any draft. A click re-points the panel. A finding with no past amendment rests on a guideline or a standard.
Every study. Drafts and approved protocols, searchable by phase, therapy area and stage.
The amendment archive. 148 amendments from 41 protocols, sorted by how often current reviews cite them. Each new summary of changes is read, classified and confirmed by a person.
Standards and guidelines. The sponsor's own standards with the sections reviewers cite. The ICH sentences are quoted from E9(R1) A.6, E8(R1) 3.3 and E6(R3) Annex 1 3.1.4.10,6,7
The decision log. Every finding, who decided it, when and why, with a place for the protocol lead's signature.
People and agents on one audit trail. Every step, decision and signature, with time and name. The log exports.
A rejection needs a reason. An owner can say no, and the reason goes in the log.
The dashboard. Sample data. The 72% to 24% risk fall is the solution's design target, shown here on a sample portfolio.
Where findings cluster. In the sample, the Population section in immunology carries the most findings per protocol, and the consistency check has the highest acceptance.
Your rules. Which reviewers run, when a finding is raised and what holds a draft back.
Owners and sources. Who decides each area, your own review rules, and what the reviewers read.
A monitoring finding. The draft's line, the amendment that re-consented 211 participants, and the sponsor's standard. It goes to the medical monitor. The liver thresholds on the card are the sample's own wording, for a medical monitor to judge.
A feasibility finding. The median colonoscopy wait and central read from the past study, and the wording that extends the window.
A new draft is read when it arrives. Five reviewers read CRV-215's 104 pages in parallel. The lead reviewer then compares, merges, estimates and ranks.
17 · Who reviews and who signs
Six reviewer agents, the named owners who decide, and what goes in and comes out
In shortSix specialist agents read, compare, estimate and rank. None can decide a finding or sign. A named owner decides each finding, the protocol lead signs the log, and the committee chair approves the protocol. The draft remains your controlled document.
What each protocol reviewer agent does, and where it stops
Eligibility reviewer
Reads inclusion and exclusion criteria and washouts, and compares each with the target label, your design standard and past amendments that changed a similar rule.
Its rules Every finding cites a protocol line and a source. It proposes changes and never edits the document.
Schedule and burden reviewer
Reads the schedule of activities and section 8, totals participant hours and invasive procedures per visit, and compares them with the therapy area median and your standard.
Its rules Shows the basis for each burden figure. Never removes an assessment the statistician needs.
Endpoint and estimand reviewer
Checks the five estimand attributes for each primary and key secondary objective, and flags an interrupting event with no strategy or an assumption with no benchmark.
Its rules Statistical suggestions go to the biostatistician. Never sets the sample size or changes the analysis.
Safety monitoring reviewer
Reads the investigator's brochure and earlier study results, and confirms each known risk has monitoring and a stopping or interruption rule in this protocol.
Its rules Its findings always go to the medical monitor. Never downgrades one below Medium.
Feasibility reviewer
Compares screening windows, sample shipping, vendor turnaround and country plans with site feasibility history.
Its rules Cites the site or vendor evidence. Never contacts sites.
Lead reviewer
Compares every endpoint and procedure across the synopsis, body and table, merges duplicates, estimates likelihood, ranks, assigns owners and writes the pack.
Its rules Ranks, and never decides a finding or signs. Every pack statement links to a finding.
Who decides a finding, who signs the log and who approves the protocol
Decides eligibilityDr. Maya Chen, protocol leadAccepts, rejects with a reason, or raises to the committee. Owns the draft.
Decides estimandsPriya Ranvelle, biostatistics leadEvery estimand and sample size finding comes here.
Decides safety monitoringDr. Omar Haddad, medical monitorEvery monitoring and stopping rule finding comes here.
Decides feasibilityLena Ortiz, clinical operations leadWindows, shipping, countries and vendors.
Decides consistencyDana Okafor, medical writerMismatches between the summary, the body and the table.
Approves the protocolDr. Sam Patel, committee chairTakes the committee's decision once the protocol lead has signed.
From one draft and your past amendments to a board, a pack and a signed log
From your documents
The draft protocol or synopsis, in Word
Past protocols and their summaries of changes
Design standards and procedures
Investigator's brochures and earlier study results
Site feasibility history
From your team
Owners by area
Thresholds and review rules
Whether open high findings block sending
Agents read, compare, estimate and rankEvery section of every draft, against your history
Named owners decide
No finding without its line and its source
Outputs
Protocol board: risk by draft and by section
Findings beside the past amendment or standard behind them
Consistency report: synopsis, body and schedule
Committee pack
Signed decision log
What it is designed to reach
24% average amendment risk at committee sign-off, down from 72% at first draft: design target
71% of findings accepted by owners, the rest rejected with a reason: design target (the sample dashboard shows 72%)
Records and systems a protocol review rollout connects to
Trial master fileThe source of past protocols and summaries of changes
Document managementControlled drafts, with accepted changes tracked
Word and review toolsDrafts read as Word files, split into ICH M11 sections
Feasibility recordsScreening times, procedure waits and courier times by site
Identity and rolesOwners, reviewers, signers, and who may approve whose work (maker-checker)
Audit exportEvery decision, with name, time and reason
Audit trail, signatures and credentials a clinical quality team will ask about
Every agent step, decision, pack and signature is recorded with who, what and when. The signature shows signer, time and meaning, which is what 21 CFR 11.50 looks for in a signed record.52 These are controls that support your compliance with Part 11, FDA's rule on electronic records and signatures, and validating them for your use stays with you. The agents never edit the controlled document: an accepted suggestion goes in as a tracked change, and the draft stays yours.
Botminds' information security is managed to ISO 27001 and audited under SOC 2 Type II. No product can be certified for good clinical practice or Part 11, and we make no such claim. The solution runs at enterprise scale across many drafts and therapy areas, with roles, maker-checker approvals and an exportable audit trail.
Part C · Are you ready to automate?
Automating protocol design review: what avoidable amendments cost you, what a review tool returns and how to test it
You design protocols, or chair the committee that signs them, or pay for what they cost later. This part is written for you: what amendments cost today, what automation could return, whether your team is ready, what to ask any vendor, and how to run a test that can fail.
18 · What amendments cost you
What avoidable protocol amendments cost a sponsor each year, and where to find your own number
In shortPublished figures frame the scale: a median direct cost per amendment, a wait of most of a year, and a daily cost of a running trial. Your own summaries of changes hold the real numbers. You can pull most of them in a week.
$535K
median direct cost to implement one substantial amendment on a Phase 3 protocol, $141,000 on Phase 2.4
Getz and colleagues, 2016; 52 protocols
260 days
on average from identifying the need for an amendment to the last oversight approval.2
Getz and colleagues, 2024; 950 protocols
$40K
estimated direct daily cost to run a Phase 2 or Phase 3 trial.26
Smith, DiMasi and Getz, 2024; 409 budgets
Ten Phase 3 protocols a year carry about $3.1 million in avoidable amendment cost, on published averages
Yearly direct cost of avoidable amendments, by number of protocols
$1.5M5 protocols
$3.1M10 protocols
$6.2M20 protocols
$12.3M40 protocols
Our reading of the sources4,2 · Our multiplication: protocols × 76% amended × 3.3 amendments × 23% avoidable × $535,000. It mixes two studies and a 2016 cost, and assumes every protocol is Phase 3, so replace each input with your own.
Show the numbers
Protocols a year
Direct cost
5 protocols
$1.5M
10 protocols
$3.1M
20 protocols
$6.2M
40 protocols
$12.3M
Leave lost sales out of your first case. Tufts puts a day of lost sales at about $500,000 in its journal article and about $800,000 in its August 2024 white paper, from the same 645 drugs.26,27 Such a figure counts only if the amendment moves the launch, so a case resting on it will not survive finance. Mention it only for a product close to filing, and build the case on direct costs finance can check.
Seven amendment costs to find in a week, starting with your last 20 summaries of changes
Cost
Where it hides
How to find your number in a week
Avoidable amendments
Filed as "clarification", or bundled into a larger change
Read your last 20 summaries of changes. Mark each one where the information already existed when the protocol was written
Direct cost per amendment
Vendor change orders, site fees, consent updates, system changes
Ask finance and clinical operations for totals on your last three amendments
Days to last approval
The slowest country, recorded only in a tracker
Decision date to last approval, for those same three
Re-consent
Coordinator time, early visits and withdrawals at sites
Participants re-consented per amendment, and any who left after being asked
Screen failures
Site logs, grouped by reason only at the end
Top five reasons on your last two studies, and the cost per screened person
Review days
Comment rounds that repeat, in many inboxes
Count days and comments from circulation to committee on your last five drafts
Deviations from unclear text
The deviation log, sorted by site and with no link to the wording
Group a trial's top ten deviation types and ask which would change if the protocol read differently
Worn-out sites, lost lessons and a difficult second consent: what the totals leave out
A site's patienceA site that restarted its review for your last amendment is slower to say yes to your next study.
The participant asked twiceA person who agreed to one plan gets called back to read and sign a different one.
Results that need explainingA change to the estimand mid-trial, which E9(R1) says can reduce credibility.10
Lessons that leave with peopleA monitor who remembers the liver rule moves to another company. The next draft has none.
Committee time on the wrong thingsAn hour spent on a table mismatch is an hour lost from the question only the committee can answer.
19 · Your return
What catching amendments in the draft returns: direct cost, trial days and reviewer hours
In shortPut in your own numbers. The main value is a share of avoidable amendments that never happen, and that share is an assumption until your back-test measures it. Reviewer hours are a small and easily proved second line. Defaults use published figures where they exist and illustrative ones elsewhere.
Eligibility, schedule, estimands, consistency: where a design review saves money
Amendments
Changes that never happen
A design choice fixed in the draft, because a past amendment was read in time.
avoidable amendments × share caught × direct cost per amendment
Trial days
Less waiting on approvals
Fewer days with sites on different versions and a trial held up.
amendments avoided × trial days lost × daily trial cost
Enrollment
Fewer screen failures
A broader rule or a longer window lets more screened people enroll.
people screened × fewer failures × cost per screened person
Reviewer time
Comments that do not repeat
Reviewers read findings with their evidence, and the table is checked for them.
drafts × reviewer hours saved × hourly cost
Committee
Meetings spent on decisions
A short pack with decisions taken and only real questions left.
send-backs per draft, before and after
Memory
An archive that gets read
Each new summary of changes is classified and ready for the next draft.
share of findings that cite your own history
Protocols a year, avoidable amendments and reviewer hours on your own figures
Every input marked illustrative is an assumption. Replace it with your own.
Your amendmentsWhat one costsReviewer timeYour cost
Illustrative yearly value
Avoidable amendments a year (rounded)0
Their direct cost today$0
Amendments avoided a year (rounded)0
Direct cost avoided$0
Trial days saved, valued$0
Reviewer time released, valued$0
After your yearly cost$0
Share caught at which amendments alone cover your cost (%, rounded)0
Formulas, per year: Avoidable amendments = protocols × share amended × amendments each × share avoidable Avoided = avoidable amendments × share caught Direct cost avoided = avoided × direct cost per amendment Trial days value = avoided × days lost × cost of a day Reviewer time = protocols × (hours today − hours with a tool) × hourly cost After your cost = direct cost avoided + trial days value + reviewer time − yearly cost Share that covers your cost, leaving reviewer time out = yearly cost ÷ (avoidable amendments × (direct cost per amendment + days lost × cost of a day))
The 25% caught is an assumption, and nothing published measures it. Set it to zero to see the case on reviewer time alone, which on these defaults will not cover the tool. The amendment line has to be proved by your own back-test.
In the solution's estimate, 23 review days fall to 7.5, and collecting comments gives back the most
Working days for one Phase 3 draft, first circulation to committee
By hand (an estimate)With the solution (an estimate)
Collecting comments from six departments10 days3 days
Checking against past amendments and standards4 days0.5 days
Reconciling synopsis, body and schedule2 days0.5 days
Deciding each comment and redrafting5 days3 days
Writing the committee pack2 days0.5 days
Illustrative · replace with your own numbers · The solution's own estimates, 23 days falling to 7.5, for one fictional team. Time your own next draft.
Show the numbers
By hand (an estimate)
With the solution (an estimate)
Collecting comments from six departments
10 days
3 days
Checking against past amendments and standards
4 days
0.5 days
Reconciling synopsis, body and schedule
2 days
0.5 days
Deciding each comment and redrafting
5 days
3 days
Writing the committee pack
2 days
0.5 days
Start here20 · Readiness check
How ready your clinical development team is: past amendments, standards, owners and a committee that will use it
In shortPick the answer closest to your team today. Eight questions score 0 to 2, and the last is for reflection. The meter adds up your score as you go, and each question says why it matters and what a strong answer sounds like.
1
Protocols a year
How many new protocols go through your committee in a year?
Why it mattersVolume decides whether a share of avoidable amendments is worth a tool.
A strong answer"Twelve next year, eight of them Phase 2 or 3."
2
An archive of past amendments
Can you find past protocols and their summaries of changes, in one place?
Why it mattersYour own history is the evidence that convinces your own team. No archive, no precedent.
A strong answer"All in the trial master file since 2016, about 150 amendments, and we can export them."
3
Amendment cost and delay on record
Do you record what each amendment cost and how long it took?
Why it mattersWithout this, a finding can say only "this happened before", and your case rests on someone else's median.
A strong answer"Direct cost and days to last approval for every amendment since 2020."
4
Written design standards
Do you have written standards for eligibility, burden, estimands and monitoring?
Why it mattersA reviewer can cite only what is written down. "We usually" is a poor citation.
A strong answer"Four versioned standards, including a limit on visit length and a rule on washouts."
5
Named owners by area
Is there one named person who decides each kind of design finding?
Why it mattersA finding with no owner becomes one more comment nobody answers.
A strong answer"The biostatistics lead owns estimands; the medical monitor owns stopping rules; reasons are required."
6
A committee that will use it
Does your protocol review committee work from a pack with decisions already taken?
Why it mattersA tool changes little if the committee still rereads the whole draft and reopens every decision.
A strong answer"The chair wants a ten-minute pack, and has agreed to hold high findings back."
7
Site feasibility history
Do you hold screening times, procedure waits and courier times by site or country?
Why it mattersFeasibility findings need facts from your sites, or they are one person's opinion.
A strong answer"Screening logs and vendor turnaround for our last 40 studies, by site."
8
Quality and validation
Has clinical quality agreed how an AI-assisted review tool would be assessed and validated for your use?
Why it mattersFDA's draft separates operational tools from those that affect patient safety, drug quality or the reliability of results, and your quality team needs to place the tool on one side of that line.43
A strong answer"Quality has a risk assessment; people decide every finding; we keep evidence for each release."
9
For reflection only
If you could read one past amendment before signing your next protocol, which would it be, and why was nobody able to find it last time?
0–6
Explore
Build the baseline by hand first. Read your last 20 summaries of changes, mark the avoidable ones, and write down one standard. You may find your first design rule that way, with no tool at all.
7–11
Ready to pilot
Back-test on past protocols, where you know what happened, then review one live draft in parallel with your usual process. Compare what was found, what was missed and how many findings owners rejected.
12–16
Ready to implement
Plan the rollout: archive classified, standards loaded, owners named, the committee's rule on high findings agreed, and the validation evidence your quality team asked for.
21 · Questions for any vendor
Twelve questions for any protocol optimization software vendor, us included
In shortEvery tool looks good on a clean sample. These questions test what a demonstration hides: whether it reads your history, whether its likelihoods came true, whether each finding can be checked, and who stays in charge of your document.
A
Your own amendment history
A1
Does it read my own summaries of changes, or only an outside benchmark?
Why it mattersA benchmark tells you about trials in general. Your archive tells you about your drug, your sites and your habits.
Strong answer · warning sign
Shown citing one of your amendments by study and number, in the first session.
"Our dataset covers the whole industry", with no way to load yours.
A2
Who classifies a new amendment as avoidable, and can I correct it?
Why it mattersThat judgment feeds every later likelihood, and companies draw the line differently.
Strong answer · warning sign
A person confirms each one, and corrections are logged.
It is classified automatically, and nobody can see how.
A3
What happens with a thin archive, or a first study in a new therapy area?
Why it mattersA number drawn from three past amendments means little, and should say so.
Strong answer · warning sign
It falls back to standards and guidance, and marks low evidence plainly.
The same confident percentage either way.
B
Likelihoods and whether they come true
B1
How is amendment risk calculated, and may I see the formula?
Why it mattersA dial built on independence or a public median can be off by a lot. Part A shows why.
Strong answer · warning sign
The formula is shown, with what it assumes.
"Proprietary AI."
B2
Will you back-test on my past protocols, blind to what happened?
Why it mattersWe found no published test of this kind on full protocols, so yours is the evidence.41
Strong answer · warning sign
Yes, with hits, misses and false alarms reported.
Case studies with no denominator.
B3
What does it miss? Show me an amendment it would not have caught.
Why it mattersMost amendments are called unavoidable.2 A tool that claims to catch them all is overclaiming.
Strong answer · warning sign
An honest list of misses, by type.
"We flag everything."
C
Findings a person can check
C1
Does each finding show the protocol line and an openable source?
Why it mattersA model can invent a guideline section. A person has to be able to open it.
Strong answer · warning sign
Line and source side by side, each opening at its place.
A plausible sentence quoted from "ICH guidance" with no section.
C2
Do guideline quotes match the real text?
Why it mattersParaphrase presented as quotation misleads a committee and an inspector.
Strong answer · warning sign
Pick three at random; they match word for word.
Close, but no text in the guideline says that.
C3
What is the false alarm rate, and can I tune it?
Why it mattersFifty weak findings teach owners to reject without reading.
Strong answer · warning sign
Acceptance rate reported per reviewer, with a threshold you set.
More findings presented as more value.
D
Your document, your people, your evidence
D1
Can the tool change my protocol by itself?
Why it mattersA protocol is a controlled document, and a small wording change can change the study's question.
Strong answer · warning sign
Only proposals. A named person accepts, as a tracked change.
"It auto-fixes low-risk items."
D2
What do you claim about Part 11 and good clinical practice?
Why it mattersNo product can be certified for these. You validate for your own use.
Strong answer · warning sign
Controls that support your compliance, with audit trail, signatures and validation evidence.
"Part 11 certified."
D3
Where do my unpublished protocols go, and do they train a model?
Why it mattersA draft holds your strategy and your drug's data, years before anyone sees it.
Strong answer · warning sign
Stays in your environment, not used for training, in writing, with audited security.
"Our terms cover that."
22 · A pilot plan
Testing protocol review software in ten weeks: a blind back-test, planted errors, one live draft
In shortStart with protocols you already signed, because you know how they turned out. Hide what happened, see what the tool finds, and count hits and misses. Plant errors to test the consistency check. Then review one live draft alongside your usual process, and decide on measured numbers.
A ten-week pilot ends with a decision on measured numbers
Your teamVendor
Pick 20 past protocols and gather their amendments
Load archive and standards
Blind back-test on the 20
Score hits, misses and false alarms
Plant 20 errors, test the consistency check
Review one live draft in parallel
Measure and decide
Week 0246810
Illustrative · replace with your own numbers
Show the numbers
Activity
From
To
Pick 20 past protocols and gather their amendments
0
2
Load archive and standards
1
3
Blind back-test on the 20
3
5
Score hits, misses and false alarms
5
6
Plant 20 errors, test the consistency check
5
6
Review one live draft in parallel
6
9
Measure and decide
9
10
Start with Phase 3 studies in a therapy area where you have amended often
What an amendment costs there →
Standards first
Start here
Later
Second step
Main area, Phase 3New area, Phase 3Main area, Phase 2Extension studyFirst in human
How many past amendments you can draw on →
Illustrative · replace with your own numbers
Show the numbers
Item
How many past amendments you can draw on (0–1)
What an amendment costs there (0–1)
Main area, Phase 3
0.80
0.72
New area, Phase 3
0.10
0.56
Main area, Phase 2
0.80
0.30
Extension study
0.80
0.14
First in human
0.10
0.20
Hits, misses, false alarms and how long owners took to decide
Measure
How
Why
Real amendments anticipated
Of the amendments your team judges avoidable, how many did a finding point at, on the draft as it stood before?
The number your case rests on
False alarms
Findings a senior reviewer would reject on sight
Decides whether people keep reading
Likelihood calibration
Of findings at about 20%, did about one in five come true?
Tells you whether to believe the dial
Planted errors caught
Plant 20 mismatches between the summary, body and table
Shows the check can fail
Citations that hold
Open a random 50. Does each say what the finding claims?
Must be 100% to proceed
Days to committee, and owners' time
One live draft, by step, against your last five
Your own estimate replaces ours
Questions for the working session: seven questions in three groups
Bring clinical science, biostatistics, the medical monitor, clinical operations, medical writing, quality and IT into one room.
A
What counts as an avoidable amendment here
A1
What is our test for "avoidable"?
Why it mattersPublished shares moved from 45% to about 23%, in different samples, on judgments made after the fact.4,2
Strong answer · warning sign
Was the information available when the protocol was written?
Whatever the study team felt at the time.
A2
Do we keep regulator requests that could have been anticipated in the count?
Why it mattersThey lead the published reasons.2 Some, such as a missing estimand strategy, were foreseeable.
Strong answer · warning sign
A separate tag, reviewed case by case.
All counted as unavoidable by default.
B
Who may hold back a draft, and on what evidence
B1
What does a "high" finding mean here, and who sets the line?
Why it mattersA block on sending works only if people agree with what triggers it.
Strong answer · warning sign
Set by the chair, reviewed after the first five drafts.
Left at a vendor default.
B2
What do we do when the committee date cannot move?
Why it mattersThe review is usually the first thing cut.
Strong answer · warning sign
High findings get decisions; the rest go in the pack as open.
Turn the rule off quietly.
B3
Who may reject a safety monitoring or estimand finding?
Why it mattersThese can change a participant's risk or the study's question.
Strong answer · warning sign
Only the named medical monitor or statistician, with a reason.
Anyone with edit rights.
C
How quality signs off on an AI review tool
C1
Do we treat this as an operational tool, or as affecting study reliability?
Why it mattersFDA's draft draws that line, and encourages sponsors who are unsure to talk early.43
Strong answer · warning sign
A written position, with people deciding every change.
Nobody has asked.
C2
What evidence will we keep for each release of the tool?
Why it mattersModels and prompts change, and so can findings.
Strong answer · warning sign
A rerun of the back-test set on each release, with the results filed.
A vendor's release note.
23 · Frequently asked questions
Protocol optimization questions answered: amendments, screen failures, estimands, burden and AI
In shortThe questions people ask most, each answered so it can stand alone.
What is protocol design optimization?
Protocol design optimization is checking a draft clinical trial protocol for choices likely to cost enrollment, participant burden or a formal amendment, while it can still be changed cheaply. A review reads eligibility, the schedule, estimands, monitoring rules, feasibility and internal consistency. It usually happens before the sponsor's protocol review committee signs.
How common are protocol amendments?
Protocol amendments are very common. A study of 950 protocols from the Tufts Center for the Study of Drug Development, published in 2024, found that 76% had at least one amendment, up from 57% in the 2015 data, with a mean of 3.3 amendments on protocols that were amended. Oncology protocols ran higher, at 91.1% with a mean of 4.0.
How much does a protocol amendment cost?
Tufts researchers reported in 2016 a median direct cost of $141,000 for a Phase 2 substantial amendment and $535,000 for Phase 3, from 52 protocols. A later Tufts report, read only as quoted in a WCG presentation, cites earlier Tufts studies for nearly $1 million on a typical Phase 3 amendment. Those figures leave out delay, and a trial day costs about $40,000 in direct cost by a separate 2024 Tufts estimate.
What percentage of protocol amendments are avoidable?
Two figures for avoidable amendments circulate. A 2016 Tufts study called 45% of substantial amendments avoidable. A 2024 Tufts study called 77% unavoidable, which leaves about 23% by subtraction. Both are judgments made after the fact, so test your own by asking whether the information was available when the protocol was written.
What is the difference between a protocol amendment and a protocol deviation?
An amendment changes the protocol on purpose, and goes through regulators and ethics committees before it starts, except to remove an immediate hazard. A deviation is a departure from the protocol at a site, usually found afterwards. A pattern of the same deviation at many sites can mean the protocol needs changing.
What is a substantial amendment?
A substantial amendment is a change big enough to need review. In the US, a Phase 2 or 3 change that significantly affects safety, scope or scientific quality needs a protocol amendment under 21 CFR 312.30. In the EU, a substantial modification is one likely to have a significant impact on participants' safety or rights, or on the reliability and robustness of the data. Since April 28, 2026, the UK sorts modifications into substantial, important detail and minor.
What is a protocol review committee?
A protocol review committee is a sponsor's internal group that approves a protocol's design before it goes to regulators and ethics committees, usually with clinical, statistical, medical, operations and regulatory members. We found no regulation that requires one or sets its form. Academic centers use similar scientific review committees.
What is a good screen failure rate in a clinical trial?
There is no standard for a good screen failure rate. The Phase 3 benchmark implies about 29%, since 70.7% of screened people were randomized in one Tufts sample. Crohn's disease trials averaged 53% in a 2025 study of 17 inflammatory bowel disease trials run by one contract research organization, and advanced genitourinary cancer trials ran about 20% to 30%. Compare yourself with the same disease, and read the reasons.
What are critical to quality factors?
ICH E8(R1) defines them as attributes of a study whose integrity is fundamental to protecting participants, to the reliability and interpretability of results, and to the decisions based on them. They should be identified for each study as part of designing quality in, and communicated proactively to sponsor and site staff. ICH E6(R3) builds them into good clinical practice.
What is an estimand, and must it be in the protocol?
An estimand is the exact question a trial answers: the treatment, the population, the variable, how interrupting events such as rescue medicine are handled, and the summary across the group. ICH E9(R1) says a trial protocol should define and specify explicitly a primary estimand. FDA finalized that guidance in May 2021; it is guidance and carries no legal force of its own.
How do you reduce participant burden in a clinical trial?
Start by questioning procedures that serve no core purpose: a 2026 Tufts study found nearly one-third of procedures and datapoints per protocol were non-core or non-essential. Then look at the longest visits and ask whether some steps can move to a home visit or a different day. Ask patients and site staff, as ICH E8(R1) recommends.
Can AI predict protocol amendments?
AI can predict protocol amendments only modestly, on present evidence. A January 2026 preprint trained on public registry histories reached an area under the curve of 0.714 for eligibility amendments, where 0.5 is chance, and its authors say that, to their knowledge, no earlier machine learning study had tried this. AI is more useful today for reading a draft against your past amendments and showing the evidence, while a person decides. Test any vendor's likelihoods on your own past protocols.
Does FDA regulate AI used to review a protocol?
FDA's January 2025 draft guidance covers AI that produces information supporting regulatory decisions. It excludes tools for operational efficiency that do not impact patient safety, drug quality or the reliability of study results. A tool that changes a study's design sits near that line. FDA encourages sponsors who are unsure to talk early, and a named person should decide each change.
What goes in a summary of changes for a protocol amendment?
A summary of changes lists what changed, section by section, with the reason for each change. The ICH M11 template asks for the primary reason, a brief summary and whether the amendment is likely to have a substantial impact on participants or on data reliability. Kept and classified over time, these documents are a sponsor's best evidence of its own repeat mistakes.
24 · One-page summary
Protocol design optimization on one page: the method, the 2026 rules and the terms
Print this page
In shortThe whole guide on one screen: the method, the rules as of November 2026, the readiness scale and the terms.
The method
Gather past protocols and summaries of changes. Mark each amendment: was the information available when the protocol was written?
Read each eligibility rule for its reason and its effect on the pool.
Total the hours at each visit. Question procedures that serve no core purpose.
State the estimand in the protocol, with a strategy for each interrupting event.
Give each known risk a test and a stopping rule.
Work out every window, shipment and vendor with real site numbers.
Compare the summary, the body and the table for every endpoint and visit.
A named owner decides each finding, with a reason. The lead signs, the committee approves.
Readiness: score 0–2 on eight questions: 0–6 explore · 7–11 pilot · 12–16 implement.
As of November 2026: E6(R3) in EU effect July 23, 2025, FDA final September 2025, Annex 2 EU effect January 15, 2027 · E8(R1) October 6, 2021 · E9(R1) FDA final May 2021 · M11 Step November 4 19, 2025, FDA final May 2026 · UK modifications April 28, 2026 · FDA oncology washout final July 2026 · EU Biotech Act: proposal · FDA AI guidance: draft, January 2025.
14 terms
Protocol
The plan a clinical trial follows, reviewed by regulators and ethics committees.
Sponsor
The company or body responsible for a trial.
Amendment
A formal change to an approved protocol. In the EU and UK, a modification.
Avoidable amendment
One whose cause was knowable when the protocol was written.
Summary of changes
The document that says what an amendment changed and why.
Protocol review committee
A sponsor's internal group that approves a design.
Critical to quality factor
A study attribute fundamental to protecting participants or trusting the result.
Screen failure
Someone screened and never enrolled.
Washout
A required gap between an earlier treatment and the study drug.
Schedule of activities
The table of visits and procedures.
Estimand
The exact question a trial answers.
Intercurrent event
An event after treatment starts, such as rescue medicine, that changes what a result means.
Medical monitor
The doctor who watches over participants on the sponsor's side.
Deviation
A departure from the protocol at a site.
25 · Sources
Sources
Accessed November 2026. Regulatory status statements are as of November 2026.
Getz, Smith, Kravet, "Protocol Design and Performance Benchmarks by Phase and by Oncology and Rare Disease Subgroups", Ther Innov Regul Sci 57(1), 2023. pmc.ncbi.nlm.nih.gov
Getz, Smith, Botto, Murphy, Dauchy, "New Benchmarks on Protocol Amendment Practices, Trends and their Impact on Clinical Trial Performance", Ther Innov Regul Sci 58(3), 2024 (abstract). pubmed.ncbi.nlm.nih.gov
Getz et al., "The Impact of Protocol Amendments on Clinical Trial Performance and Cost", Ther Innov Regul Sci 50(4), 2016 (abstract). pubmed.ncbi.nlm.nih.gov
ICH, E8(R1) General Considerations for Clinical Studies, Step 4, October 6, 2021. database.ich.org
ICH, E6(R3) Good Clinical Practice, Step 4, January 6, 2025. database.ich.org
Joshi, "Common Clinical Trial Amendments, why they are submitted and how they can be avoided", Trials 24:10, 2023. pmc.ncbi.nlm.nih.gov
Uzzan et al., "Screen Failures and Causes in Inflammatory Bowel Disease Randomized Controlled Trials: A Study of 16 913 Screened Patients", Inflamm Bowel Dis 31(7), 2025 (abstract). All trials run by one contract research organization. research.regionh.dk
ICH, E9(R1) Addendum on Estimands and Sensitivity Analysis, Step 4, November 20, 2019. database.ich.org
EMA, ICH E6 Good Clinical Practice scientific guideline page, read November 3, 2026. ema.europa.eu
FDA, E6(R3) Good Clinical Practice, final guidance, September 2025. fda.gov
FDA, E9(R1) Statistical Principles for Clinical Trials: Addendum, final guidance, May 2021. fda.gov
Regulation (EU) No 536/2014 on clinical trials, Articles 2 and 15. health.ec.europa.eu
European Commission, Clinical Trials Regulation Questions and Answers, section 3 on substantial modifications, July 2026. health.ec.europa.eu
Jones Day, "The Proposed European Biotech Act, 100 Days On", May 6, 2026. jonesday.com
European Parliament, Legislative Observatory, 2025/0406(COD), read November 3, 2026. oeil.europarl.europa.eu
Botto, Smith, Getz, "New Benchmarks on Protocol Amendment Experience in Oncology Clinical Trials", Ther Innov Regul Sci 58(4), 2024 (abstract). pubmed.ncbi.nlm.nih.gov
21 CFR 50.25, Elements of informed consent, April 1, 2025 edition, govinfo. govinfo.gov
Smith, DiMasi, Getz, "New Estimates on the Cost of a Delay Day in Drug Development", Ther Innov Regul Sci 58(5), 2024 (abstract). pubmed.ncbi.nlm.nih.gov
Tufts CSDD, "Quantifying the Value of a Day of Delay in Drug Development", white paper, August 2024. csdd.tufts.edu
Liu et al., "Evaluating eligibility criteria of oncology trials using real-world data and AI", Nature 592, 2021 (abstract). pubmed.ncbi.nlm.nih.gov
Getz et al., "Insights Informing Strategies for Optimizing the Collection of Clinical Trial Data", Ther Innov Regul Sci 60(2), 2026 (abstract). pubmed.ncbi.nlm.nih.gov
Dirks, Botto, Smith, Getz, "Trends in the Burden for Patients Participating in Industry-Funded Clinical Trials", Ther Innov Regul Sci 59(5), 2025 (abstract). pubmed.ncbi.nlm.nih.gov
Smith et al., "Insights from a Multi-company Workshop to Apply a Patient Participation Burden Algorithm to Protocol Data", Ther Innov Regul Sci 57(2), 2023. pmc.ncbi.nlm.nih.gov
Kahan, Morris, White, Carpenter, Cro, "Estimands in published protocols of randomised trials: urgent improvement needed", Trials 22:686, 2021 (abstract). pubmed.ncbi.nlm.nih.gov
Clark et al., "Are estimands being correctly used? A review of UK research protocols", Trials 26:310, 2025. pmc.ncbi.nlm.nih.gov
FDA, Use of Data Monitoring Committees in Clinical Trials, draft guidance, February 2024. fda.gov
Getz, Smith, Jain, Krauss, "Benchmarking Protocol Deviations and Their Variation by Major Disease Categories", Ther Innov Regul Sci 56(4), 2022 (abstract). pubmed.ncbi.nlm.nih.gov
FDA, Protocol Deviations for Clinical Investigations of Drugs, Biological Products, and Devices, draft guidance, December 2024. fda.gov
Markey et al., "Clinical trials are becoming more complex: a machine learning analysis of data from over 16,000 trials", Sci Rep 14:3514, 2024. All authors work at a consultancy that funded the work. pmc.ncbi.nlm.nih.gov
Willigers et al., "Development of a protocol complexity tool", BMC Med Res Methodol 25:205, 2025 (abstract). All authors work at one sponsor. pubmed.ncbi.nlm.nih.gov
Das, Beigi, Aptekar, Sun, "AMEND++: Benchmarking Eligibility Criteria Amendments in Clinical Trials", arXiv 2601.06300, January 2026, version July 2, 2026 (preprint). arxiv.org
Shin, Bhat, Ramanathan, "Large Language Models for Clinical Trial Protocol Assessments", Clin Pharmacol Ther 119(2), 2026 (abstract). pubmed.ncbi.nlm.nih.gov
FDA, Considerations for the Use of Artificial Intelligence to Support Regulatory Decision-Making for Drug and Biological Products, draft guidance, January 2025. fda.gov
FDA and EMA, Guiding Principles of Good AI Practice in Drug Development, January 2026. fda.gov
EMA, Reflection paper on the use of AI in the medicinal product lifecycle, adopted September 9, 2024. ema.europa.eu
European Commission, AI Act regulatory framework page, on Regulation (EU) 2026/1744, in force July 27, 2026. digital-strategy.ec.europa.eu
ISPE, GAMP Guide: Artificial Intelligence, July 2025. ispe.org
PIC/S and European Commission, draft Annex 22: Artificial Intelligence, consultation July 7 to October 7, 2025. picscheme.org
EMA, report of the multistakeholder workshop on Annex 22 of June 30, 2026, EMA/156789/2026. ema.europa.eu
European Commission, EudraLex Volume 4, read November 3, 2026. health.ec.europa.eu
FDA, Computer Software Assurance for Production and Quality Management System Software, final guidance, February 2026. fda.gov
Explore the solution, or bring one draft, your design standards and your past summaries of changes, and we will review it with you, every finding beside the line and the source behind it.
We use essential cookies to make this site work, and cookieless, anonymised analytics to understand how it's used. "Accept all" also turns on Google Analytics, which sets cookies. Privacy policy