WorkflowClinical Development

Protocol Deviation Classifier & Trend Analyst

Protocol deviation management that classifies every deviation the same way, at every site and every CRO

Every protocol deviation classified in minutes, the same way at every site, with its reason cited.

See one case, screen by screen ↓
demo41sto read, classify and check a deviation against 3 signed precedents
target6minfrom report to classification, median
target96.2%agreement with the medical monitor’s final call
target1 in 4deviations need a person; agreed routine ones confirm on their own
The problem

Why deviations wait for the monthly review — and get called differently at every CRO

A deviation is logged by a site or a CRO, and its importance is decided weeks later at the monthly deviation review. Until then nobody knows whether a participant may leave the per-protocol set, whether a serious breach clock is running, or whether a site has done the same thing three times.

Each team reads the classification spec its own way. In the sample study, Ashgrove’s CRAs call a Week 16 PASI by an untrained assessor not important because the visit was inside the window, and call a single late self-injection important. The medical monitor re-reads the protocol, the spec and old decisions for every case — and at database lock someone still has to build the Appendix 16.2.2 listing and the §10.2 summary by hand.

target≈ 9daysfrom report to classification by hand, at the next monthly review
demo79%agreement of one CRO’s proposed classifications with the medical monitor’s final call
demo196of 612participants in one Phase 3 study with at least one deviation
Where a deviation’s days go, from report to a decision (days)estimated
By hand9 days
With the solution1.8 days
  • Waiting for the monthly deviation review5 → 0 d
  • Reading the report against the protocol and spec1 → 0.1 d
  • Finding how similar deviations were called1 → 0.1 d
  • Medical monitor decision1.5 → 1.4 d
  • Into the CSR listing0.5 → 0.2 d

Estimated split for one deviation, by hand and with the solution. “By hand” means waiting for the next monthly review meeting.

How it works

How a deviation moves

Six specialist agents read, classify, compare, assess, watch and list; the medical monitor decides where opinions differ.

What comes in
Deviations inNightly + on demand · trial systems, study data, visit reports
Agents at work
Deviation readerone clean record
Then
Classifierspec row + protocol
Precedent findersigned decisions
Then
Impact assessoranalysis set + breach clock
Then
Trend watcher
CSR listing writer
A person decides
Medical monitorsigns where opinions differ
What comes out
Signed classifications
Study report listing by site
Site alerts
One case, step by step

One deviation, from the CRO’s log to a signed decision

At Site 114, the Week 16 PASI for participant 114-0087 was done by a study coordinator who is not on the assessor training log. The CRO says not important. Here is what happens next, screen by screen, in the working solution.

  1. 01Morning

    Where the study’s deviations come from, on one screen

    Dr. Maya Chen · Medical monitor

    Maya opens the solution on VLT-302, a Phase 3 plaque psoriasis study across 64 sites — 40 run by Ashgrove Research, 24 in-house. A cause map shows 418 deviations, 57 important, in 196 of 612 participants. Seven calls need her today; five are cases where a CRO and the agent disagree.

    “Every deviation classified the same way, whichever team logged it.”

  2. 02The log

    Every study, every team, one deviation log

    Dr. Maya Chen · Medical monitor

    1,192 deviations across three studies, one classification spec per study, CRO and in-house in one place. Each row shows the team’s proposal and the agent’s call side by side — “Not important → Important 0.94” — with per-protocol and breach-check flags. At the top: DV-302-0412, Week 16 PASI done by an untrained assessor.

  3. 03Opened

    The record, the two opinions and the two questions

    Dr. Maya Chen · Medical monitor

    The deviation record sits on the left, the passages that matter highlighted: the PASI and sPGA were done by the coordinator, J. Moreno, while the trained sub-investigator was on leave; the visit was on Day 113, inside the ±3-day window. In the middle a balance weighs Ashgrove’s “not important” against the classifier’s “important”, and the two ICH E3 questions are answered — reliability of key data: yes; participant safety and rights: no.

    Evidence lands on the side it supports — each point numbered back to its source.

  4. 0441 seconds

    Read, classified and checked against precedents

    The agents

    Show the run, and every step is there with its time. The deviation reader read the visit report. The classifier matched spec row EA-03 and cited protocol §8.1.2 — important, confidence 0.94. The precedent finder found 3 signed decisions on similar deviations. Because Ashgrove proposed not important, the agreement check sent it to Maya. The impact assessor flagged that 114-0087 may leave the per-protocol set for the Week 16 PASI 75 and sPGA analyses, and notified Sam Patel.

    “Read, classified and checked against 3 precedents in 41 s · 4 agents”

  5. 05Checked

    The sources behind the call, one click away

    Dr. Maya Chen · Medical monitor

    Beside the record: the protocol passage — PASI and sPGA must be done by an assessor who has completed the sponsor’s training and is listed on the site’s log — and spec row EA-03 with its action, a per-protocol review by the statistician for a primary assessment. The site’s training log lists Dr. A. Brooks and Dr. R. Ellison, and no entry for J. Moreno. The CRA’s visit report adds that this is the third time since August.

    Training log: “No entry for J. Moreno.”

  6. 06Decided

    She signs the decision, with the reason

    Dr. Maya Chen · Medical monitor

    Maya keeps “Important” and signs. The reason is drafted from the evidence: the Week 16 PASI and sPGA were done by a coordinator not on the assessor training log; visit timing was within the window but does not change the assessment. Her name, the meaning — “I confirm the classification of this protocol deviation” — and her password are recorded together.

    Had she overruled the classifier, the screen would say: “You are deciding differently from the classifier. Your reason becomes a precedent for future classifications.”

  7. 07Signed

    The decision travels back, on the record

    The agents

    The activity trail records each step after the signature: the agreement check sent the decision and reason to Ashgrove Research and notified Dana Okafor; the impact assessor confirmed the per-protocol flag for 114-0087 and notified Sam Patel; the precedent finder added the decision to the precedent library. A signed decision can be reopened — with a reason, kept in the audit trail.

  8. 08Each night

    Site 114 turns into a signal

    Trend watcher

    Site trends show important deviations per 100 participant-visits. Site 114, Hillcrest Dermatology, has risen to 3.1 — above the 2.0 threshold — with three assessments by staff not on the training log in 58 days, and two more participants reach Week 16 before Oct 30. The alert proposes one action: Create retraining action. Consistency by team shows the classifier at 96 % against the medical monitor’s final call, Ashgrove’s CRAs at 79 %.

    Alerts propose actions; people decide.

  9. 09At lock

    The CSR listing builds itself from confirmed decisions

    Priya Raman · Medical writer

    The Appendix 16.2.2 listing is grouped by site, as ICH E3 asks, and built from confirmed decisions only. With Maya’s signature, 53 of 57 important VLT-302 deviations are confirmed, and 114-0087 shows as confirmed. Next to it: the Section 10.2 draft, with a table of important deviations by cause and citations back to the log, and the DV domain tabulation.

  10. 10Next sync

    New deviations, classified as they arrive

    Dr. Maya Chen · Medical monitor

    Sync from CTMS brings in three new records — from CTMS, EDC and IRT. They are classified in 21 seconds and checked against 11 signed decisions. Two, agreed not important at 0.90 or higher, are confirmed automatically. The third — site 188 dispensed kit 4417 instead of the assigned 4471 — is important and waits for Maya, and the impact assessor flags 188-0014 for per-protocol review.

    “3 deviations classified in 21 s. Two confirmed automatically; DV-302-0421 — a wrong kit — needs your decision.”

Who it’s for

Built for everyone who touches a protocol deviation.

The same deviation, seen by the five people who carry it — from the CRA who logs it to the medical writer who lists it.

MC
Dr. Maya ChenMedical monitor · VLT-302 and CRV-118
Medical monitor
Before
Calls importance at the monthly review, re-reading the protocol, the spec and old decisions for each CRO’s log.
Now
Sees only the calls that need her — disagreements and important deviations — with the spec row, protocol section and precedents beside the record.
LO
Lena OrtizClinical trial manager · VLT-302
Study manager
Before
Spots a site’s repeating pattern when it shows up in the monthly listing.
Now
Gets a site signal when a trend rule fires — Site 114, third time in 58 days — with one proposed action ready.
SP
Sam PatelBiostatistician
Statistician
Before
Works out who may leave the per-protocol set in the run-up to database lock.
Now
Is notified as each participant is flagged, so per-protocol decisions are made as the study runs.
PR
Priya RamanMedical writer
Medical writer
Before
Assembles the Appendix 16.2.2 listing and the §10.2 summary from the log at lock.
Now
Exports a listing grouped by site from confirmed decisions only, and a §10.2 draft with every number cited back to the log.
DO
Dana OkaforLead CRA · Ashgrove Research
CRO lead CRA
Before
Proposes a classification and waits for the sponsor’s review to learn whether it stands.
Now
Gets each signed decision and its reason back in the Ashgrove log, and a drafted question when the facts need checking.
Built on the engine

6 agents. Each with one job, and hard limits.

Six specialist agents read, classify, compare, assess, watch and list; the medical monitor decides where opinions differ.

Deviation reader

Reads each deviation from CTMS, EDC, IRT and visit reports and writes one clean record: participant, visit, occurrence and awareness dates, what happened, and the system it came from — keeping the site’s own words as the description.

  • Participant IDs only — no names or contact details
  • Never edits the source system
Classifier

Assigns category, subcategory and importance against the study’s classification spec, answering the two importance questions and citing the spec row and the protocol section breached, with a confidence.

  • Cites a spec row and a protocol section for every classification
  • Answers both questions — reliability of key data, and participant safety, rights and well-being
  • Confidence below 0.90 goes to a person
Precedent finder

Finds up to five of the closest signed decisions on similar deviations in the same study and programme, from any CRO, and says how many agree with the proposed classification.

  • Only signed decisions count as precedents
Impact assessor

For each important deviation, flags whether the participant may leave the per-protocol set, whether a serious breach assessment is needed for EU and UK sites with its 7-day clock, and whether a site rule fires.

  • Never removes a participant from an analysis set — proposes to the statistician
  • Serious breach decisions stay with clinical quality
Trend watcher

Recalculates important deviations per 100 participant-visits by site, cause and team each night, and raises an alert with one proposed action when a rule in Settings fires.

  • Alerts propose actions; people decide
CSR listing writer

Builds the Appendix 16.2.2 listing by site, drafts the §10.2 summary with citations in the house CSR style, and prepares the DV domain tabulation.

  • Confirmed decisions only
  • Every sentence cites the log
Medical monitor

Signs where opinions differ. The agents propose; a named person decides.

Ask in plain words

Ask about any deviation, site or study

Ask in plain words — why a deviation was classified the way it was, what is happening at a site, which breaches are open — or tell it what to change.

Why does the agent say DV-302-0412 is important?

Because the Week 16 PASI — the primary efficacy assessment — was done by a study coordinator who is not on the assessor training log. Protocol §8.1.2 requires a trained assessor, and spec row EA-03 classifies this as important. All 3 earlier signed decisions on the same rule were important. Ashgrove called it not important because the visit was inside the window — timing is fine, but it does not fix who assessed. Confidence 0.94. The decision is yours.

What is happening at Site 114?

Site 114 (Hillcrest Dermatology, Austin) has had 3 assessments by staff not on the training log in 58 days — Week 8, Week 12 and Week 16. Its important-deviation rate rose from 0.8 to 3.1 per 100 visits since May, the highest in VLT-302. Two more participants reach Week 16 before Oct 30, so retraining now protects the primary endpoint.

Any possible serious breaches?

One open: DV-302-0410 at Site 163, Valencia — an SAE reported to the sponsor 4 days after site awareness. As an EU site it went to Omar Haddad for a serious breach assessment on Oct 2; the 7-day clock ends Oct 9. Importance is agreed: important under SR-01.

Alert me when a site has 3 assessor deviations in 60 days

Done — I added a trend rule: “Assessor not on the training log: 3 at one site within 60 days”. It alerts you and Lena Ortiz and proposes retraining. It would already fire for Site 114 (3 in 58 days). You can switch it off in Settings.

Every screen

The working solution, as it ships.

13 screens from the working solution, on its sample data. Pick one to see it large.

HomeWhere the study’s deviations come from: a cause map with important deviations highlighted, the calls waiting, and site signals.
The deviation logEvery deviation across studies, CRO and in-house, with the team’s proposal and the agent’s call side by side.
The decision benchThe record with its passages highlighted, the two opinions on a balance, the two importance questions, and the sources.
The agents’ runEach step with its time and result: read, classified against spec row EA-03, checked against 3 precedents, impact assessed.
The training logThe site’s PASI / sPGA assessor training log — and no entry for the coordinator who did the assessment.
Signing the decisionThe decision, the reason, the signer and the meaning of the signature, recorded together.
The activity trailWho did what and when, from the CRA’s proposal to the decision sent back to the CRO.
Site trendsImportant deviations per 100 participant-visits by site, alerts with a proposed action, top causes and consistency by team.
CSR listingThe Appendix 16.2.2 listing grouped by site, built from confirmed decisions only.
Section 10.2 draftThe protocol deviations section, drafted with a table by cause and citations back to the log.
DashboardDeviations classified, agreement with the medical monitor, report to classified, and the share reviewed by a person.
New deviations, classified on arrivalA sync from CTMS, EDC and IRT, classified in seconds — agreed routine ones confirmed, the important one sent for a decision.
Your study’s rulesClassification specs per study, who decides each kind of call, automatic confirmation and the minimum agent confidence.
Governance

Built for trial oversight: cited, signed, on the record.

Every call cites the spec and the protocolEach classification names the spec row and the protocol section breached, answers both importance questions, and links every point back to the highlighted passage in the record, the visit report or the training log.
Important deviations always go to a personOnly deviations where the team and the agent agree on “not important”, at or above the minimum confidence, confirm automatically. Disagreements and every important deviation wait for a signed decision.
A named medical monitor signsDecisions are signed with the signer’s name, password and the meaning — “I confirm the classification of this protocol deviation” — recorded together with the reason.
Analysis sets and breaches stay with their ownersThe impact assessor never removes a participant from an analysis set; it proposes to the statistician. Serious breach decisions stay with clinical quality, on a 7-day clock for EU and UK sites.
Source systems are read, never changedThe deviation reader never edits CTMS, EDC or IRT, and carries participant IDs only — no names or contact details.
Every step on the activity trailEach agent step and each human decision is recorded on the deviation with who and when. Reopening a signed decision needs a reason, kept in the audit trail, and a weekly quality sample re-checks automatic confirmations.
Configuration

Your study’s rules, not ours

The classification spec, who decides and when a person must look are settings — per study, changed in plain words.

SettingDefaultChoose from
Classification specificationVLT-302 v3.0 · 46 rowsUpload a new version — open and confirmed classifications are re-checked against it
CRO and agent disagreeDr. Maya ChenDr. Maya Chen · Lena Ortiz
Possible serious breach (EU and UK sites, 7-day clock)Omar HaddadOmar Haddad · Lena Ortiz
Per-protocol impactSam PatelSam Patel · Priya Raman
Confirm when CRO and agent agree on “not important”OnOn · Off — important deviations always go to a person
Minimum agent confidence0.900.80 to 0.99
Quality sample of automatic confirmations10 %5 · 10 · 20 % each week
Trend alertsSame cause at a site 3 times in 60 days · above 2.0 per 100 participant-visits · late SAE reports above twice the study rateAdd a rule
Connections

Works with the trial systems you already run

CTMSthe deviation log, synced nightly and on demand
EDCdeviations and queries from study data
IRTkit, dispensing and unblinding events
Monitoring visit reportsthe CRA’s findings and action items
Protocols and classification specseach version, indexed by section and row
Clinical study reportAppendix 16.2.2 listing, §10.2 draft, DV tabulation
What it changes

The difference, in numbers.

Every figure is labelled: a target the solution is built to, an estimate, a typical published result, or a proven one.

target
6min
from report to classification, median
By hand≈ 9 days
With agents6 min
target
96.2%
agreement with the medical monitor’s final call
Goal: 95% or better
target
1 in 4
deviations need a person; agreed routine ones confirm on their own
Reviewed by a person
24% in the last 30 days

“demo” = seen in the working solution, on its sample study data · “target” = the design goal, measured in the live solution · “estimated” = our estimate · by hand = the next monthly review meeting. Sources: ICH E3 Q&A (R1) · FDA draft guidance on protocol deviations (Dec 2024). People, companies and products named on this page are fictional — characters and sample data in the working solution.

Questions

What clinical teams ask us.

What is protocol deviation management software?

Software that takes each protocol deviation from the site or CRO log, classifies its category and importance, routes the ones that need judgement to the right person, and keeps the record ready for the clinical study report. The Protocol Deviation Classifier & Trend Analyst adds agents that read, classify, compare with precedents, assess impact, watch trends and write the CSR listing.

How does it decide whether a deviation is important?

The classifier matches the deviation to a row of your study’s classification specification, cites the protocol section breached and answers two questions: could it significantly affect the reliability of key data, and could it significantly affect the participant’s rights, safety or well-being. It gives a confidence and shows the closest signed decisions on similar deviations.

Do people stay in control?

Yes. Every important deviation, every disagreement between a team and the agent, and every call below the minimum confidence goes to a named person for a signed decision. Only agreed “not important” deviations confirm automatically, and a weekly quality sample re-checks them.

Does it handle per-protocol impact and serious breaches?

It flags them. The impact assessor marks participants who may leave the per-protocol set and notifies the statistician, who decides. For EU and UK sites it flags possible serious breaches to clinical quality with the 7-day notification clock.

Can it show which sites and CROs need attention?

Yes. Trends show important deviations per 100 participant-visits by site, the top causes, and how consistently each team classifies against the medical monitor’s final call. Alerts fire on the rules you set and propose one action, such as retraining.

Does it produce the CSR protocol deviation listing?

Yes. It builds the Appendix 16.2.2 listing grouped by site, drafts the §10.2 summary with citations back to the log, and prepares the DV domain tabulation — from confirmed decisions only.

Which systems does it connect to?

Your CTMS deviation log, EDC, IRT and monitoring visit reports, plus the protocols, amendments and classification specification for each study. Source systems are read, never changed.

How long does it take to go live?

The Agentic Solution Engine builds and deploys it from your requirements and documents — your protocols, classification specifications and a sample of past deviations — and it goes live once every quality gate has passed. We will walk you through it on your own deviations first.

See it on
your deviation log.

We’ll run it on a sample of your own deviations and classification spec.