- Before
- Builds the searches, chases full texts and keeps the PRISMA counts honest across spreadsheets: "I spend more time reconciling spreadsheets than searching."
- Now
- Sees each month's search land on the flow as a visible increment, decides the four duplicate pairs the agent was unsure of, and prepares an export whose counts already balance.
One living systematic review, from a monthly search to a signed PRISMA flow
"Effects of high-dosage tutoring on middle-school math achievement", protocol REG-2026-0318, registered March 2, 2026, is one of the reviews Halden State University's evidence synthesis service runs. Here is Wednesday, October 21, screen by screen, in the working solution.
- 01Morning
The review opens on its PRISMA flow, drawn live
Priya Natarajan · Evidence Synthesis LibrarianEvery box is a count Priya can open: 6,412 records identified, 1,431 duplicates removed, 4,981 screened, 4,542 excluded with 61 awaiting a person, 378 reports sought, 369 assessed. A chip between the screening boxes reads "112 conflicts · 3 open", and the rail beside the flow holds the review question and the six inclusion criteria, each cited to its protocol page.
One next step: decide 3 screening conflicts, due October 26.
- 02October 1, 6:00 a.m.
The saved searches re-run themselves, and the new records show
Search agentThe Search agent re-ran the six saved strategies across five bibliographic databases and one trials register and found 86 new records. It removed 19 duplicates; the Screener agents voted on the rest: 58 agreed exclusions, 6 to full text and 3 conflicts. The increment sits on the top box of the flow as "+86", so the review stays a living systematic review without a manual update cycle.
- 03Two blind votes
A screening conflict, with both reasons quoted side by side
Screener A, Screener B and the Adjudicator agentFor Moreau & Tanaka 2025, Screener A votes include at 0.82, quoting "two to four sessions a week"; Screener B votes exclude at 0.84, quoting "mean attendance was 2.3 sessions a week". The two run on different models, and their votes were sealed until both were in. The Adjudicator names the criterion they disagree on, C3 dosage, cites protocol page 5, and routes it to Dr. Imani Rhodes, who decides with a reason.
The Adjudicator has not decided any of them; they are yours.
- 04One batch
Agreed exclusions count only after a person confirms them
Daniel Ruiz · First screenerThe 58 records both agents excluded on October 1 wait as one batch, grouped by reason: 17 not a tutoring intervention, 15 outside grades 6–8, 10 below three sessions a week, 7 with no comparison group, 5 with another outcome, 4 of an ineligible design. Daniel reads a 10% random sample of six records in full before he confirms the batch.
- 059:41 a.m.
A sample size that does not match, lit in both places
Checker agentAt full text, both Screener agents included Vellacott 2023, a randomized trial from the October 1 search. The Checker agent re-derives every sample and effect size from the raw numbers and finds the abstract reports 212 students on page 1 while Table 2 on page 6 sums to 198: 101 tutored and 97 in the comparison group. Both passages light up beside the extraction form, and the study stays out of the synthesis.
The Extraction agent proposed 212. The Checker never overwrites a value; it flags.
- 06October 21
The right value, recorded with a reason, and the count ticks to 41
Dr. Imani Rhodes · Second reviewerDr. Rhodes records 198 as the analytic sample: 212 were randomized and 14 left before the spring test, 6.6% overall with a 0.2-point difference between arms. The included box ticks from 40 to 41 with her initials, all 12 values on the form are verified, and the Checker's re-derived effect size, g = 0.27, matches the paper's Table 3.
- 07Two signatures
No full-text exclusion without a reason and a second reviewer
Dr. Imani Rhodes and Daniel RuizKessler & Ahn 2024 offered tutoring twice a week. Dr. Rhodes picks the protocol reason, dosage below 3 sessions a week (C3), and the exclusion waits for Daniel Ruiz to confirm it. The person who picks a reason never confirms their own.
- 08Drafted, then confirmed
Risk of bias assessment with the sentence behind each judgment
Bias agentFor Vellacott 2023 the Bias agent drafts the RoB 2 domains with quoted passages: a computer-generated sequence held by the district research office (page 4), 91% of sessions delivered (page 7), 14 of 212 missing, 7 per arm (page 6). The analysis plan was not publicly registered, so the overall draft is Some concerns. Two reviewers confirm, and either can change a judgment with a reason.
- 09Verified values only
A meta-analysis that pools only what a reviewer verified
Checker agentThe forest plot pools 36 studies at g = 0.29 (95% CI 0.22 to 0.36, I² = 41%, random effects) on the sample data. Beside it, the Checker's findings across the included studies: 7 found and 7 resolved, among them a standard error entered as a standard deviation and a sign reversed.
- 104:12 p.m.
The flow is signed, and only then does it export
Dr. Samuel Okafor · Principal investigatorPriya prepares the export and the counts balance from 6,412 to 41. Dr. Okafor signs the PRISMA 2020 flow; the 27-item checklist reads 27 of 27 reported, and the AI-use statement for the methods names each agent, its prompt version, the 300-record calibration and the 112 disagreements decided by a second reviewer. The flow, checklist, search log, statement and audit trail export together for the journal.