Before a lab spends a year on an experiment, someone has to find out what is already known. A scientific literature search is how: you turn a question into a search, run it across the right sources, read what comes back, and tie every statement you keep to the sentence it came from. Done well, a colleague can repeat your search next year and reach the same papers.
This guide is for anyone who asks the literature a question or pays for the answer: discovery and translational scientists, computational biologists, medical affairs and medical writing teams, research librarians and information specialists, patent counsel, and the R&D leaders deciding whether to automate this work. No background needed.
Imagine you are a translational scientist at a mid-sized oncology biotech, designing the next study for a drug called CVT-416. Tumors sometimes escape drugs of this kind by making extra copies of a gene called MET. It is 8:14 a.m. on Tuesday, October 6, 2026, and your question sounds simple: when MET gain shows up, is it usually the tumor's only escape route?
A published series of 212 patients says yes, more often than not, on page 3. If that holds, a MET blood test alone could decide who enters your new study group. Your colleague's internal report on a different program, VLT-302, says something else on page 18. It sits in a report store your database search never touches.
Published plasma series · p. 3
MET gain seen in
23 of 212 samples
The only new change in
12 of those 23
Share
52%
Found by
Any database search
Internal VLT-302 report · p. 18
MET gain seen in
4 of 38 samples
The only new change in
1 of those 4
Share
25%
Found by
Only if you know to look
A MET test alonePerhaps a wider panelfour samples settle nothing, and the owner of that report needs to see the question.
Careful literature search catches this. It reads the published passage and your own report side by side, shows how small the numbers are, and sends the disagreement to the person who can settle it, before the study plan is signed.
Searching published science so that someone else can check it: strategy, sources, screening, citations and the limits on what you may copy
What a literature search is, why most cannot be repeated, how to read what comes back, and what copyright and licenses allow, explained without selling anything. If you have never run a formal search, start here.
01 · In plain words
A scientific literature search, explained: from a question to a sentence you can stand behind
A scientist has a question: does this drug's target matter in this disease, has anyone tried this combination, how many patients show this change? The answer probably exists, in part, in papers other people have written. The search is the work of finding those papers, deciding which ones count, and writing down what they actually say.
You could type a few words into a search box, and for a quick look that is fine. The trouble starts when the answer has to carry weight. A program lead wants to spend money on it. A reviewer asks where a number came from. A colleague wants to know whether you looked at last year's papers or just the famous one. If all you have is a browser history and a memory of what you read, you cannot answer any of those questions.
So a careful search leaves a trail. You write down the question in parts, the sources you chose, the exact words and filters you used, the date you ran it, and how many records came back. You record why you set papers aside. For every statement you keep, you note the paper, the page and the sentence. Librarians and information specialists call this a search strategy and its report. It is slow, and it is what lets another person check you.
Two more things make the job harder than it looks. Having a paper on your screen does not always mean you may copy it, share it or feed it to software; those rights depend on the license. And the most useful evidence may not be published at all: your own company's reports can agree with the literature or quietly contradict it, and no public database will tell you.
The route of one literature question, from wording to a kept answer
Write the question in partsThe target, the mechanism, the model system, and what an answer would have to contain: a rate, a count, a sentence.
Name the sources and write the strategyWhich databases, registries, patents and internal stores, and the exact search for each.
Run it and screen what comes backRemove duplicates, read titles and abstracts, read the full text of what survives, and record each reason for setting a paper aside.
Read the passage and tie each statement to itOne line per source: year, model system, how many, what it found, whether it supports the claim. This is the step this guide cares most about.
Keep the record, and run it againSave the strategy and the table. Check for retractions. Rerun before anyone relies on it months later.
The step numbers are a teaching aid; formal reviews add a protocol and a second reader at most stages.
Why a repeat search rarely matches, and three more surprises in literature work
Few published searches can be run again
When researchers re-ran the 453 database searches in a random sample of 100 systematic reviews, only 10.4% came within 10% of the reported result count, and one review out of 100 gave enough detail to repeat in full.1
One database leaves real papers behind
In 58 published reviews, 16% of the included references turned up in only one database.2 Cochrane, which sets the method for many health reviews, says a search of MEDLINE alone "is not considered adequate".3
A citation can point at a paper that does not say that
A review of 28 studies put quotation errors in medical journals at 25.4%, and about half of those were major.4 Copying a claim and its reference from another paper copies its errors too.
Free to read is a different right from free to mine
PubMed Central lets anyone read its articles and forbids systematic downloading from its main site.5 A company's text mining often needs its own license or exception, as sections 10 and 11 explain.
Strategy, recall, precision and screening: four words for this work
Search strategy
The exact search you ran in one database: its terms, its field tags, its filters, in order.
Recall
Of all the papers that matter, the share your search found. Reviewers also call it sensitivity.
Precision
Of everything your search returned, the share that matters. High recall usually means low precision.
Screening
Reading what came back and deciding, against written rules, what stays in and what goes out.
Quick question, rapid review or systematic review: how much proof each literature search owes its reader
In shortNo law sets a method for a discovery search. What a search owes depends on who will rely on it. A note for your own bench needs little. A systematic review for a journal or a payer owes a published strategy, two readers and a count of everything set aside. Most company searches sit between the two, with no written rule at all, while the pile of papers keeps growing.
41.4M
records in PubMed, the free index from the US National Library of Medicine, counted November 3, 2026.6
Our count
1.88M
of those carry a 2025 publication date, up from 1.26 million for 2015.6
Our count
4+ hours
a week that researchers said they spent searching for articles, in a 2019 survey of more than 3,000.7
Elsevier and Sense about Science
PubMed gains about half again as many records a year as it did in 2015
Records by publication year, millions, counted November 3, 2026
The survey behind that four-hour figure also found that between 2011 and 2019, researchers read 10% fewer articles while spending 11% more time finding them.7 It was carried out by a publisher with a charity partner, and it is seven years old, so treat it as a rough guide. We found no newer public figure for drug companies, and no market size we could verify for literature search software. To get your own figure, ask ten scientists to log a week.
What each grade of literature search owes the person relying on it
Three grades cover most of the work. The names vary from one company to the next; the difference that matters is what you could show if someone asked.
Only a systematic review owes every part of the record; a working search usually owes the two that cost least
None, a good habit, due, or a must: what reporting standards expect, and what we would expect of a careful working search
NoneHabitDueMust
Strategy saved as runDate of last searchSeveral sourcesSecond readerFlow of recordsPublished strategyWorking question for one personHabitHabitHabitNoneNoneNoneEvidence note a program will rely onDueDueDueHabitHabitNoneRapid reviewDueDueDueHabitDueHabitSystematic reviewMustMustMustMustMustMust
Systematic reviews have two reporting standards. PRISMA 2020 lists 27 items for the whole review.9 PRISMA-S adds 16 items for the search alone, including the strategy for each source "copied and pasted exactly as run" and the date of the last search.8 Those standards bind journals and many payers. Inside a company, nobody enforces them. The useful question to ask of any search is the plain one: if this answer were challenged in a year, what could you show?
Where the free text is, and why it has grown
More of the literature can be read without a subscription each year. In PubMed, the share of each year's records marked as having free full text rose from 44% for 2015 to 65% for 2025.6 A 2018 study estimated that at least 28% of all scholarly articles were open access, and 45% of those from 2015.10 NIH-funded manuscripts accepted on or after July 1, 2025 must now reach PubMed Central on publication, with no embargo.11 That is cited from a university library guide; we did not read NIH's own notice.
Two in three new PubMed records now point to free full text
Share of records by publication year with the free full text filter, percent
What you may copy, share or mine from a free article depends on its license; sections 10 and 11 explain.
03 · Writing the search strategy
How to write a literature search strategy: split the question, list the words, trade recall against reading
In shortA strategy turns a sentence into blocks of terms joined by AND, with synonyms inside each block joined by OR. Widening it finds more of what matters and gives you more to read. The way to know whether it works is to test it on papers you already know should appear. Before relying on it, have a second person check it against a short published checklist.
From one sentence to three blocks of search terms
Take the question from this guide's example: what is known about resistance to covalent KRAS G12C inhibitors through MET amplification? It has three parts that a paper must touch to be relevant. Each becomes a block, using both the database's own subject headings (in PubMed, Medical Subject Headings, a controlled list that indexers assign) and the words authors really use.
Leave this block out at first if the set stays small: fewer blocks means fewer ways to lose a paper.
A MEDLINE strategy does not transfer to another database as written: field tags, proximity operators and headings all differ. Each database needs its own translation, and each translation is a separate strategy to save. Cochrane's advice on keeping them is blunt: "The search strategies should not be re-typed, because this can introduce errors."3
Recall and precision worked through on a known set of 34 papers
You cannot measure recall on a question nobody has answered, because you do not know what you missed. The practical trick is a test set: before you search, list papers you already know belong, from a review or an expert. Then see how many of them your strategy finds. Suppose your list holds 34 papers (these numbers are illustrative).
Recall = known papers found ÷ known papers = 30 ÷ 34 = 88% Precision = relevant records ÷ records returned = 30 ÷ 1,200 = 2.5% Records to read per relevant paper = 1,200 ÷ 30 = 40
Widening one strategy found nine more known papers, at nearly four times the reading per paper
Two drafts of the same search against a test set of 34 known papers
Narrow draftWider draft
Known papers found, of 342130
Records returned, in hundreds2.412
Records read per relevant paper1140
Illustrative · replace with your own numbers
Show the numbers
Narrow draft
Wider draft
Known papers found, of 34
21
30
Records returned, in hundreds
2.4
12
Records read per relevant paper
11
40
Published reviews usually include about 3% of what their searches find: 2.94% on average across 195 reviews.13 A low precision is normal. A low recall on your test set is the warning.
The six things a second person checks in your search
Peer review of a search is cheap and it works. Cochrane "strongly" recommends it before the search runs.3 The PRESS 2015 guideline keeps the check to six points:14
Translation of the question
Does the search match what was asked, with the right concepts?
Boolean and proximity operators
Is AND where OR should be? Do the brackets group what you meant?
Subject headings
Are the headings relevant, and do they include narrower terms?
Text words
Are synonyms, spellings, plurals and acronyms covered?
Spelling, syntax, line numbers
Do the lines combine as intended, with no typos?
Limits and filters
Is each one justified? A date or language limit can drop what matters.
It catches real faults. In 137 reviews from January 2018 with explicit PubMed strategies, 92.7% of the search strategies contained some error, and errors that hurt recall were the most frequent, at 78.1%: mostly missing terms and mistakes with subject headings.12
04 · Which sources to search
PubMed, Embase, Google Scholar, registries, patents: which sources a scientific search has to reach
In shortNo single database holds the evidence. Four general sources together reached 98.3% recall in one study, and an estimated 60% of published reviews fell short of 95%. Beyond the journals sit conference abstracts, trial registries, preprints, patents and your own reports, none of which share a search box. Writing down what you left out is part of the method.
About one included reference in six sat in a single database
16 in 100
included references found in only one database, across 58 published systematic reviews; Embase supplied the most unique ones
included references found in only one database, across 58 published systematic reviews; Embase supplied the most unique ones
16 of 100
That 2017 study came from one information specialist's recorded searches, so its setting is narrow. Its best combination was Embase, MEDLINE, Web of Science Core Collection and Google Scholar, with 98.3% overall recall and 100% recall in 72% of reviews. Its authors estimated that 60% of published systematic reviews do not retrieve 95% of the available relevant references, because they skip important databases.2
The sample question in this guide comes from cancer biology. A chemistry-heavy or device question would call for other specialized sources; the same study notes that specialist databases add unique references when the topic fits.2
Search engine or database: what a repeat search needs
A database with fixed fields lets you write a statement that can be run again. A web-scale search engine is good at finding something relevant quickly. A 2020 test of 28 academic search systems found that only half could be recommended for evidence synthesis without substantial caveats, and its authors wrote that their findings "demonstrate why Google Scholar is inappropriate as principal search system".15
That is a judgment about the main search of a formal review. As a second source for a working question, or for reports and theses, it remains useful, and the 2017 study above includes it for that reason.2
Each kind of source can answer what the others cannot, and few can be repeated exactly
Our reading of how each kind of source behaves for a company's search
RarelySomeOftenYes
Exact repeatIndexed fieldsFull text searchableReviewed before releaseVisible to outsidersBibliographic databaseYesYesRarelyOftenYesWeb-scale scholar searchRarelyRarelyOftenSomeYesPreprint serverOftenSomeOftenRarelyYesConference abstractsSomeSomeSomeSomeYesTrial registriesOftenYesSomeSomeYesPatent office dataYesYesOftenSomeOftenYour internal reportsSomeSomeSomeOftenRarelySigned lab notebooksSomeSomeSomeOftenRarely
Conference abstracts show how much stays out. Across 425 reports covering 307,028 abstracts, only 37.3% were published in full, and abstracts reporting a significant result were more likely to make it (risk ratio 1.31).16 So a search of journals alone is a sample tilted toward results that worked. Librarians call the rest gray literature: abstracts, registry results, theses, regulatory reviews and company reports.
Your own reports are the part of the gray literature only you can search. A translational interim report or a signed notebook entry may hold the most relevant result in the world on a narrow question. It is also the source that a published-literature tool cannot read. Section 9 explains why that matters, and section 14 how teams handle it today.
05 · Making a search repeatable
Why literature searches cannot be repeated, and the six facts that make one reproducible
In shortStudies have tested this directly. One review in 100 could be fully repeated from its published details, and about half of searches re-run by independent specialists differed by over 10% in records found. The good news from 2026: those differences seldom changed the final result in a meaningful way. The fix is clerical. Save six facts for each search on the day you run it.
Few published searches give what someone needs to run them again
Share of searches or articles meeting each test, two studies
At least one reproducible strategy (272 articles, 2012)22%
A reproducible strategy for every database (same 272)13%
Reproduced within 10% of reported results (453 searches, reviews from 2021)10.4%
Reported all six key items (same 453)4.9%
Whole review fully reproducible (100 reviews from 2021)1%
At least one reproducible strategy (272 articles, 2012)
22%
A reproducible strategy for every database (same 272)
13%
Reproduced within 10% of reported results (453 searches, reviews from 2021)
10.4%
Reported all six key items (same 453)
4.9%
Whole review fully reproducible (100 reviews from 2021)
1%
Those figures come from two sets of published systematic reviews: 272 articles from high-impact pediatrics, cardiology and surgery journals in 2012,18 and a random sample of 100 reviews indexed in MEDLINE in November 2021.1 In the later study, six searches differed by more than 1,000% from their reported result.1 These are the formal reviews whose methods get written up. Working searches inside companies usually leave less behind, though we found no public measurement of them.
A 2026 replication adds a useful check. Two information specialists repeated the searches of 10 reviews, 43 searches in all. Record counts differed by more than 10% in 58% of searches for one replicator and 49% for the other. Eight of the 10 meta-analyses first looked not fully replicable; after screening and data discrepancies were resolved, five did. Differences were judged meaningful in one blinded replication and none of the unblinded ones.19
Its authors' reading is fair: results were not always consistent, and the inconsistencies seldom changed summary estimates in a meaningful way. An unrepeatable search is mainly a problem of trust and checking. You cannot tell which search is the rare one that mattered.
Six facts to save for each search on the day you run it
Save this
Why
PRISMA-S item
Database and its platform
MEDLINE through one vendor behaves differently from MEDLINE through another.
Date, language or study-type limits explain what was never looked at.
9 and 10
Date of the last search
Databases add and re-index records every day. The date is what a reader needs to judge staleness.
13
Records found in each source
A repeat search can only be compared with a number.
15
How you removed duplicates
Otherwise nobody can follow the count from found to screened.
16
Item numbers follow PRISMA-S.8 The 2024 study of 100 reviews checked six key items that differ slightly: database name, multi-database searching, full strategies, limits and restrictions, dates, and total records.1
When a saved search goes stale
A search answers the question as of its date. Cochrane requires a rerun if the search date is more than 12 months, and preferably six, from intended publication.3 A company can set its own clock by what is at stake. A study plan about to be signed deserves a rerun that week, in a field where a key paper can appear any month. What matters is that the reader can see the date and decide.
06 · Screening the results
Screening thousands of abstracts: how often careful readers err, and what a second reader catches
In shortScreening is reading what came back and sorting it against written rules. Trained reviewers make mistakes in about one decision in ten. One reader alone misses a median of 5% of the eligible studies, and a less experienced reader misses more. A formal systematic review takes over a year on average, which is why teams look for shortcuts. Knowing the size of the human error helps you judge any tool that claims to replace it.
67.3 weeks
mean time from registering a systematic review to publishing it, in 195 reviews, with about five authors.13
PROSPERO data to 2014
10.76%
of reviewers' abstract screening decisions were wrong against the final list, across 329,332 decisions by 86 reviewers.20
PLoS One, 2020
2.94%
of the records a review's search found ended up as included studies, on average.13
BMJ Open, 2017
From 3,000 records to about 70 studies: most of the reading ends in a no
One illustrative search, using the 2.94% mean yield on the records left after duplicates
Records found across sources3,000
After removing duplicates2,400
Kept after titles and abstracts180
Included after full text71
Illustrative · replace with your own numbers
Show the numbers
Stage
Count
Records found across sources
3,000
After removing duplicates
2,400
Kept after titles and abstracts
180
Included after full text
71
What one reader misses that two would catch
Reporting standards prefer two independent screeners because people miss things. A review of the evidence found a median of 5% of eligible studies missed when one person screened, with a range of 0 to 58%.21 The experience gap is the part to remember.
A less experienced single screener missed four times the share an experienced one did
Median share of eligible studies missed by one screener, across 23 single screenings
Those numbers rest on only four evaluations and nine reviewers, so read them as a size and a direction. When the missed studies were traced into meta-analyses, findings changed substantially in three of seven single screenings, all by the same less experienced reviewer. The authors' view is that one experienced screener can be an acceptable shortcut in a rapid review, and that single screening is not equivalent to double.21
Write the rules before you read the first abstract
Screening goes wrong when the rules form as you read. Write them first: which species and model systems count, which dates, which study designs, whether reviews and conference abstracts stay in, and what to do with a paper you cannot get in full. Record a reason for each paper set aside at full text. PRISMA 2020's flow diagram expects those counts, and a working search benefits from the same habit in a short form. Six months later, the first thing anyone asks is why a paper they know about is missing.
Screen on the passage where you can. An abstract says what the authors chose to stress. For a question about a rate or a mechanism, the number you want is often in a results table the abstract leaves out. That costs more reading, or a tool that reads full text you are licensed to use.
07 · Citations back to the source
Evidence tables and citations back to the source: one row, one passage, and the numbers behind it
In shortCitations go wrong more than people think: one in four to one in seven in medical journals, depending on how you count. Extraction into tables also goes wrong. The defense is a table in which every row carries its model system, its count, its effect and the exact passage. Reading the count beside the percentage stops a small sample from looking like a finding.
Citing and extracting are both error-prone, with published figures from about 12% to as high as 50%
Published error rates; each study defines its own denominator
Data extraction errors, highest rate reported50%
Quotation errors of any size, meta-analysis of 28 studies25.4%
Quotation errors, recalculated per quotation, 15 studies14.5%
Major quotation errors, meta-analysis of 28 studies11.9%
Quotation errors of any size, meta-analysis of 28 studies
25.4%
Quotation errors, recalculated per quotation, 15 studies
14.5%
Major quotation errors, meta-analysis of 28 studies
11.9%
The two quotation figures use different denominators. The 2015 meta-analysis found 25.4% in total,4 and the 2017 recalculation, counting per quotation, found 14.5%, of which 64.8% were major: the source failed to support or contradicted the claim.23 On extraction, a methods review reports "up to 50%" from only four studies of error frequency, and warns that the evidence base is weak.22
Six columns that let a reader judge one source line
Column
What it holds
What goes wrong without it
Source
Paper or report, with what is needed to find it again
A result nobody can trace
Year
Publication date
An old assay read as if it were new
Model system
People, plasma, biopsy, xenograft, cell line
A cell line result quoted as if measured in patients
n
The count behind the effect
A percentage hiding four samples
Effect
The number, in the source's own words
A rounded or recalculated figure drifting from the paper
Stance and passage
Supports, contradicts or limits, with the sentence
A claim only the writer can check
Reading 12 of 23 against 1 of 4: why the percentages mislead
Take the two numbers from the example at the top of this page. They are fictional, and the arithmetic is what matters. The published series found MET gain alone in 12 of 23 samples, 52%. The internal report found it alone in 1 of 4, 25%. They look like a clear disagreement, so we worked out how much these counts can tell you.
52% against 25% looks like a gap, and with these counts the two ranges overlap almost completely
Exact 95% confidence interval for each count, percent, worked for this guide
Low end of rangeHigh end of range
Published series, 12 of 2330.6%73.2%
Internal report, 1 of 40.6%80.6%
Fictional example from this guide
Show the numbers
Low end of range
High end of range
Published series, 12 of 23
30.6%
73.2%
Internal report, 1 of 4
0.6%
80.6%
On a Fisher's exact test, a standard test for small counts, the two-sided p value is 0.60. Those four samples cannot show the published series wrong. They also cannot be dismissed, because the internal report describes a different population and a second alteration, confirmed in two matched biopsies. The right response is to go and find out: more samples, a look at the assays, a word with the author. A good search hands the person that question, with the counts in plain sight.
Quote, never recalculate. Copy the effect in the source's own words. If you add a calculation of your own, as we just did, label it as yours and keep the original number beside it.
08 · Retractions and preprints
How to find retracted papers before you cite them, and why preprints need their own label
In shortPubMed marks retracted papers, and you can filter on the mark in minutes. The hard part is the citations made before the notice, and the answers you already kept. Few later citations mention the retraction at all. Preprints are a separate issue: they are growing fast, and they are useful as long as the row says what they are.
35,403
PubMed records carried the Retracted Publication type on November 3, 2026.6
Our count
5.4%
of 13,252 citation passages written after a retraction acknowledged it.24
PubMed Central subset, 1960 to 2020
70,563
PubMed records carried the Preprint type on the same day, 20,951 of them dated 2025.6
Our count
Papers dated 2022 carry more retractions than any other recent year, and later years are still filling in
PubMed records with the Retracted Publication type, by the paper's publication year, counted November 3, 2026
Each bar counts papers by the year they were published. A retraction often comes years after publication, so the low numbers for recent years will rise, and they show no fall.
What PubMed marks, and what the mark leaves out
The National Library of Medicine gives a retracted article the Retracted Publication type and the phrase "Retraction in:" on its record, and links a separate notice carrying "Retraction of:".25 It covers partial retractions and corrections under errata, which can touch the very table you cited.25 It also does not separate articles retracted for honest error from those retracted for misconduct, plagiarism or the like.25 So a mark tells you to go and read the notice. It does not tell you why the paper was withdrawn or who was at fault.
Three checks cover most of the risk. Run the filter on your reference list before anything leaves your team. Read each notice and erratum it turns up: Cochrane expects reviewers to read relevant retraction notices and errata, including for studies already included when a review is updated.3 And recheck what you already kept: a saved table has no way of knowing that a source was withdrawn after you made it.
The citations made before the notice
One study followed the publications of a single research group with 113 published integrity concerns. Of 3,925 references to papers with a published concern, 3,688 appeared in articles published before the concern, and very few later publications assessed the effect on their own findings.26 Across PubMed, retracted papers kept being cited, and "only 722 (5.4%)" of 13,252 post-retraction citation passages acknowledged the retraction.24
Nearly all the citations of one group's questioned papers came before anyone raised a concern
94 in 100
references to papers with a published integrity concern appeared in articles published before the concern: 3,688 of 3,925, for one research group with 113 concerns
references to papers with a published integrity concern appeared in articles published before the concern: 3,688 of 3,925, for one research group with 113 concerns
94 of 100
Preprints: useful, early and labeled
A preprint is a paper shared before peer review. In a fast field it may be the only source for several months. Treat it as you would any row: name what it is, say it has not been reviewed, and check again for the published version. PubMed indexes only some preprints, so the count above understates what preprint servers hold.
09 · When findings disagree
When published findings and your own lab disagree: what the reproducibility studies do and do not show
In shortCompany scientists have long reported that published results often fail to match their own work. One much-quoted count from Bayer found published and in-house data in full agreement in about a fifth of 67 target projects. A large open project repeating cancer biology experiments found effects a median 85% smaller. A disagreement usually has ordinary causes, and finding one early is cheap, if someone is assigned to look.
In one company's review of 67 target projects, 43 were highly inconsistent with the published claims
67projects
Highly inconsistent43
Matched published findings14
Mostly or partly reproducible, or not applicable10
That analysis covered most of Bayer's work in oncology, women's health and cardiovascular medicine over four years, and it was reported in 2011.27 It counts in-house projects, and it is the company's own retrospective with no shared data. It is fair to say the two sets of results disagreed. It is less fair to say the papers were wrong. A year later, scientists at Amgen reported a success rate of 11% in their own check of preclinical cancer papers.28
The open attempt to measure this properly was the Reproducibility Project: Cancer Biology. Of 193 experiments it planned to repeat from high-impact papers, it completed 50, because the original papers often lacked the detail or the materials. Across those, the median effect in the replications was 85% smaller than the original, and 40% of 97 positive effects replicated by three or more of five binary tests.
The authors add a caution worth keeping: "A successful replication does not definitively confirm an original finding or its theoretical interpretation", and a failure does not disconfirm one, though it suggests more investigation is needed.28
Three checks of published preclinical results found 11% to 40% holding up, each by its own measure
Different companies, fields and tests, so no trend can be read across them
Cancer biology replication project: positive effects replicated on three of five tests (39 of 97), 202140%
Bayer: target projects where in-house data matched the published claims (14 of 67), 201120.9%
Amgen: success rate in its check of preclinical cancer papers, 201211%
Cancer biology replication project: positive effects replicated on three of five tests (39 of 97), 2021
40%
Bayer: target projects where in-house data matched the published claims (14 of 67), 2011
20.9%
Amgen: success rate in its check of preclinical cancer papers, 2012
11%
The best-known dollar figure is an estimate: more than 50% of US preclinical research irreproducible, about $28 billion a year. Its authors built it from four categories of error, study design, biological reagents and reference materials, laboratory protocols, and data analysis and reporting, and their own bounds run from 18% to 88.5%.29 It shows the likely scale of the problem and does not measure one company.
The ordinary reasons two good labs get different answers
What may differ
What to check in the two passages
Population or model
Plasma against tissue; lung against colorectal; a cell line against a mouse
Assay and threshold
The cutoff that counts as a "gain", the input amount, the panel's reach
Timing
When the sample was taken, and how long after treatment
Reagents
Cell line source, passage number, antibody lot
Sample size
The count on each side, as section 7 worked through
Analysis
What was pre-specified, and what was excluded
Most of these sit in the methods sections and the internal report's appendix, which is why the check needs both documents open at once. It also needs a named person to rule on it, usually whoever owns the internal data. A disagreement with no owner stays a surprise until the wrong moment: a reviewer's question, a failed study or a board meeting.
10 · Copying and sharing papers
Copyright for corporate research: what a company may copy, keep and share from a journal article
In shortAccess to a paper does not settle what you may do with it. In the US, the leading case on company scientists copying journal articles went against the company. Your rights come from your subscription or license, any open license on the article, and the law in each country. Most companies run on a collective license plus publisher agreements, and the terms of both decide the answer.
General information. This section and the next describe public sources as of November 2026. They are not legal advice. Your counsel and your library licensing team should decide what your company may do.
The Texaco case: why copying for company research is judged differently
US law allows fair use after weighing four factors: the purpose, including whether it is commercial; the nature of the work; how much is used; and the effect on the market for it.30 In American Geophysical Union v. Texaco, 83 publishers sued over a company scientist who photocopied eight articles from a chemistry journal for his files. The appeals court held that this was not fair use.31
The court was careful about its scope. It treated the scientist as one example of 400 or 500, and the question as "institutional, systematic copying". It did not decide on copying "by an individual, for personal use in research". It also gave weight to the working market for licenses, including the Copyright Clearance Center (CCC).31
Scientists sometimes assume that research itself makes a copy fair. That court said the idea of a use with a new purpose would be stretched "beyond recognition" if it applied simply because the copier "acted in the course of doing research".31
What each kind of article lets a company do
Being able to read an article rarely settles copying, sharing or mining
Our reading, not legal advice, for a company in the US or EU. License: needs one. Check: read your terms. Often: commonly allowed. Open: open terms, or your own work
LicenseCheckOftenOpen
Read itKeep a copy for your teamQuote a short passage internallyMine it with softwareAbstract in PubMedOpenCheckOftenCheckSubscription articleOpenCheckOftenCheckCC BY open accessOpenOpenOpenOpenCC BY-NC open accessOpenCheckOftenLicenseFree on a publisher site, no open licenseOpenLicenseOftenCheckAuthor manuscript in PubMed CentralOpenCheckOftenCheckYour own internal reportOpenOpenOpenOpen
NLM's data include "abstracts originating from publications that may be protected by U.S. or non-US copyright law", and users are advised to consult counsel.34
A free index does not license its abstracts for every use.
PubMed Central
Systematic downloading from the main site is prohibited. Its OAI-PMH, FTP and Cloud services are the routes for automated retrieval, and copyright holders' terms can still apply.5
Use the sanctioned services and the Open Access Subset, and read each article's license.
Publisher license
Elsevier's public policy enables researchers at subscribing academic institutions to mine for non-commercial research. Corporate subscribers are told to contact their account manager.33
Your subscription may not carry mining rights. Other publishers set their own terms.
Open licenses
Creative Commons' guide says commercial mining is allowed under CC BY, and "you may not mine" under its NonCommercial licenses where permission is needed.35
Sort your corpus by license. An open access paper can still be off limits. The guide dates from 2014.
Collective license
A March 2026 trade press report says CCC's Annual Copyright License carries "internal-only AI re-use rights for businesses", and its AI Systems Training License covers uses outside the organization.36 We did not read CCC's own terms.
Ask CCC which works and rightsholders the AI rights cover, and read the exact terms.
Reprints and team folders: where everyday copying happens
The everyday risks are small and frequent. A shared folder of PDFs built by a project team. A set of articles sent to a partner or a contract research organization, which is an outside party. A reprint a medical team hands to a doctor, which normally needs its own permission. A PDF uploaded into a consumer AI tool to get a summary. Each of these copies a work, and each one may or may not be covered by the license.
A good rule is to share links where you can, keep citations and short passages in the record, and have your library or legal team write down what is allowed so scientists do not have to guess.
11 · Text mining and AI licenses
Text and data mining at a company: the EU, UK and US rules, and why AI search raises a new question
In shortThe EU lets anyone mine lawfully accessible works unless the rightholder reserves the right. Its stronger research exception is closed to most companies. The UK's exception is for non-commercial research only. US law rests on fair use, and in September 2026 an appeals court ruled against a company that copied a rival's content to build a tool that returned passages. Licenses do most of the real work. Ask yours three questions.
The rules on mining and AI use of text were still moving in late 2026
1994Texaco
US appeals court: systematic copying by a company's scientists is not fair use.
2019EU Directive 2019/790
Articles 3 and 4 create the two text and data mining exceptions.
May 2025US Copyright Office
Pre-publication report: retrieval that summarizes works is less likely to serve a new purpose.
December 2025Hamburg appeal court
A natural-language reservation was not machine-readable on those facts. A further appeal is admitted.
March 2026UK government report
An exception with an opt-out is no longer the preferred way forward; more evidence first.
September 2026Thomson Reuters v. ROSS
Third Circuit: copying headnotes to train a passage-returning tool was not fair use.
PendingEU Court of Justice
Like Company v Google, the first text and data mining referral.
Article 3 covers research organizations and cultural heritage institutions, for works they have lawful access to. Article 2 excludes a body whose results a controlling company can enjoy preferentially. Article 4 lets anyone mine lawfully accessible works unless the rightholder has expressly reserved the use "in an appropriate manner, such as machine-readable means" for content online.32
A company generally relies on Article 4. Check for reservations. Article 7 makes contract terms against Article 3 unenforceable and does not list Article 4,32 so a license can narrow Article 4.
United Kingdom
Section 29A allows copies for computational analysis "for the sole purpose of research for a non-commercial purpose", for people with lawful access, and contract terms cannot override it.41 The government's March 2026 report says an exception with an opt-out is "no longer the government's preferred way forward", and proposes gathering more evidence.39
Section 29A does not cover commercial mining, so a company generally needs a license. Watch for later changes.
United States
No specific exception. Fair use weighs four factors case by case.30
A commercial purpose and a working license market can count against a company, as they did in Texaco.31
Other countries have their own rules; check with counsel wherever your scientists sit. A German appeals court has already shown how much detail matters: in the LAION case, it found a rights reservation "not machine-readable" on the facts, and the case can still go further.40 We read a law firm's note on that judgment, not the judgment itself. The Directive, section 29A, the UK government's report and the Third Circuit's opinion below were read in their official texts.
Training, indexing, quoting and summarizing are four different uses
Writing about AI and copyright mostly discusses training models on books. A company's literature search does something narrower, and it matters which of these it does.
Use
What the software does
The question to ask
Index
Stores a copy of the text, in chunks and as numbers, so that it can be found
Does our license cover a copy held in a third party's system?
Quote
Shows the exact passage beside an answer, with a link
How long may a quoted passage be, and who may see it?
Summarize
Writes new text from what it retrieved
Is this abridging the work? The Copyright Office thinks that matters.
Train
Changes a model using the text
Is our content used to train anyone's model? Get a written answer.
The US Copyright Office's May 2025 report, still labeled a pre-publication version, treats retrieval separately from training. In fair use terms, it says retrieval is less likely to serve a new purpose when the aim is to generate outputs that "summarize or provide abridged versions of retrieved copyrighted works", as opposed to hyperlinks, and that it can also substitute for the original in the market.38 The report is the Office's analysis, and courts are not bound by it.
The Third Circuit decided Thomson Reuters v. ROSS on September 29, 2026, under seal, and filed the public opinion on September 30. Contractors working for ROSS used Westlaw headnotes to write the memos that trained ROSS's legal research tool, a point ROSS did not contest on appeal. The court noted the tool "was not a generative AI" and "would only return text passages", found that ROSS's use shared "the same ultimate purpose" as Westlaw's and added little new, and held it was not fair use, affirming a partial summary judgment on 2,243 headnotes.
In a footnote it set this apart from the generative models in Bartz v. Anthropic and In re OpenAI, and it weighed the fact that ROSS meant to compete with Westlaw.37 Our reading: a drug company reading papers for its own research builds no rival to a journal, so the opinion does not decide that situation, and it shows that a tool which only returns passages gets no automatic pass.
Three license questions to settle before any tool reads your full text
Which texts, by which right?
List each source: abstract, open access by license type, subscription, purchased article. Name the right that covers each.
Whose systems hold the copy?
Your license may cover your own servers and say nothing of a vendor's. Ask where the text and its numeric index sit.
Who sees what comes out?
Internal rights stop at your walls. A partner, a CRO or a publication needs its own check.
12 · Patents beside papers
Non-patent literature and patent search: keeping a claimed dose apart from a measured one
In shortPatents show what other groups think is worth protecting, often before they publish. They also lag: applications generally stay hidden for 18 months, so a clean search says nothing about the most recent filings. The largest trap is reading a claim as a result. A claimed dose range states what an applicant wants to protect, and it measures nothing. Whether a position is safe is a question for counsel.
A search cannot see a patent application for its first 18 months
The usual US path, from 35 U.S.C. 122(b)
Month 0Earliest filing date
The application exists. No search can find it.
Months 1 to 18The unseen period
A competitor may already hold a filing on your idea.
About month 18Publication
Published promptly after 18 months, unless the applicant filed a qualifying request not to publish.
LaterGrant, if any
Granted claims can differ from those first published.
Patent examiners search both patents and everything else, which they call non-patent literature. A document counts as a printed publication if it was "disseminated or otherwise made available to the extent that persons interested and ordinarily skilled in the subject matter or art exercising reasonable diligence" can locate it.42 Public availability is the test, and peer review is not required. That is why a poster or a thesis can count. It cuts both ways: your own conference abstract can count against your own later filing, depending on timing and country.
US rules also put a duty of candor on those substantively involved in filing a patent application: they must disclose information known to them that is material to patentability.43 So what your team's searches turn up can matter to your counsel, and who sees those results should be a deliberate decision.
Why a claim and a result need different labels in one table
In a merged list, a patent and a paper look alike: a title, a date, a dose. They mean different things. A paper reports what someone measured. A claim of, say, 200 to 400 mg draws a boundary around what the applicant wants to protect. Count it as support on a claim about doses in people and you have invented evidence. Keep patent rows visibly separate in any table, count them apart, and write "no result in people" when that is the truth.
A freedom-to-operate opinion comes from a patent professional. Claim scope, family status, the countries a patent covers and legal status all need one. A search tells counsel what to read.
13 · AI literature search
What AI literature search gets right and wrong: hallucinated references, missed papers and who answers for them
In shortModels asked to produce references from memory invent some (often called hallucinated references), even in 2026. Models with web search still write statements their sources do not support. In one test, a purpose-built research tool found 39.5% of the included studies, against 94.5% for traditional searching, though it needed far less reading. AI screening does better, at about 92% sensitivity. FDA's draft guidance leaves drug discovery out, and evidence groups and journal editors keep responsibility with people.
Invented references fell sharply between tests, and half the citations still carried an error
Different tests, models, questions and definitions, so no trend can be read across them
Invented references, Bard, 2024 test91.4%
Invented references, GPT-3.5, 2024 test39.6%
Invented references, GPT-4, 2024 test28.6%
Fabricated references, GPT-5, 2026 test7.13%
Citations accurate in every field, GPT-5, 2026 test49.3%
Citations accurate in every field, GPT-5, 2026 test
49.3%
The 2024 test counted a paper as invented if any two of title, first author or year were wrong, and models found few of the right papers: recall was 11.9% and 13.7% for the two GPT models.44 The 2026 test ran 350 queries in one specialty, and 8% of queries had only fully accurate citations.45
Giving the model the web helps with this failure and leaves another. Across seven models and 58,000 statement and source pairs, between 50% and 90% of responses were not fully supported by the sources they cited, and about 30% of individual statements from one web-searching model were unsupported.46
High precision, low recall: one AI research tool against traditional searching
An AI research tool needed far less reading and found far fewer of the studies
Averages across four evidence syntheses, percent
Original review searchAI research tool
Sensitivity: included studies found94.5%39.5%
Precision: share of results that were relevant7.55%41.8%
Those four case studies concern one version of one product, and its authors note that it keeps changing. They also found that the tool turned up some studies the original searches missed, and they called it a useful adjunct and too insensitive to replace traditional searching.47 That points to a fitting use: a fast first look, with a formal search still required when missing a paper would matter.
Screening is where the evidence is strongest. A systematic review of 148 performance assessments reported median agreement with human reviewers of 0.92 on included records and 0.89 on excluded ones for title and abstract screening, with a wide spread between studies.48 A 2026 meta-analysis of 18 studies pooled sensitivity at 0.92 and specificity at 0.94.49 Set that against the 10.76% human error rate from section 6 and you can see why teams are interested, and why a tool's result still needs measuring on your own question.
Five jobs called "AI literature search", and how far each can be trusted
Job
How it fails
The check that fits
Answer from a model's memory
Invented references, confident tone
Do not use for evidence.
Write a Boolean strategy for a person to run
Missing terms, wrong field tags
Test against known papers, and have a second person review it with PRESS.
Rank and retrieve by meaning
Silent misses; a ranking that shifts
Measure recall on a test set, and record the version and date.
Screen titles and abstracts
Missed eligible studies
Run it beside a person on a sample, and report its use.
Write an answer with citations
A real source that does not say that
Read each statement against its passage.
What FDA, EMA, editors and evidence groups say about AI in this work, as of November 2026
Who
Status
What it says for literature search
FDA
Draft, January 2025. Still a draft on FDA's page.
Covers AI producing information to support regulatory decisions about a drug. It "does not address the use of AI models (1) in drug discovery or (2) when used for operational efficiencies".50 Our reading: internal research search falls outside it, and a number going into a submission raises the question again.
EMA
Final reflection paper, adopted September 9, 2024.
Discovery "can be low regulatory impact if non-optimal performance only affects the developer". If results contribute to the evidence for regulatory review, non-clinical principles should be followed.51
FDA and EMA together
Ten guiding principles, January 2026. High level.
Principles such as "Human-centric by design", "Risk-based approach" and "Clear context of use".52
EU AI Act
In force; high-risk dates moved by the AI Omnibus to December 2, 2027 and August 2, 2028.53
Excludes AI "specifically developed and put into service for the sole purpose of scientific research and development", and its recitals keep other AI used in research in scope.54 As amended by the AI Omnibus, providers and deployers must "take measures to support the development of AI literacy" of their staff.53
Draft EU GMP Annex 22
Draft on November 3, 2026; not in EudraLex Volume 4.
Its limits on language models concern critical manufacturing applications, so it does not govern a discovery search. EMA's workshop report says the scope is under discussion.55
Cochrane, Campbell, JBI, CEE
Joint position statement, November 2025.
Those doing the review remain "ultimately responsible". AI use must not compromise rigor, and AI that makes or suggests judgments must be reported with human oversight.56
Journal editors (ICMJE)
Current recommendations, read November 3, 2026.
AI tools should not be listed as authors; "humans are responsible", must review and edit AI output, and must attribute quoted material. "Referencing AI-generated material as the primary source is not acceptable."57
Once a literature answer enters a regulated record, such as a filing or a quality document, the usual rules for that record apply to it: who wrote it, who checked it, and whether it can be traced to its source. Controls in a tool can support that work. The responsibility stays with your people, and so does the checking.
14 · How teams search today
How R&D and medical teams run literature searches now: the scientist, the librarian and four separate search boxes
In shortIn most companies, the scientist does the searching alone, a library or information team helps on bigger jobs, and patents and internal reports are searched separately, if at all. The answer goes into slides or email, and the next person starts again. In the illustrative week below, most of the time goes on finding, tabulating and checking, and reading gets what is left.
Scientist, information specialist, program lead: who touches a literature question
TS
Discovery or translational scientist
Asks most of the questions and does most of the reading, usually alone, and usually between experiments.
Cares about: the passage, and whether our data agrees.
IS
Information specialist or research librarian
Builds formal strategies, runs the databases and manages licenses. In one study only 17% of articles reported that a specialist was involved.18
Cares about: a search that can be defended, and rights that are clear.
PL
Program or cohort lead
Relies on the answer for a decision, and owns internal data that may disagree.
Cares about: hearing about a disagreement first.
CB
Computational biologist
Reanalyzes data and needs counts and model systems lined up.
Cares about: n and the model on the same line.
PC
Patent counsel
Reads claims against the plan, and needs to keep claims and results apart.
Cares about: what is public, and since when.
MA
Medical affairs and medical writers
Need evidence for documents and letters that outside readers will see, with citations that hold.
Cares about: the reference matching the sentence, and permission to share.
Six steps and four systems behind one answer about resistance
One question crosses four systems in six steps, and the record often ends in slides or email
A typical path for a working question that matters to a study plan
Most of the hours go to finding and assembling, and the published search is only part of it
An estimated week of 7.5 hours of literature work, hours; replace with your own log
Searching papers and patentsFinding our own reportsBuilding the tableChecking our work against publishedWriting it up
One scientist's estimated week2.5 h1.5 h1.5 h1 h1 h
Illustrative · replace with your own numbers
Show the numbers
Week
Searching papers and patents
Finding our own reports
Building the table
Checking our work against published
Writing it up
One scientist's estimated week
2.5 h
1.5 h
1.5 h
1 h
1 h
Estimated, and shown to give a shape to test. The only published figure here is the survey's "just over four hours" of searching for articles and more than five reading them, in 2019.7
From reference managers to question-answering search: four ways teams work
Way
What it does well
Where it stops
Bibliographic databases and reference managers
A repeatable search; stored references and formatted citations
Finds records and stores them; the reading and the table are yours. Internal work is invisible.
Review and screening software
Two screeners, recorded decisions, counts for the flow diagram
Built for formal reviews. The search happens elsewhere, and most working questions are too small for it.
Outsourced literature reviews
Method and capacity for a defined project
Weeks per question. The firm cannot read your internal reports unless you arrange it.
Question-answering search
A written answer with sources, in seconds
Quality varies widely, as section 13 shows. Check recall, passages and what it does when it finds nothing. Few read a company's own work.
Part B · See it working
Botminds Scientific Literature Search on one resistance question, from plain words to a kept answer
Part A described the work without naming a product. This part shows how Botminds does it. Every program, person, paper, author, journal, patent and number on these screens is invented sample data, and the sample answer says nothing about real science: please do not cite it.
15 · One question, start to finish
"What is known about resistance through MET amplification?": eleven seconds to numbered claims, then an amber row
In shortThis is the example from the top of the page, inside the product. Dr. Maya Chen, a translational scientist on Program CVT-416, asks in plain words. Agents, pieces of software that each do one defined job, search papers, patents, internal reports and signed lab notebooks together. They answer as numbered claims, each made of evidence rows, and each row opens its passage. One row turns amber because a company report disagrees, and only the owner of that report may settle it.
1
Yesterday's answer is still there, with its rows
It is Tuesday, October 6, 2026, a little after 8 a.m. Ask opens on Maya's last question from October 5: does MET copy gain show in plasma before tissue? That answer is kept in the program notebook: 3 claims, 7 rows, 6 sources, 1 of them the company's own, no disagreement found.
The scope sits under the question: Program CVT-416, all four source types, 2021 to 2026, checked against the company's own work. Clicking a row shows its passage on the right.
The last kept answer. Question and scope on top, claims and rows on the left, the exact passage of the selected row on the right.
2
The run shows each step as it happens
Maya asks about resistance through MET amplification. The panel shows the question scoped to what she may open, then 128,412 sources searched and 36 passages read in full. Five claims follow, from 17 evidence rows across 12 sources, 4 of them the company's own.
Only after the claims are written does the citation checker read every row back against its passage, and then the agreement check starts.
The run in view. Claims fill in on the left while the right-hand panel lists each step and how long it took.
3
Numbered claims, each a block of rows
The short answer comes first. Under it, claim 1: MET copy gain is the most common single new alteration at progression, in about one in ten people. Its four rows are a plasma series at 10.8% (23 of 212), a review of 11 series, the company's VLT-302 interim 2 at 10.5% (4 of 38), and a colorectal study that limits the claim to lung.
The meter reads 3 support, 0 contradict, 1 limits it. The citation checker read all 17 rows: 17 supported, 0 removed.
Numbered claims. One line per source: year, model system, n, effect and stance, with an agreement meter on each claim.
4
One row turns amber
Claim 2 says that when MET gain appears, it is usually the only escape route. The published series found it alone in 12 of 23. The company's VLT-302 interim 2 found it alone in 1 of 4, with three samples carrying a second alteration. The meter reads 2 support, 1 contradict, and the claim lands amber.
The agreement agent's note starts with the weakness in its own finding: small numbers, four samples, and a lead for a person to check. Section 7 showed why that caution is right.
An amber row. The contradicting row, the agent's reason, and two choices: compare, or send to the owner.
5
The models, and what no one has shown in people
Claim 4 reports that adding a MET inhibitor restored pathway suppression in resistant models: 62% xenograft shrinkage at day 21, and 71% growth inhibition against 18% for CVT-416 alone in the company's RX-0942 study. The last row limits the claim, with regrowth within 11 days of stopping.
Claim 5 is a gap: no report of the combination in people. Its first row is a patent claim, with its own label.
Models, patents and the gap. The patent row carries its own stance, and claim 5 says "No result in people".
6
A patent row reads as a patent
Opening that row shows the passage from sample patent family WO 2025/998432: a daily MET inhibitor dose of 200 to 400 mg, which overlaps the planned 300 mg arm. A note under the facts explains that patent text describes what an applicant wants to protect.
The row counts as a patent claim on the meter, never as support. Whether the overlap matters is for Omar Haddad, the patent counsel.
A patent row. The claim text, with a note that it counts as a claim. Sample patent number, sample applicant.
7
From the row to the report, at its page
"Open at page 18" takes Maya to the VLT-302 translational interim report with the cited sentence highlighted. Beside it, the panel says why this passage came back, what the source studied, who wrote it and who may read it: owned by Program VLT-302, program only. The note at the top says the citation checker read the row against this passage and found it supported.
The source at its page. The sentence, the page number, why it came back, and the access rule.
8
Both passages on one screen
"Compare side by side" lays the published passage beside the company's own, each with its n and model system. Below them, a note on why they may differ. If the finding holds, a MET inhibitor alone would leave three in four of these patients with a second route open, and the cohort should enter on a panel. That is a suggestion for a person to weigh. Maya clicks to send it to Lena Ortiz, who owns the VLT-302 cohort.
Side by side. The two passages with their counts, the reason they may differ, and the person who may decide.
9
On one list until its owner settles it
It joins the Disagreements list, sent at 8:17 a.m. Four sit there in the last 30 days: one new, one open with Dana Okafor on twice-daily dosing, one explained by Sam Patel on assay length, one settled by Lena on a panel threshold. The rule is on the screen: Lena Ortiz only, because an agent never closes a disagreement. Until she does, the row stays amber on every answer that uses this claim.
Disagreements. State, both passages, the owner and who may close it.
10
Kept with its rows, so the next person starts ahead
Maya keeps the answer in the CVT-416 notebook at 8:18 a.m. as "Resistance through MET copy gain: what we know today": 5 claims and 17 rows from 12 sources, each opening at its passage. The disagreement stays attached. The notebook also lists the questions the team asked this week, so Sam Patel's question about bypass alterations does not get worked a second time.
Keep in the notebook. A person decides to keep it, under her name and time.
Four minutes from a plain question to a disagreement with an owner and a kept answer
The case as the screens show it, Tuesday, October 6, 2026
8:14 a.m.Maya asks
Five claims and 17 rows arrive 11 seconds later, one amber.
8:16 a.m.Report at page 18
She reads the contradicting passage herself.
8:17 a.m.Sent to Lena Ortiz
Both passages and the agent's note go to the cohort owner.
8:18 a.m.Kept in the notebook
12 sources, 17 rows, the disagreement attached.
NextLena settles or explains it
A person's decision, written to the audit trail.
Fictional example from this guide
Show the numbers
When
What
8:14 a.m.
Maya asks
8:16 a.m.
Report at page 18
8:17 a.m.
Sent to Lena Ortiz
8:18 a.m.
Kept in the notebook
Next
Lena settles or explains it
16 · The other screens
Morning matches, the source library, a refusal to guess, and the rules a library administrator sets
In shortAround the answer sit the screens a research group uses every week: what is new against each person's topics, every source with its model system and count, the evidence table to take away, an honest "no passage found", and the settings that decide how strict an answer is and who may see which program.
New for you. Each scientist names research topics to watch. Each morning, new sources are listed with the reason they matched, and new internal reports are read against the answers the team has kept.
Sources. Papers, patents, internal reports and lab notebooks in one table, with what each studied and how many answers cite it.
A patent at its page. The highlighted claims of the sample family, with the applicant and publication date. Sample text, sample applicant.
When nothing answers. Asked something the library cannot support, it says so and writes no claim. Section 13 explains why this matters: an invented answer is the failure to fear.
The evidence table to take away. Each row keeps a link back to its passage, page and document.
Program notebook. Kept answers per program, ready to reuse or publish to the program, and the team's questions this week.
Dashboard. Sample usage: questions answered, rows checked, disagreements, where cited passages came from.
In the sample library, papers are about 58% of what is searchable, and internal work about 27%
128,412 sample sources by type
128,412sources
Published papers74,480
Internal reports24,109
Patents19,230
Lab notebooks10,593
Fictional example from this guide
Show the numbers
Part
Value
Published papers
74,480
Internal reports
24,109
Patents
19,230
Lab notebooks
10,593
Your rules. How strict an answer is, how the meter counts, how patent text is treated and when small numbers are called out are settings. The library administrator alone can switch off a passage rule, as a new version on the audit trail.
Who sees which program. Internal reports and lab notebooks answer only to the program that owns them, and every question is logged.
17 · Who does what
Five agents read and check; the scientist keeps the answer and the report's owner settles the disagreement
In shortFive agents index the library, write claims, check rows, count agreement and match new sources. People do the deciding: a scientist decides what to keep, and only the owner of the company's source may explain or settle a disagreement. A person checks every answer that matters. Numbers below are design targets to measure on your own library.
From library agent to watch agent: what each one does
Library agent
Reads each new source, splits it into passages, and records target, mechanism, indication, model system and n, keeping page and position. A lab notebook entry is indexed only once signed, and program access is written on the record when it is indexed.
Research agent
Takes the question, searches every source type, and writes a short paragraph and numbered claims. Figures and doses are quoted exactly. If the library does not answer the question, it says so instead of writing a claim.
Citation checker
Reads each row back against its passage, including n and model system, and removes what the source does not say. A removed row goes on the audit trail. It adds no sources of its own.
Agreement agent
Counts sources that support, contradict or limit each claim, reads the company's reports and signed notebooks against the published ones, gives the likely reason they differ, and sends a disagreement to the owner. It calls out small numbers and never picks a side.
Watch agent
Each night, matches new sources to the research topics people asked about, ranks them, and says in one line why each matched. It never surfaces a source the person may not open.
Maya keeps, Lena settles: what stays with people
Decision
Who decides
What the record shows
Whether an answer is good enough to keep
The scientist who asked, after reading the passages
Name, time, the rows and passages kept
What a disagreement means
The owner of the company's source; no one else may close it
New, open, explained or settled, with both passages
What a patent overlap means
Patent counsel
The claim, labeled and counted apart
Whether the passage rule may change
The library administrator
A new version on the audit trail
Who may read which program
The library administrator and program leads
Access written on the source, and each question logged
Roles and separation of duties, an audit trail of who asked what and which passages came back, exports, connections to your own systems and clear ownership of each decision are part of the design. The platform is SOC 2 Type II audited, with information security managed to ISO 27001. If an answer later goes into a regulated document, these controls support your own process; the checking and the responsibility remain with your people.
Papers, patents, reports and notebooks in; claims, rows and kept answers out
Published and public
Published papers and reviews: abstracts and open full text, synced nightly
Patent families and their claims, synced weekly
Sources you add, under the rights you hold
Your own work
Pharmacology, translational and discovery reports, on upload
Signed lab notebook entries, on sign-off
Program structure and access rules
Agents index, answer, check and compareEvery row tied to a passage, under your rules
The scientist keeps the answer
The owner settles a disagreement
Claims, tables and kept answers
Short answer with numbered claims
Evidence table: source, year, model system, n, effect, stance
Agreement meter on each claim
Disagreements with an owner and a state
Kept answers in the program notebook
Design targets
11 seconds, median, to a sourced answer
100% of evidence rows open the passage they came from
Measure both on your own library
Systems a research literature rollout connects to
Literature feedsPublished citations, abstracts and open full text
Your licensed contentUnder the terms your agreements set
Patent office dataFamilies and claims
Research report storePharmacology, translational, discovery
Electronic lab notebookSigned entries only
Identity and accessPrograms, roles and sign-in
Part C · Are you ready to automate?
Literature search software for R&D: what a missed paper costs, what automation returns and how to test it on your own questions
You run a research group, an information team or an R&D budget. This part is written for you: what slow and unrepeatable searches cost, what automating could return, whether your team is ready, what to ask any vendor, and how to run a pilot whose result you can trust.
18 · What it costs you
What slow searches and missed disagreements cost your research group
In shortAlmost nobody publishes what a literature question costs a company, so start from your own log. A few public figures show the scale: the hours a researcher reports, how rarely a search can be repeated, and how often one company's labs and the literature did not match. The costliest case is a study plan written without a fact you already owned.
4+ hours
a week researchers said they spent searching for articles, and more than five reading them.7
Elsevier survey, 2019
1 in 100
systematic reviews in a random sample gave enough detail to be fully reproduced.1
J Clin Epidemiol, 2024
43 of 67
target projects at one company were highly inconsistent with published claims.27
Prinz and colleagues, 2011
Searching and table-building shrink the most; judging a disagreement and writing it up shrink least
One scientist's estimated week, hours; replace both columns with your own log
By hand (estimate)With a tool (assumption)
Searching papers and patent families2.5 hours0.8 hours
Finding our own reports on the same question1.5 hours0.4 hours
Pulling n, model and effect into a table1.5 hours0.7 hours
Checking our work against the published series1 hour0.6 hours
Writing it up1 hour0.7 hours
Illustrative · replace with your own numbers · An estimate, and the after column is an assumption to test in a pilot.
Show the numbers
By hand (estimate)
With a tool (assumption)
Searching papers and patent families
2.5 hours
0.8 hours
Finding our own reports on the same question
1.5 hours
0.4 hours
Pulling n, model and effect into a table
1.5 hours
0.7 hours
Checking our work against the published series
1 hour
0.6 hours
Writing it up
1 hour
0.7 hours
What nobody publishes. There is no public figure for hours per working question in a drug company, the recall of working searches, the share of company findings that disagree with the literature today, or what a study lost because a paper or report was missed. You can measure the first three within a month.
How to count your own literature hours and missed papers in one week
Cost
Where it hides
How to find your number in a week
Scientists' search time
Between experiments, never logged
Ten scientists log a week: question, minutes, sources opened
Questions worked twice
Slides and email threads
Ask three programs for last month's questions, and count the repeats
Missed papers
In the search nobody re-ran
Take five past answers, list the papers an expert expects, and check the recall
Untraceable numbers
Decks and study plans
Pick 20 cited numbers in one study plan. Time how long it takes to find each passage, and count the ones that do not match
Internal disagreements
Reports no one reads across programs
For one target, set three published claims against your own reports
Retracted sources
Old reference lists
Run the PubMed retraction filter over the references in your active plans
License exposure
Shared PDF folders and AI tools
Ask which tools hold full text today, and which license covers each
What an unchecked literature answer costs that no spreadsheet shows
A study built on one paperWhen an entry test or dose rests on a source nobody read twice, the cost shows up a year later.
Your own best data, unusedThe report that would have changed the plan sat in another program's folder.
Reviewer confidenceOne citation that does not say what you claimed makes a reader doubt the rest.
The person who leftThe search lived in one scientist's head and browser.
Questions never askedTeams stop asking across sources when each attempt costs an afternoon.
19 · Your return
What faster sourced answers return: scientist hours, license costs and the point where the tool pays for itself
In shortPut in your own numbers. The calculator counts search and table-building hours released, against the tool and any added content license. Only the survey's four hours has a source, and it is a 2019 self-report. Hours count as value only if you decide what they are for. The disagreement caught early is the bigger prize, and you should measure it apart.
Search time, repeats, retractions and early disagreements: where literature automation saves
Finding
Less time getting to the passage
Papers, patents and internal work searched in one question.
Kept answers mean the next person starts from rows.
repeated questions a month × hours each × hourly cost
Disagreements
Found before the plan is signed
Count them, and record what each one changed. Never assume a value.
disagreements found × share that changed a decision
Checking
Faster to verify
Open the sentence instead of hunting for it.
minutes per cited number, before and after
License clarity
A written answer on rights
Know which text may be read by which system.
sources mapped to a named right ÷ all sources
Your scientists, their search hours and your hourly cost
Only one default has a published source. Every default marked illustrative is an assumption: replace it with your own.
Your peopleHours a week, per scientistShare saved, after people read the passagesYearly cost
Illustrative yearly value
Search time today, valued$0
Search and table time released, valued$0
After your yearly cost$0
Hours released a year0
Scientists needed to cover your cost0
Formulas, per year: Search time today = scientists × weeks × search hours × hourly cost Time released = scientists × weeks × hourly cost × (search hours × share + table hours × share) Net = time released − tool − license Scientists to cover cost = (tool + license) ÷ value released per scientist
Not counted: repeated questions avoided, faster checking, or what a disagreement caught early was worth. Released hours are value only when you decide what they are for.
At the defaults, the tool covers a $310,000 yearly cost once it saves about 18% of search time
Value released per year at the calculator's other defaults, by share of search hours saved
10%$232.8K
20%$325.9K
30%$419K
40%$512.1K
50%$605.2K
Illustrative · replace with your own numbers
Show the numbers
Share of search hours saved
Value released
10%
$232.8K
20%
$325.9K
30%
$419K
40%
$512.1K
50%
$605.2K
A group of 20 scientists at $90 an hour over 46 weeks, saving 20% of four search hours and 30% of one table hour a week, releases about $91,000 a year: about $89,000 short of a $150,000 tool and a $30,000 license. For a small team, the case rests on missed disagreements and traceable citations. If your log shows little repeated work, say so before buying anything.
Start here20 · Readiness check
Is your research group ready for AI literature search? Eight questions on records, licenses, internal reports and owners
In shortScore your team from 0 to 2 on eight questions. A low score tells you what to fix first, usually your license terms and the rule for who settles a disagreement. A ninth question has no score, and it may be the most useful one.
1
Questions worth answering twice
How often do your teams ask literature questions that matter to a decision?
Why it mattersVolume turns minutes per answer into capacity, and repeats show what is being lost.
A strong answer"About 80 a week across three programs, and we logged a week to check."
2
Search records today
When someone relies on a search, is the strategy saved with its date?
Why it mattersSaved strategies are rare even in published work.1 Without them you have no baseline.
A strong answer"Our evidence notes carry the strategy, date and record count."
3
Rights mapped to sources
Do you know what your licenses allow for text mining and AI use, by source?
Why it mattersCorporate rights often differ from academic ones.33 A vendor cannot settle this for you.
A strong answer"Library and legal hold a table of sources, rights and permitted systems."
4
Internal reports findable
Can your internal reports and signed notebooks be read by software, with their dates and owners?
Why it mattersA search can only compare your work with the literature if it can read your work.
A strong answer"Reports are in one store with owner metadata; the notebook exports signed entries."
5
Who may read which program
Are access rules for each program written down clearly enough to configure?
Why it mattersSearch across programs is useful and risky. A leak through an answer is still a leak.
A strong answer"Each program has a named owner and a written list of who may read it."
6
Who settles a disagreement
When your data disagrees with a paper, is there a named person who must respond?
Why it mattersA flag with no owner gets ignored. Software can route it, and only a person can settle it.
A strong answer"The report owner responds within two weeks; the program lead sees open ones."
7
Who checks an answer
Have you decided what a person must read before an AI answer is reused?
Why it mattersEditors and evidence groups keep responsibility with people.56,57 A written rule makes that real.
A strong answer"No number goes into a plan until someone has read its passage."
8
A test set you trust
Could you name 50 questions and the papers that should answer them?
Why it mattersRecall can only be measured against what you already know belongs.
A strong answer"Our information team built one from past reviews, with expected papers listed."
9
For reflection, no score
What single fact would you have wanted on the screen before your last study plan was signed, and where was it sitting at the time?
Reading your score: fix the record, pilot on known questions, or roll out by program
0–6
Explore
Build the baseline. Log a week of questions, save strategies for anything a decision uses, and ask legal and the library for your license table. You will find real gaps without buying anything.
7–11
Ready to pilot
Run a measured pilot on one target: known questions, planted disagreements, and a recall test. Compare it with your baseline, and leave the decision to keep each answer with a person.
12–16
Ready to implement
Plan the sources and rights, each program's access, owners for disagreements, your checking rule and the connections to your report store and notebook.
A 0 on rights mapped to sources, question 3, holds you back at any total. Settle that first: it decides what a tool may read.
21 · Questions for any vendor
Questions for any AI literature search vendor: recall, invented citations, rights, your own data and proof
In shortAsk us too. Polished demonstrations on a vendor's own sample show none of what matters. These questions go to the failures Part A described: papers quietly missed, statements a source does not make, rights nobody checked and internal data seen by the wrong team. Ask to see each one on your own questions.
A
What it searches, and what it silently misses
A1
What is your recall on a test set we choose, and how do you measure it?
Why it mattersOne published test found 39.5% for a research tool against 94.5% for traditional searching.47
Good · warning sign
Runs your 50 questions and shows the misses.
Quotes a precision or satisfaction figure.
A2
Which databases and full text can it read, by name, and what is excluded?
Why it mattersA single database is not adequate for a formal review.3
Good · warning sign
A source list with dates, and full text and abstracts told apart.
"All the world's science."
A3
If we ask the same question next month, can we see what changed and why?
Why it mattersWithout a record, the search cannot be checked.8
Good · warning sign
Question, scope, date and passages stored with the answer.
Only the final text is saved.
B
How it ties each statement to a source
B1
Open any sentence in an answer. Can I see the exact passage and the page?
Why it mattersReal sources often do not support the statement beside them.46
Good · warning sign
Every row opens a highlighted passage.
A reference list at the end.
B2
What happens when nothing in the library answers the question?
Why it mattersWriting an answer anyway is how references get invented.44
Good · warning sign
It says so and writes no claim.
It always produces an answer.
B3
Does it round or recalculate numbers, and does it tell me the n?
Why it mattersA percentage without its count misleads, as section 7 showed.
Good · warning sign
Quotes the figure and calls out small numbers.
"About a quarter of patients."
C
Copyright and license terms for what it reads
C1
Who holds the rights to the text you index: you, us, or neither?
Why it mattersA subscription rarely answers this.33
Good · warning sign
A table per source, and a route for your own licensed content.
"Our lawyers say it's fine."
C2
Is any of our text or any question used to train a model?
Why it mattersInternal reports and rights-limited text must not leave your control.
Good · warning sign
A written contract term saying no.
A statement on a web page.
C3
How long are displayed passages, and can we set the limit by source?
Why it mattersSummaries and long extracts carry more risk than links.38
Good · warning sign
Short passage plus a link; set per license.
Whole papers reproduced on screen.
D
Your own reports, access and disagreements
D1
Is access applied before the model reads a source, or after it writes?
Why it mattersText written from a report the person may not see has already leaked.
Good · warning sign
Filtered before retrieval, and tested with a restricted account.
Results hidden afterward.
D2
How do you show that our data disagrees with a paper, and who can close it?
Why it mattersAn answer that blends the two loses the most useful finding.
Good · warning sign
Both passages shown, a named owner, and a state.
A blended summary.
D3
Are unsigned notebook entries readable?
Why it mattersA draft result can still change before sign-off.
Good · warning sign
Only after sign-off.
Everything in the folder.
E
Claims, retractions and credentials
E1
How are patent claims told apart from results?
Why it mattersA claimed dose range measures nothing.
Good · warning sign
Labeled and counted apart.
Patents and papers mixed as "sources".
E2
What happens to a kept answer when one of its sources is later retracted?
Why it mattersFew citing papers ever mention a retraction.24
Good · warning sign
Shows you how it checks, and who is told.
"We use the latest database."
E3
Is the product certified or validated for regulated use?
Why it mattersNo product can be certified for GxP or Part 11. How you use it decides.
Good · warning sign
"We provide controls that support your compliance." Botminds' own credentials: SOC 2 Type II audited, information security managed to ISO 27001.
"Fully compliant out of the box."
22 · A pilot plan
Testing AI literature search on one target: a 10-week pilot with known papers and planted disagreements
In shortPick one target your team knows well. Log a baseline, build a test set from past reviews, settle the rights question, plant a few disagreements, then run the tool beside your scientists for a month. Decide on measured recall, passage accuracy and time saved after people have checked. The target and pass marks should be written before you start.
Ten weeks: rights and baseline first, then a parallel run, and a decision on measured results
Your teamWith the vendor
Map sources to rights
Log a baseline week; build the test set
Connect sources and set access
Recall and passage tests
Parallel run with six scientists
Measure and decide
Week 0246810
Illustrative · replace with your own numbers
Show the numbers
Activity
From
To
Map sources to rights
0
2
Log a baseline week; build the test set
0
3
Connect sources and set access
1
4
Recall and passage tests
3
5
Parallel run with six scientists
5
9
Measure and decide
9
10
Which kinds of question to test first
Start with frequent questions a person can check quickly; hold back the ones a wrong answer would damage most
Harm from a wrong answer →
Keep a person leading
Pilot with close checking
Leave as is for now
Start here
Dose in a study planOur data against publishedRate of a mechanismWhat's new on a topic
How often it is asked →
Illustrative · replace with your own numbers
Show the numbers
Item
How often it is asked (0–1)
Harm from a wrong answer (0–1)
Dose in a study plan
0.26
0.70
Our data against published
0.36
0.56
Rate of a mechanism
0.66
0.27
What's new on a topic
0.74
0.12
The measures that decide a literature search pilot
Measure
How
What good looks like, set before you start
Recall
50 questions with expected papers from past reviews
A pass mark you wrote first; compare with your own strategy, and review every miss
Passage accuracy
A person reads 200 rows against their passages
Number, n and model system correct; every failure logged
Nothing invented
Questions with no answer in the library, and sources that do not exist
It says so each time; no invented citations
Disagreements caught
Plant 10 known conflicts between your reports and papers
A high catch rate; count false alarms as well
Access kept
Restricted accounts ask about other programs
Nothing shown or implied, every time
Time
Stopwatch on the same kinds of question as your baseline, including checking
Minutes saved after people read the passages
Rights
Every source in the pilot mapped to a named right
No source without one; signed off by legal
The working-session questions: 9 questions in three groups
Bring a lead scientist, an information specialist, a program lead, patent counsel, legal or licensing, and IT into one room. Each question says why it matters and what a strong answer looks like.
A
Which target and which sources first
A1
Which target should go first?
Why it mattersYou can only judge answers you can check.
Strong answer
One with past reviews, internal reports and a known disagreement.
A2
Which internal stores stay out for now?
Why it mattersSensitive programs need their own decision.
Strong answer
A written list, with a named owner for each.
A3
Who may use it in the pilot?
Why it mattersA small group gives cleaner measures.
Strong answer
Six named scientists and one information specialist.
B
Rights, records and retention
B1
Which license covers each source inside this tool?
Why it mattersCorporate rights vary by publisher.33
Strong answer
A table signed by legal.
B2
What do we keep from each search?
Why it mattersA record makes the answer checkable.8
Strong answer
Question, scope, date, passages, and who kept it.
B3
What must counsel see from patent searches?
Why it mattersSearch results may touch disclosure duties.43
Strong answer
A route agreed with patent counsel before the first run.
C
Owners and the check a person makes
C1
Who responds to a disagreement, and by when?
Why it mattersFlags with no owner get ignored.
Strong answer
The report owner, within two weeks.
C2
What must someone read before a number enters a plan?
Why it mattersA pilot without a stop rule only ever continues.
Strong answer
Any access failure, or an invented citation in a kept answer.
23 · Questions people search
Scientific literature search questions: PRISMA-S, Boolean, recall, AI tools, retractions and copyright
In shortShort answers to the questions people type, each of which can be read on its own.
How do you do a scientific literature search?
Write the question in parts, choose the sources, and write a search for each source using subject headings and the words authors use. Save the exact search and the date. Screen the results against written rules, read the full text of what survives, and tie every statement you keep to the page and sentence it came from.
What is the difference between a literature search and a systematic review?
A literature search finds what is known about a question. A systematic review is a formal study of the evidence, with a protocol, a full search, two independent readers and a report that follows a standard such as PRISMA 2020. A working literature search can borrow its record keeping without its full cost.
Which databases should a literature search use?
Use more than one. A 2017 study found Embase, MEDLINE, Web of Science and Google Scholar together reached 98.3% recall, and Cochrane says MEDLINE alone is not adequate for its reviews. Add trial registries, patents, conference abstracts and your own reports when the question calls for them.
What is PRISMA-S?
PRISMA-S is a 16-item checklist for reporting the search part of a systematic review, published in 2021. It asks for items such as each database's name, each full strategy copied and pasted exactly as run, limits, and the date of the last search. It exists because search reporting has been poor, and a search that is reported fully can be checked.
How do you make a literature search reproducible?
On the day you run it, save the database and platform, the strategy exactly as run, any limits, the date, the records found and how you removed duplicates. Do not retype the strategy from memory. Studies show few published searches do this: one sample of 100 reviews had just one that was fully reproducible.
Can ChatGPT do a literature search?
It can suggest terms and help you draft a search, and a person should check that draft. Asked for references from its own memory, a model may invent them: a 2026 test of GPT-5 found 7.13% of references fabricated and fewer than half accurate in every field. Check every reference, and read the passage itself.
Are AI literature search tools accurate?
It depends on the job. AI screening of titles and abstracts reached a pooled sensitivity of 0.92 in a 2026 meta-analysis, while one research tool found 39.5% of studies against 94.5% for traditional searching, in four case studies. Test any tool on questions whose answers you already know, and ask what it does when it finds nothing.
How do I find out if a paper has been retracted?
In PubMed, look for "Retraction in:" on the record, or filter a set by the Retracted Publication type. Then read the notice, because the mark does not say why. Recheck the references in anything you have kept, because few later citations mention a retraction.
Is it legal for a company to text mine journal articles?
It depends on the country and your license. EU law provides a mining exception for lawfully accessible works unless the rightholder has reserved that use, and each country writes it into its own law. The UK's exception covers non-commercial research only, and in the US, fair use is decided case by case. Many publishers handle corporate mining through separate agreements, so ask your counsel.
Can I upload journal PDFs into an AI tool at work?
Not without checking. Your subscription or collective license decides whether a copy may sit in a third party's system, and terms vary by publisher. Some collective licenses for businesses now include internal AI re-use rights, according to trade press reports. Ask your library or legal team, and find out whether the tool trains on what you upload.
What is an evidence table in a literature review?
It is a grid with one row per source and columns such as year, model system, n, effect and whether the source supports the claim. It lets a reader compare sources and judge the claim without reading each paper. Adding the exact passage to each row makes it checkable.
How long does a systematic literature review take?
A study of 195 reviews registered in PROSPERO found a mean of 67.3 weeks from registration to publication, with about five authors. A working evidence note takes far less because it asks less. Time spent should depend on what the answer will be used for.
Does AI literature search replace a research librarian?
The evidence supports using it alongside one. Searches still need a strategy someone can defend, license rights need managing, and a tool's recall needs testing against known papers. An information specialist does all three, and a tool can give that person a faster first look.
24 · One-page summary
Literature search on one page: the method, the November 2026 rules, readiness and terms
Print this page
In shortThe whole guide on one screen: the method, the rules as of November 2026, the readiness scale and the terms.
The method
Write the question in parts, and say what an answer must contain.
Name your sources, including what you are leaving out and your own reports.
Write a search for each source; test it on papers you know belong.
Save the strategy as run, its date, limits and record count.
Screen against written rules, and record why papers go out.
One row per source: year, model, n, effect, stance, passage.
Quote numbers; read the count beside the percentage.
Check for retractions, and rerun before anyone relies on it.
Keep claims and results apart, and send a disagreement to a named owner.
Know which license covers each source in each system.
Readiness: score 0–2 on eight questions: 0–6 explore · 7–11 pilot · 12–16 implement.
As of November 2026: PRISMA 2020 and PRISMA-S current · Cochrane Handbook 6.5.1 · FDA AI guidance still a draft, leaves out drug discovery · EMA reflection paper final September 2024 · EU AI Act high-risk dates moved to December 2, 2027 and August 2, 2028 · draft Annex 22 still a draft and about manufacturing · EU DSM Articles 3 and 4 in force, CJEU referral pending · UK section 29A non-commercial only, and the March 2026 report proposes no new mining exception · US Third Circuit ruled against fair use in Thomson Reuters v. ROSS, September 2026.
14 terms
Search strategy
The exact search run in one database.
Boolean operators
AND, OR and NOT, which combine search terms.
Medical Subject Headings
PubMed's controlled list of topics, assigned by indexers.
Automated analysis of text to generate information.
Non-patent literature
Prior art other than patents: papers, theses, posters.
25 · Sources
Sources
Accessed November 2026. Legal and regulatory status statements are as of November 2026.
Rethlefsen ML, Brigham TJ, Price C, et al., "Systematic review search strategies are poorly reported and not reproducible: a cross-sectional metaresearch study", Journal of Clinical Epidemiology 166:111229, February 2024. pubmed.ncbi.nlm.nih.gov
Bramer WM, Rethlefsen ML, Kleijnen J, Franco OH, "Optimal database combinations for literature searches in systematic reviews: a prospective exploratory study", Systematic Reviews 6:245, December 6, 2017. pubmed.ncbi.nlm.nih.gov
Cochrane Handbook for Systematic Reviews of Interventions, version 6.5.1 (2025), Chapter 4, "Searching for and selecting studies", last updated March 2025. cochrane.org
Jergas H, Baethge C, "Quotation accuracy in medical journal articles: a systematic review and meta-analysis", PeerJ 3:e1364, 2015. pubmed.ncbi.nlm.nih.gov
PubMed Central, "PMC Copyright Notice", read November 3, 2026. pmc.ncbi.nlm.nih.gov
PubMed, record counts by publication year and publication type, counted by this guide through the National Library of Medicine's public E-utilities service on November 3, 2026; the counts rise every week. pubmed.ncbi.nlm.nih.gov
Elsevier and Sense about Science, Trust in Research survey (more than 3,000 researchers, May 2019), as reported by Elsevier's research director in Research Information, August 27, 2019. researchinformation.info
Rethlefsen ML, Kirtley S, Waffenschmidt S, et al., "PRISMA-S: an extension to the PRISMA Statement for Reporting Literature Searches in Systematic Reviews", Systematic Reviews 10:39, January 26, 2021. pmc.ncbi.nlm.nih.gov
Page MJ, McKenzie JE, Bossuyt PM, et al., "The PRISMA 2020 statement: an updated guideline for reporting systematic reviews", BMJ 372:n71, March 29, 2021. bmj.com
Piwowar H, Priem J, Larivière V, et al., "The state of OA: a large-scale analysis of the prevalence and impact of Open Access articles", PeerJ 6:e4375, 2018. pubmed.ncbi.nlm.nih.gov
University of Michigan Library, "National Institutes of Health Public Access Policy" guide: manuscripts accepted on or after July 1, 2025 available in PubMed Central on publication (NIH notice NOT-OD-25-101, as named by other university guides). A university library guide; we did not read NIH's own notice. guides.lib.umich.edu
Salvador-Oliván JA, Marco-Cuenca G, Arquero-Avilés R, "Errors in search strategies used in systematic reviews and their effects on information retrieval", Journal of the Medical Library Association 107:210-221, April 2019. pubmed.ncbi.nlm.nih.gov
Borah R, Brown AW, Capers PL, Kaiser KA, "Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry", BMJ Open 7:e012545, February 27, 2017. pubmed.ncbi.nlm.nih.gov
McGowan J, Sampson M, Salzwedel DM, et al., "PRESS Peer Review of Electronic Search Strategies: 2015 Guideline Statement", Journal of Clinical Epidemiology 75:40-46, July 2016. pubmed.ncbi.nlm.nih.gov
Gusenbauer M, Haddaway NR, "Which academic search systems are suitable for systematic reviews or meta-analyses?", Research Synthesis Methods 11:181-217, March 2020. pubmed.ncbi.nlm.nih.gov
Scherer RW, Meerpohl JJ, Pfeifer N, et al., "Full publication of results initially presented in abstracts", Cochrane Database of Systematic Reviews 11:MR000005, November 20, 2018. pubmed.ncbi.nlm.nih.gov
35 U.S.C. § 122(b), publication of patent applications. law.cornell.edu
Koffel JB, Rethlefsen ML, "Reproducibility of Search Strategies Is Poor in Systematic Reviews Published in High-Impact Pediatrics, Cardiology and Surgery Journals", PLoS One 11:e0163309, 2016. pubmed.ncbi.nlm.nih.gov
Hamilton DG, McKenzie JE, Nguyen PY, et al., "Evaluation of the replicability of systematic reviews with meta-analyses of the effects of health interventions", Research Synthesis Methods 17:538-556, May 2026. pubmed.ncbi.nlm.nih.gov
Wang Z, Nayfeh T, Tetzlaff J, et al., "Error rates of human reviewers during abstract screening in systematic reviews", PLoS One 15:e0227742, 2020. pubmed.ncbi.nlm.nih.gov
Waffenschmidt S, Knelangen M, Sieben W, et al., "Single screening versus conventional double screening for study selection in systematic reviews", BMC Medical Research Methodology 19:132, June 28, 2019. pubmed.ncbi.nlm.nih.gov
Mathes T, Klaßen P, Pieper D, "Frequency of data extraction errors and methods to increase data extraction quality: a methodological review", BMC Medical Research Methodology 17:152, November 28, 2017. pubmed.ncbi.nlm.nih.gov
Mogull SA, "Accuracy of cited 'facts' in medical research articles: a review of study methodology and recalculation of quotation error rate", PLoS One 12:e0184727, 2017. pubmed.ncbi.nlm.nih.gov
Hsiao TK, Schneider J, "Continued use of retracted papers: temporal trends in citations and (lack of) awareness of retractions shown in citation contexts in biomedicine", Quantitative Science Studies 2:1144-1169, 2021 (issue dated February 2022). pubmed.ncbi.nlm.nih.gov
U.S. National Library of Medicine, "Errata, Retractions, and Other Linked Citations in PubMed", page reviewed February 10, 2026. nlm.nih.gov
Bolland MJ, Grey A, Avenell A, "Citation of retracted publications: a challenging problem", Accountability in Research 29:18-25, January 2022. pubmed.ncbi.nlm.nih.gov
Mullard A, posted by Owens B, "Reliability of 'new drug target' claims called into question", Nature Reviews Drug Discovery news blog, September 5, 2011, on Prinz F, Schlange T, Asadullah K, Nature Reviews Drug Discovery 10:712 (2011). blogs.nature.com
Errington TM, Mathur M, Soderberg CK, et al., "Investigating the replicability of preclinical cancer biology", eLife 10:e71601, December 7, 2021. elifesciences.org
Freedman LP, Cockburn IM, Simcoe TS, "The Economics of Reproducibility in Preclinical Research", PLOS Biology 13:e1002165, June 9, 2015. journals.plos.org
American Geophysical Union v. Texaco Inc., 60 F.3d 913 (2d Cir. 1994, amended 1995), opinion text. lib.uchicago.edu
Directive (EU) 2019/790 on copyright in the Digital Single Market, Articles 2, 3, 4 and 7, Official Journal text. publications.europa.eu
Elsevier, "Text and data mining" policy, read November 3, 2026. elsevier.com
U.S. National Library of Medicine, "Copyright Information & Downloading National Library of Medicine Data". nlm.nih.gov
Creative Commons, "Content mining" guide (data and text mining under CC licenses), last edited July 29, 2014. wiki.creativecommons.org
KMWorld, "CCC is offering 4 AI licensing options to support internal and external AI use cases", March 4, 2026. A trade press report; we did not read CCC's own license pages. kmworld.com
Thomson Reuters Enterprise Centre GmbH v. ROSS Intelligence Inc., No. 25-2153 (3d Cir.), opinion of the court, decided September 29, 2026 under seal, public opinion filed September 30, 2026; read in full. lawnext.com (court PDF)
U.S. Copyright Office, "Copyright and Artificial Intelligence, Part 3: Generative AI Training", pre-publication version, May 2025, section on retrieval-augmented generation. copyright.gov
UK Department for Science, Innovation and Technology and Department for Culture, Media and Sport, "Report on Copyright and Artificial Intelligence", presented to Parliament under section 136 of the Data (Use and Access) Act 2025, March 2026, paragraph 27. gov.uk
Freshfields, "AI training and copyright, part 2: text and data mining under court scrutiny", January 29, 2026, on Higher Regional Court of Hamburg, 5 U 104/24 (December 2025), and the pending Like Company v Google referral. A law firm's note; we did not read the judgment itself. freshfields.com
Copyright, Designs and Patents Act 1988 (UK), section 29A, copies for text and data analysis for non-commercial research. legislation.gov.uk
USPTO, Manual of Patent Examining Procedure, section 2128, "Printed Publications as Prior Art", revision R-01.2024. uspto.gov
37 C.F.R. § 1.56, duty to disclose information material to patentability. law.cornell.edu
Chelli M, Descamps J, Lavoué V, et al., "Hallucination Rates and Reference Accuracy of ChatGPT and Bard for Systematic Reviews", Journal of Medical Internet Research 26:e53164, May 22, 2024. pubmed.ncbi.nlm.nih.gov
Bernstein EM, Bol B, Shanaa J, et al., "Evaluating the Citation Accuracy of ChatGPT-5 Using the American Academy of Orthopaedic Surgeons Clinical Practice Guidelines", Cureus 18(7):e113654, July 30, 2026. pmc.ncbi.nlm.nih.gov
Wu K, Wu E, Wei K, et al., "An automated framework for assessing how well LLMs cite relevant medical references", Nature Communications 16:3615, April 16, 2025. pubmed.ncbi.nlm.nih.gov
Lau O, Golder S, "Comparison of Elicit AI and Traditional Literature Searching in Evidence Syntheses Using Four Case Studies", Cochrane Evidence Synthesis and Methods 3:e70050, November 2025. pubmed.ncbi.nlm.nih.gov
Laignelot et al., "Large language models show promising performance for some systematic review tasks but call for cautious implementation: a systematic review", Journal of Clinical Epidemiology 194:112221, June 2026. pubmed.ncbi.nlm.nih.gov
Xie et al., "Performance of Large Language Models in Automated Medical Literature Screening: A Systematic Review and Meta-Analysis", Journal of Evidence-Based Medicine 19:e70166, September 2026. pubmed.ncbi.nlm.nih.gov
FDA, "Considerations for the Use of Artificial Intelligence to Support Regulatory Decision-Making for Drug and Biological Products", draft guidance, January 2025, docket FDA-2024-D-4689; still a draft on FDA's page, read November 3, 2026. fda.gov
European Medicines Agency, "Reflection paper on the use of artificial intelligence (AI) in the medicinal product lifecycle", final version adopted by CHMP September 9, 2024, section 2.3.1. ema.europa.eu
FDA, "Guiding Principles of Good AI Practice in Drug Development", developed with the European Medicines Agency, content current January 14, 2026. fda.gov
Regulation (EU) 2026/1744 (the AI Omnibus) of July 8, 2026, Official Journal July 24, 2026, in force on the third day after publication: Article 4 of the AI Act replaced (AI literacy); high-risk rules apply from December 2, 2027 (Annex III) and August 2, 2028 (Annex I). publications.europa.eu
Regulation (EU) 2024/1689 (the EU AI Act), Articles 2(6) and 4, Official Journal text. publications.europa.eu
European Medicines Agency, report of the multistakeholder workshop on Annex 22 (EMA/156789/2026, workshop of June 30, 2026), and the draft Annex 22 text, consultation July 7 to October 7, 2025; EudraLex Volume 4 listed no Annex 22 on November 3, 2026. ema.europa.eu
Flemyng E, et al., "Position statement on artificial intelligence (AI) use in evidence synthesis across Cochrane, the Campbell Collaboration, JBI and the Collaboration for Environmental Evidence 2025", published November 2025. ncbi.nlm.nih.gov
International Committee of Medical Journal Editors, Recommendations, "Artificial Intelligence (AI)-Assisted Technology: AI use by authors", read November 3, 2026. icmje.org
Next step
See it on your own library.
Explore the solution, or bring ten questions your team has already answered by hand, the papers and reports behind them, and your license terms. We will run them together, with every row opening its passage.
We use essential cookies to make this site work, and cookieless, anonymised analytics to understand how it's used. "Accept all" also turns on Google Analytics, which sets cookies. Privacy policy