Intelligent document processing

Botminds IDP Intelligent document processing that reads anything — and proves every value.

Scans, faxes and handwriting. Hundred-page forms and tables that run across pages. Spreadsheets, email, call transcripts, photos and video, in the language they were written in. Botminds IDP reads it, checks it against your rules and your other documents, and hands a person a result where every value opens the page it came from.

The short answer

What is Botminds IDP?

Botminds IDP is the agentic intelligent document processing technology inside the Botminds platform. A crew of AI agents reads documents and records of every kind, extracts what matters by meaning rather than by position, checks it against rules and other documents, scores how sure it is, and hands the result to a person or a system — with every value linked to the page and region it came from.

It is not a separate product to integrate. It is the reading layer under every document solution in the Botminds library, so a solution for claims, credit, trials or invoices starts with the reading already done well. New to the term? Read our intelligent document processing buyer’s guide.

98%

measured precision on the fields that pass automatically — held-out real financial statements, mostly French, a quarter scanned. The rest go to a reviewer.

measured
1Mpages

of mortgage files in 30 minutes — about 2,000 loan files — on a deployment scaled out for the wave.

scale-out sizing
1,000pages

one loan file — OCR, layout, classification, splitting and extraction — read end to end in under 14 minutes.

measured
100%

of extracted values carry a confidence score and a link to the exact page and region they came from.

by design
Four generations

IDP vs OCR: from characters to evidence.

Each generation of document processing fixed the last one’s worst problem and kept a new one. OCR gave us characters without meaning. Machine learning gave us meaning, one labeled document type at a time. Large language models read anything — and can invent a value no page contains. Botminds IDP keeps what each did well and binds every value to its evidence.

1990s →

OCR and templates

Characters from images; fields from fixed zones drawn per layout.

  • Fast on one fixed form
  • A moved field breaks the read
  • No idea what a value means
  • No tables, no handwriting
2010s →

Machine-learning IDP

Classifiers and extractors trained per document type on labeled samples.

  • Handles layout variation
  • Confidence scores
  • Hundreds of labels per type
  • The long tail never gets done
  • Confidence often uncalibrated
2023 →

LLM extraction

A large model reads the page and returns fields from a prompt.

  • Any layout, no training
  • Understands meaning
  • Can invent values
  • No source for an answer
  • Costly at volume, hard to measure
Now

Botminds IDP — agentic and evidence-bound

Agents read, cross-check and decide with every value tied to its source, measured on your documents.

  • Any format, any layout, any language
  • Every value cited to page and region
  • Cross-document consistency checks
  • Calibrated confidence and evals
  • A person signs what matters
Agentic document processing

What is agentic IDP? A crew of agents on every file — and a person who decides.

Classic IDP is a fixed pipeline: one model, one pass, one score. Agentic IDP gives each job on a file to an agent with its own instructions, tools and limits. The agents plan the work, use tools, check each other, and stop at a person where judgment is needed. Botminds IDP runs the whole file this way — and records every step.

What makes it agentic

  • Plans, not just parsesAn agent decides which pages matter, which tool to call next and when the work is done — the way a trained processor works a file.
  • Uses toolsLookups in your systems, calculators, indexes and reference lists. Each agent gets only the tools on its allow-list.
  • Checks itself and the othersA quality agent reviews the reads; independent re-reads are compared; disagreement lowers confidence instead of hiding.
  • Knows its limitsGuardrails on what goes in and what comes out. A tool that changes something can be set to wait for a person’s approval.
  • Stops at a personAnything under the threshold, and every decision you reserve, goes to a named reviewer with the page open at the evidence.
  • Learns from correctionsReviewer corrections become test cases; every change to an agent is scored against them before it publishes.

Every agent has a written boundary

Built by conversation

Describe the work. Confirm the plan. The crew is built.

You don’t wire agents together by hand. Tell Piper, the Botminds builder agent, what arrives and what must come out. It asks what it needs to know, shows you the plan — document types, fields, agents, review stages — and builds nothing until you confirm. Then it builds the crew and runs it on your sample files.

We get mortgage files as one PDF. Split them, pull income and assets, check them against each other, and send anything unsure to underwriting.
Here’s the plan. A Loan files collection with nine document types · intake, extraction, quality and cross-document agents · stages: Received → Checked → Underwriter review → Decided. Nothing is built until you confirm.Confirm planChange it
Confirm. Hold any file where the income doesn’t match.
Built, and run on your 20 sample files. Income conflicts now stop at underwriter review, with both sources shown.

Sample conversation

How Botminds IDP works

Ten stages, from the inbox to a signed result.

Every document takes the same governed path. Each stage does one job, records what it did, and runs in parallel with the rest of the file — so a thousand-page packet and a one-page form travel the same road.

Ingest

Uploads, mailboxes, SharePoint, cloud storage and APIs. Archives unpacked safely; exact duplicates dropped by fingerprint.

emailSharePointS3 · BlobAPI

Prepare

Pictures become pages, every TIFF frame included. Sideways pages are turned upright — before OCR and again after.

auto-rotate1,500 pages / doc

Read

OCR runs only where a page has no usable text, so born-digital pages keep their exact characters. Handwriting is read from the image.

OCRhandwritingcheckbox ink

Understand layout

Words with boxes and confidence, reading order, paragraph roles, and tables as grids with header cells and merged spans.

reading ordertable grid

Classify & split

Each page is classified; a packet is split into the documents inside it, and each split is typed.

page classifiersplit planner

Extract

Fields come from a schema that says what each value means. Section specialists work long files in parallel.

schemasection specialists

Check

Values re-read and compared, totals footed, rules and formulas applied, documents checked against each other.

QC agentrulescross-document

Score

One calibrated confidence per value: the model’s own view, proof the value is on the page, re-read agreement and the QC verdict.

groundingcalibration

Review

Values under the threshold go to a person, with the page open at the exact spot. Four-eyes where it matters.

human in the loopfour-eyes

Deliver & learn

Cited results to your systems by API and webhook; reviewer corrections feed the golden set the next change is tested on.

APIwebhooksgolden set
Every format

What can intelligent document processing read? Everything your work arrives in.

Work never arrives as one tidy PDF. It arrives as a scanned packet, a workbook, an email with nine attachments, a photo from a phone, a call. Botminds IDP takes each in its own form, and every one ends up as pages, regions and timestamps a value can cite.

PDFs — born-digital and scanned

PDF · up to 1,500 pages each

Born-digital pages keep their exact text; scanned or garbled pages are OCR’d page by page, and a searchable copy is kept beside the original.

Images and faxes

TIFF (every frame) · JPEG · PNG · GIF · BMP · WebP

Phone photos, fax images and multi-frame TIFFs become pages, are turned upright and read like any scan.

Handwriting and marks

handwritten fields · ticked boxes · redlines

Handwritten words are read from the page image with a confidence each; ticked boxes are detected from the ink, not guessed from text.

Spreadsheets

XLSX · XLS · CSV

Kept whole as the tables they are — tabs, headers and cell addresses intact — or split into rows when each row is its own record.

Office documents

DOCX · DOC · PPTX · RTF

Text, tables and slide content read directly; legacy formats converted first, so nothing depends on a scan.

Email and archives

EML · MSG · ZIP

The message and every attachment become one linked set. Archives are unpacked with limits on size, count and depth.

Web and data files

HTML · TXT · MD · JSON · XML

Pages and structured files read as text with their structure kept, ready for the same extraction and checks.

Calls and meetings

transcripts · SRT · VTT · timestamped JSON

Transcripts from your recording platform are indexed with their timestamps, so every finding cites the second it was said.

Video

frames sampled with timestamps

Video is sampled frame by frame for vision models; a finding points to the frame and the moment it came from.

OCR, ICR and OMR

Scans, handwriting and ticked boxes — read with a confidence on every word.

OCR (optical character recognition) turns printed text in an image into characters. ICR (intelligent character recognition) does the same for handwriting. OMR (optical mark recognition) reads ticks and filled boxes. A real file needs all three on the same page — and a way to say how sure each reading is.

Botminds IDP checks every page first. A born-digital page keeps its exact text; only pages with no text, or text that is garbled, are sent to OCR, so nothing is re-read that was already right. Sideways pages are turned upright before and after OCR. The OCR and layout service runs inside each customer’s own environment, and the original stays beside a searchable copy.

  • Printed textWord by word, with a box and a confidence for each word, in reading order.
  • HandwritingRead from the page image; low-confidence words go to a person, never guessed into a field.
  • Ticked boxesDetected from the ink inside each box, then confirmed by a vision check — so “Married ☑” never becomes “Married ☐”.
  • Stamps and marksA stamp on a scanned page no longer counts as “text”; the page is still read.
  • Rotation and skewSideways pages corrected automatically — 74 upright pages tested, zero turned by mistake.
0.95+ passesbelow threshold → a personbox = page region

Sample form, fictional claimant

Complex forms and tables

How do you extract tables from scanned PDFs? Rebuild them, then make them add up.

A table is where document tools quietly fail: merged headers, columns without rules, a schedule that breaks across a page, a footnote that says “in thousands”. Botminds IDP rebuilds each table as a grid, reads every cell into a typed value, and re-adds the totals — so a misread figure announces itself.

  • Grid, not textHeader cells, body cells and merged spans, each with its own confidence, addressed as page 5, table 1, row 3, column 2.
  • Across pagesExtraction agents join a table that continues onto the next page, carrying its headers with it.
  • Typed valuesNumbers, dates, currencies and units read as values, with the scale the page declares.
  • FootedSubtotals and totals re-added, running balances re-run; a sum that doesn’t foot is flagged with both figures.
  • Forms by meaningA schema says what each field means — “date of loss”, “policy number” — so the same schema reads every insurer’s layout.
  • Long filesA page router sends each section to its specialist, in parallel: one 17-page packet went from 4–5 minutes to under one.

Spreading a borrower’s statements is the hardest table work in finance; see commercial financial spreading and rent roll analysis.

Statement of operations · USD thousands · p.12–13
LineFY2025FY2024Source
Net revenue48,21044,975p.12 r3
Cost of revenue(29,804)(28,113)p.12 r4
Gross profit18,40616,862✓ foots
Operating expenses continued p.13(11,920)(11,407)p.13 r1
Depreciation(2,140)(1,988)p.13 r2
Operating income4,3463,467✓ foots
every subtotal re-addedscale: thousands, from the headerjoined across a page break

Sample statement, fictional company

Beyond English, beyond the page

Multilingual documents, call transcripts, photos and video.

Evidence no longer arrives only as English text on paper. Botminds IDP reads a document in the language it was written in and answers in yours, with the citation pointing to the original words. Recordings, footage and photos go through the same pipeline and cite a second, a frame or a region.

FRChiffre d’affaires net : 48 210 k€Compte de résultat, p.12p.12
DEKündigungsfrist: drei Monate zum QuartalsendeMietvertrag § 9.2, p.7p.7
ESFecha de vencimiento: 30 de junio de 2029Contrato de préstamo, cl. 4, p.3p.3
Read in the original · answered in EnglishNet revenue €48.2M · notice period three months to quarter-end · maturity June 30, 2029
3 sources

Extraction reads the language natively rather than translating first, so nothing is lost in a round trip. Our hardest measured set — financial statements from one lender — is 91% French and a quarter scanned. See financial statement translation and international credential evaluation.

Calls and meetings

Transcripts from your recording platform — SRT, VTT or timestamped JSON — are indexed segment by segment.

04:12Agent: “…the late fee will be waived if paid by Friday.”
04:19Finding: promise recorded, cited to 04:12 04:12

Video

Sampled frame by frame with timestamps for vision models.

frame 00:41

Photos

Read as pages; findings point to a region.

region 2
Classification and splitting

A 600-page packet, split into the documents inside it.

Loan files, claim files, submissions and data rooms arrive as one enormous PDF. Botminds IDP classifies every page, plans where one document ends and the next begins, types each split, and extracts each with the schema for its type — then says what the packet is missing.

Application — pp. 1–36
Tax returns — 3 years · pp. 37–146
Bank statements — 11 of 12 months
Pay stubs — 2 employers
Appraisal — 1 report
Title — commitment
Insurance — hazard + flood
Disclosures — 14 forms
Other — letters, IDs
missingMost recent bank statement (month 12 of 12) — requested before the file moves on.

Measured: a 607-page packet split into 61 documents, classified against 63 document types, in about 10 minutes with no errors · layout shown with sample types

Indexing and deep links

Every page indexed, every value one click from its source.

Reading a document once is not enough; people and agents come back to it with questions. Botminds IDP keeps each page as layers — the words with their boxes, the layout, the sections, the passages — and indexes the passages two ways: by keyword, for names, numbers and clause ids, and by meaning, for questions phrased differently from the page.

A citation is not a page number in a footnote. It is the union of the glyph boxes the value was read from, in the coordinates of the displayed page — so the viewer opens the right page and highlights the exact words. Ask a question in plain words and the answer comes back the same way; see batch record search or derivatives documentation search.

1
Pagethe image and its searchable text
kept
2
Wordseach with a box and a confidence
boxes
3
Layoutreading order, paragraphs, tables
grid
4
Passageschunked for retrieval
keyword
5
Meaningembedded and vector-indexed
vector
The confidence center · the consistency center

How sure is it — and does it agree with everything else?

Accuracy is decided less by the first read than by knowing which reads to trust. Botminds IDP answers two questions for every value: how confident should we be, and is it consistent — with a second read, with the arithmetic, with the rules and with every other document in the file.

Confidence center

One calibrated score, from four signals

  • The model’s viewHow sure the reader was of the value it returned.
  • GroundingProof that the value actually appears on the page it cites.
  • AgreementWhether independent re-reads return the same value.
  • The QC verdictA second agent’s review of the document’s reads.
rejecta person reviewspasses automatically

Measured: on held-out real financial statements, 48.8% of fields passed automatically at 98% measured precision, with a calibration error of 2.1 points; the rest went to a reviewer. The threshold is set from measured error on your set — never by hope.

Consistency center

Every document checked against the others

ApplicationPay stubsBank stmtsTax return
Name & address✓✓✓✓
Employer✓✓—✓
Monthly income✓✓✕✓
Running balance——✓—

Conflict: payroll deposits on the bank statements average $6,180 a month; the pay stubs and application say $7,450. Both sources are shown side by side for the underwriter to resolve.

  • Self-consistencyRe-reads compared; disagreement lowers confidence.
  • ArithmeticTotals footed, balances re-run, ratios recomputed.
  • RulesYour guardrails and formulas applied to every value.
  • Across documentsAgents compare the same fact in every place it appears.
Redaction

Redaction that removes the data — not a black box over it.

A black rectangle drawn over a PDF leaves the text underneath, ready to be copied out. Botminds IDP takes the text out of the page itself and overwrites the pixels of images, after a person has approved every box and the rule behind it.

Sample letter, fictional person

  • Found by agentsNames, contact details, IDs, account and card numbers, dates of birth, health details and privileged passages — proposed by category.
  • A rule per boxEvery proposed region cites the rule or legal basis behind it; nothing is removed without one.
  • A person decidesThe reviewer accepts, rejects or adds boxes; the agent only proposes.
  • Burned inPDF text removed from the page content; image pixels overwritten — PNG, JPEG, GIF, BMP, TIFF and WebP.
  • Recordings and videoMasked on playback, so reviewers and viewers never see or hear what was withheld.
  • LoggedWhat was removed, under which rule, approved by whom and when.

Built on it: document redaction, subject access requests, public records requests and clinical trial disclosure.

Fraud and tampering

Document fraud detection, before the document is trusted.

An edited pay stub reads perfectly — that is the point of editing it. So Botminds IDP checks the file itself, not just its words, the moment it arrives, and holds a suspect document before anyone relies on it. These forensic checks need no AI model and run in well under a second.

Mixed fonts

A figure set in a different font or weight from the line around it — the classic trace of an edited number.

White-out overlays

A shape drawn over the original text, with new text placed on top.

Editing-tool traces

Metadata showing the file passed through an online PDF or design editor after it was issued.

Balances that don’t add up

Running balances and totals re-computed line by line; an edited deposit breaks the chain.

Exact duplicates

The same file submitted twice is caught by its fingerprint, whatever it is called.

Contradictions

Agents compare the same fact across documents — employer, income, dates, amounts.

Held at intake

A suspect file is held with its reasons before any agent or person relies on it.

Shown, not decided

Every signal is shown on the document for an investigator to judge.

Built on it: document fraud detection for claims, auto loan fraud detection, check fraud detection and duplicate payment recovery.

Evaluations

How accurate is IDP? Measure it field by field, on your documents.

“99% accurate” means nothing without the documents, the fields and the method. We report accuracy the way an auditor would test it: on a golden set of your own documents, field by field, with the share that passes automatically and the precision of what passed — and we re-run it on every change.

Scorecard · one golden set

The numbers we report, always together

Precision of automatic passes98%
Fields passing automatically48.8%
Calibration error2.1 pts

Measured on held-out real financial statements from one lender — 91% French, a quarter scanned. Your documents get their own scorecard before go-live; our target for what leaves the system after review is 99% field accuracy.

Manual keying is not the error-free baseline it is assumed to be: a study of hand-entered pathology data found errors in 2.8% of fields, and only 76% of records fully correct. The comparison that matters is your process today against the new one, on the same documents.

  • Field accuracyCorrect fields over all fields, against a truth file — per field and per line item.
  • Straight-through rateThe share that passes with no person touching it.
  • Precision of passesThe error rate of what passed automatically — the number that carries the risk.
  • Precision · recall · F-scoreFor classification and extraction where missing a value and inventing one cost differently.
  • CalibrationWhether 95%-confident values are right about 95% of the time (Guo et al., 2017).
  • Table structureCell and header placement, not just cell text (TEDS).
  • Text similarity · judgesFor summaries and drafts: overlap scores and rubric-based judges.
  • Time and costWall time and cost per document, from the recorded run.

Gates, not reports. Golden sets are versioned. Every model, prompt or configuration change runs against its baseline; a change that scores worse does not publish, and drift in production is watched continuously. Public benchmarks show why this matters: large vision-language models read unusual pages well, yet still invent or drop content on dense and difficult pages. Read how crew evaluations measure agents.

Collections

Collections: one home for each kind of work — its documents, fields, stages and rules.

In Botminds, documents live in collections. A collection is not a folder; it is a small operating model for one kind of work: what the documents are, what to read from them, how they move, who works them, and which agents run when one arrives. A whole program is a handful of collections that know each other.

What a collection carries

  • TaxonomyDocument types as a tree of labels; fields as typed values, each with a written meaning.
  • LifecycleStages, with automations that fire on entry — run an agent, call a webhook, notify a role, set fields.
  • IntakeThe channels that feed it and the agents that run the moment a document arrives.
  • Auto-decide policyExactly when the AI may skip the reviewers — and when it never may.
  • AccessWho can see it, work it and approve it, down to the stage and the action.
  • VersionsSnapshots of the whole setup, so a change can be compared and rolled back.
  • PortabilityPackaged with its agents and screens as an installable solution: build once, install anywhere.

Go deeper: collections, taxonomy and lifecycles on the platform page.

The experience

One reading, every way of working: review screens, inboxes, chat, dashboards — and your systems.

Reading a document well is half the job; the other half is putting the result where each person works. Every screen below reads the same cited values, so the reviewer, the manager, the auditor and your loan system never disagree about what a document says.

Document workspace

Extracted fields beside the page; click a value and the page opens on it.

Review inbox

Stages become queues with owners and due times; four-eyes where you set it.

Ask the file

Questions in plain words, answered from the documents with the passage cited.

Dashboards

Straight-through rate, backlog and time per file, read from the same events as the work.

Pages from cards

Drag a summary, a checklist, a conflict list or a chart onto a page — no front-end project.

Talk to Piper

Build, change and question the program by conversation: “how many files wait at L2?”

Inside your portal

Embed a page, a chat or a workspace in your own site, with the same roles and audit trail.

API, webhooks and MCP

Push documents and pull typed, cited results; copilots and IDEs connect over MCP.

Each person sees the screen for their job

  • Processorinbox and workspace
  • Underwriterfile summary and conflicts
  • Managerdashboards and queues
  • Auditortimeline and citations
  • ITAPI, webhooks and MCP
  • Builderpage designer and Piper

Connected at both ends

Documents arrive by
UploadEmailSharePointAzure BlobAmazon S3Web sourcesAPI
Results leave by
APIWebhooksYour loan systemExports

Every result carries its citations, so the system downstream can show the source too.

XFlows and mesh

XFlows for the steps that must run the same way every time. Mesh for the volume.

A document program needs two things from its runtime: certainty about the path each document takes, and the ability to take ten thousand of them at once. Botminds IDP runs on both — and a team of agents reasons over the whole file when the work calls for judgment.

XFlow · deterministic

The same path for every document

DocumentarrivesAgentclassifyIf bankstatementLoop · monthextract, footAgentextract by typeWebhookloan systemEVERY RUN CAPTURED — INPUTS · OUTPUTS · RETRIES PER NODE
  • Typed nodesAgents, conditions, loops, webhooks, transforms and Python steps.
  • ReplayableSame input, same path; re-run yesterday’s document and get yesterday’s answer — or a diff you can explain.
Mesh · at scale

One file or ten thousand — same shape, more workers

LoanfilesFilechecksDecisionreadyDOCUMENTSSECTIONSFAN OUT 1 → N · FAN IN · QUEUE-BACKED · RESTART-PROOF
  • DurableEvery stage hands off through a queue; a restart resumes the work in flight instead of losing it.
  • ElasticThroughput is a worker count, not a rewrite: add workers and the same mesh moves more pages.
Reach for a teamwhen the work is one conversation — a leader agent and its members reasoning over a whole file.
Reach for an XFlowwhen each document must take the same, replayable path, with conditions, loops and mixed steps.
Reach for a meshwhen the volume is the problem — durable, queue-backed stages with fan-out to the size of the book.

In a mortgage program all three work together: the mesh fans 2,000 files out into documents and sections across workers; an XFlow takes each document through the same steps; a team of agents reasons over the finished file. See teams, XFlows and mesh in depth.

Speed and scale

A million mortgage pages in 30 minutes.

Mortgage work arrives in waves — month-end, a portfolio purchase, a quality-control sample, a servicing transfer. Botminds IDP scales out to meet the wave: a deployment sized for it reads a million pages of loan files in half an hour — about 2,000 files of 500 pages — with every page accounted for and every value cited.

From one file to a wave

1,000 pagesOne loan file, end to end
under 14 minutesmeasured
a day, in productionin production
1,000,000 pagesA wave of mortgage files
30 minutesscale-out sizing

Pages per run · bars on a log scale

Every stage scales out on its own

  • Workers follow the queueAs the queue grows the platform adds workers, and the machines under them, within minutes — and releases them when it drains.
  • Pages and files fan outEach file splits into documents, each document into sections, each section to its own specialist; results fan back in for file-level checks.
  • Model capacity is pooledModel calls spread across several model deployments with automatic fallback, so one rate limit never stalls the run.
  • Intake is governedAdmission keeps work inside what the databases and models can carry, so a wave queues instead of failing.
  • Nothing lost, nothing twiceEvery page is accounted for. In a measured burst, 350 files went in and 350 came out, none processed twice.
  • Restart-proofWork hands off through durable queues; a restart resumes in flight instead of starting over.
  • Cost stays proportionalThe lightest engine for each step — OCR only on pages without text, larger models only where reasoning is needed.

Measured, one lane at a time

1,000pages

One loan file, end to end — Fifteen stages, run in parallel; extraction is the long pole.

under 14 min
607pages

One packet, split into 61 documents — Classified against 63 document types, with no errors; 6.5× effective parallelism.

about 10 min
350files

One burst, all accounted for — 350 in, 350 out — nothing lost, nothing processed twice.

0 lost
17pages

Section specialists in parallel — The same packet, split by section: 4–5 minutes down to under a minute.

35–61 s

How to read these numbers. The measured runs are single files and packets on one deployment. Throughput grows with the capacity a deployment is sized for: a million pages in 30 minutes is a deployment scaled out for that wave — OCR, model capacity and workers in proportion. We size yours from your own volumes and files. In production, documents processed this way have also run at more than 50,000 claim communications a day, sorted into over 200 categories.

Geo-availability

Runs in the region your data must stay in — and stays up.

Document programs carry residency rules: loan files that must stay in the country, health records that must stay in the region. Botminds IDP deploys where your policy says — our cloud, a dedicated environment, your own cloud subscription or your premises — in the region you choose, and everything it keeps stays in that region — or, for backup copies, its paired region in the same geography.

Deploy anywhere

Runs in your private cloud or on‑premises.

Supported on Azure, AWS, Google Cloud and Oracle Cloud — and any other cloud you run.

  • Azure
  • AWS
  • Google Cloud
  • Oracle Cloud
  • Any cloud

Built to stay up

  • More than one copyEach core service runs as at least two copies on separate machines, so one machine failing drops nothing.
  • Self-healingA failed machine is replaced automatically, and the work it held resumes from the queue.
  • Scales under loadWorkers and the machines under them are added as queues grow, within minutes, and released after.
  • Updates without downtimeNew releases roll out one copy at a time while the rest keep serving.
  • Backed up continuouslyPoint-in-time restore of the database, with backup copies kept in a second region of the same geography.

If a region is lost, the database can be restored in its paired region from the geo-redundant backup. Queued work is durable, so documents in flight resume rather than restart.

Security

IDP security: seven layers around every page.

The documents that flow through Botminds IDP are loan files, claims, contracts, medical records and statements — the most sensitive paper a business holds. Security is the operating assumption, from the certifications on the outside to the boundary around each agent on the inside.

1
AssuranceSOC 2 Type II · ISO 27001 · GDPRIndependently audited controls, recurring penetration tests, reports on request.
2
IdentitySSO and SAML · two-factorSign-in through your identity provider; workspaces can be locked to it.
3
TransportTLS on every connectionBetween browsers, systems, services and model endpoints.
4
IsolationPer customerCollections, indexes and runs kept apart; one customer’s data never serves another’s query.
5
EncryptionAES-256 at restDocuments, page images, values, indexes and backups.
6
Agent boundariesScoped reads · allow-listed toolsAn agent reads only what it is attached to and calls only the tools it is allowed.
7
AuditEvery action, human or agentWhich document, which value, which tool, which person — kept, not reconstructed.
Your document

Security for agents that read documents

  • Documents are data, not instructionsText on a page is evidence for a value. It cannot add a tool or widen an agent’s reach, because those are fixed in the agent’s settings, not in its input.
  • Fail closedAn agent whose tool settings are missing or broken gets no tools — never the full set.
  • Approval before actionTools that change something can be set to wait for a named person’s approval.
  • Safe intakeArchives unpacked with limits on size, count and depth; office files converted in an isolated process with no access to secrets; tampered files held.
  • No training on your dataYour documents never train shared or third-party models. Your reviewers’ corrections improve only your own deployment.

Bring your security review: see security at Botminds for the controls by category, the certifications and the audit reports.

Role-based access

Role-based access control for documents: who can see, change and sign each one.

Access is decided by role, not by folder, and narrows step by step — from the platform down to a single action on a single stage. People, agents and systems are all held to it, and every answer the platform gives respects it.

  1. Platformwho runs the installation
  2. Workspacea business unit or team
  3. Projectone program, its roles
  4. Collectionone kind of document
  5. Stageone step of review
  6. Actionsee, correct, approve, export
  • Sign-in your waySSO and SAML through your identity provider. A workspace can be locked to it, require two-factor sign-in and limit who may invite.
  • See anyone’s accessOne view shows what a person can reach across every workspace and project; preview the screens a role will see before you grant it.
  • Answers respect accessChat and search draw only on collections the person asking may see.
  • Agents are scoped tooEach agent reads only the collections it is attached to and calls only the tools it is allowed.
  • Keys for systemsSystems connect with per-project API keys, rotated or revoked in one place.
  • Leavers lose access at onceSuspending someone ends their access on their next request.
  • Shared views keep the rulesAn embedded page or chat carries the same roles and the same audit trail.
Loan files · who may do what
ProcessorUnderwriterQC auditorBuilderAdmin
See the file and its documents✓✓✓✓✓
Correct an extracted value✓✓flag——
Move a file to the next stage✓✓———
Approve at underwriter review—✓———
Export results—✓✓—✓
Change agents, fields and stages———✓✓
Invite people and set roles————✓

Example role set. Roles are yours to define, action by action and stage by stage. Here the QC auditor can flag a value but not change it, and only an underwriter can approve.

Confidentiality

Confidential by default: what never happens to your documents.

Confidentiality is not one control; it is the sum of where data lives, who can reach it and what the software is allowed to do with it. Here is the short list of things Botminds IDP never does with a document.

Never used to train shared or third-party modelsCorrections improve your own deployment and nobody else’s.
Never served to another customerIsolation per customer, down to the indexes.
Never read by an agent that isn’t attached to itAgents see only the collections they are given.
Never put in an answer for someone who can’t see the sourceRetrieval is scoped to what the asker may open.
Never released unredacted where a redacted copy is requiredRelease goes through approval; removals are burned in and logged.
Never kept past your retention ruleDeletion on request, verifiably; export your documents and data at any time.

Need to know, by design

A processor sees the queue they work; an underwriter sees the files at their stage; an auditor sees the trail without the power to change it. Four-eyes review puts a second named person on the decisions that matter, and redacted copies let documents travel to people who should see only part of them.

Every touch on the record

Each document keeps its own timeline: when it arrived, which agents read it and what they returned, which values a person changed, who approved it and when. When someone asks who did what to a file, the answer is already written down.

Why IDP projects stall

16 problems every IDP program meets — and the answer to each.

Most document programs stop at the easy ten document types, review everything anyway, and cannot say how accurate they are. These are the reasons, and how Botminds IDP is built around each one.

The problemWhy it happensHow Botminds IDP answers it
Templates breakZonal and template tools read positions, not meaning. A vendor moves a field and the read silently fails.Extraction is defined by what a field means, in a schema — never by where it sits. A new layout is read on the day it arrives.
The long tail of document typesThe top ten types are easy. The next four hundred each need their own setup, so most programs stop at the head.Classification and extraction learn from a description and a handful of examples, so the hundredth type costs what the tenth did.
Low straight-through ratesConfidence scores that don’t predict errors force people to review everything, and the business case evaporates.Confidence is calibrated against your golden set, so the auto-accept threshold is chosen from measured error, not hope.
Handwriting and poor scansFaxes, phone photos, skew, stamps and handwriting push character error rates up and confidence down.Pages put upright, OCR only where text is missing, a confidence on every word, and low-confidence values routed to a person — never guessed.
Tables that don’t surviveMerged headers, borderless layouts and tables that run across pages come out as a jumble of text.Tables are rebuilt as structure — header cells, rows, merged cells, units — and footed, so a misread number shows up as a total that doesn’t add up.
Values invented by a modelGenerative extraction can produce a plausible number that is not on the page.Every value must point to the page and region it came from. A value with no source is not accepted.
No audit trailWhen a regulator or auditor asks where a number came from, nobody can show them.One click from any value to its passage; every agent step, edit and approval is recorded.
Documents disagreeExtraction alone leaves the comparison — pay stub against deposit, invoice against contract — to people.Consistency checks run across documents and against your systems, and each conflict is shown with both sources.
Mixed languages and scriptsSingle-language tools drop the foreign-language half of the file, or translate and lose the original.Read in the original language, answered in yours, cited to the original words.
Not just documents any moreEvidence arrives as calls, voicemail, photos and video, and sits outside the IDP tool entirely.Transcripts, video frames and images go through the same pipeline and are cited to the second, the frame or the region.
Personal data everywhereEvery file carries data someone may not see, and manual redaction misses and over-cuts.Redaction proposed with a rule for every box, approved by a reviewer, burned into the file, and logged.
Accuracy nobody measuredMost teams cannot say how accurate their system is, field by field, today.Golden sets, field-level scores and a regression run on every change — on your documents, before you sign.
Model driftA model update changes the reads, and nobody notices until a downstream report is wrong.Every model or prompt change re-runs the evaluation set; a change that scores worse does not ship.
Cost per pageSending every page to the largest model makes the economics fail at volume.Each step uses the right engine: OCR only on pages without text, layout where it suffices, larger models only where reasoning is needed.
Volume arrives in wavesMonth-end, a portfolio purchase or a backlog swamps a fleet sized for the average day, and files wait for days.Workers follow the queue: capacity is added as the wave arrives and released as it drains, and intake is governed so nothing is dropped.
Sensitive files, wide accessDocument tools grant access by folder, and AI answers can surface text the asker should never see.Roles down to the collection, stage and action; answers drawn only from what the asker may open; agents scoped the same way.
Built on Botminds IDP

Intelligent document processing use cases, already built.

88% of the 1,062 solutions in the library start from documents, and every one of them runs on Botminds IDP. Here are 75, grouped by the capability they lean on hardest — across every industry we serve. Each opens its own page, with its screens and a demo.

Scans, faxes and handwriting

Pages people wrote, stamped, faxed and photographed — read with a confidence on every line.

Complex forms

Multi-page forms with checkboxes and repeating sections — field by field, against the rules for that form.

Tables and financial statements

Tables rebuilt cell by cell, joined across pages, then footed so the totals prove the read.

Spreadsheets, kept whole

Workbooks read as the tables they are — every tab, header and cell address kept, never flattened into text.

  • Bordereaux ManagementAny delegate’s bordereau taken into the standard layout, every rejected row explained.
    Insurance
  • Group Census & RFP Intake AutomationThe broker’s census opened as a spreadsheet, each cell that would break the rating marked.
    Insurance
  • Loan Tape ValidationEvery loan-tape cell tied to the clause, register or filing that sets it.
    Lending
  • NAV OversightAdministrator NAV packs — positions, prices, trial balances — checked against the manager’s books.
    Investment Management
  • Cost of Service Study ReviewCell errors in a cost-of-service workbook found before anyone outside does.
    Utilities

Every language

Read in the language it was written in, answered in yours, cited to the original words.

Audio, video and images

Call transcripts, footage and photos read like documents — every finding cited to a second, a frame or a region.

Packets: classify and split

Hundreds of pages in one file, split into the documents inside, typed, and checked for what is missing.

Long documents: clauses and covenants

Agreements read under their own definitions, amendments applied in order, every clause cited.

Redaction and personal data

Personal, privileged and protected data proposed for removal with a reason, approved by a person, and truly removed.

Fraud and tampering

Mixed fonts, white-out, editing-tool traces, balances that don’t add up, duplicates and rings — each signal shown.

Consistency and reconciliation

Documents checked against each other and against your systems — the comparison people spend most of their day on.

Cited answers over documents

Ask in plain words; the answer comes back with the passage, page and version it came from.

Documents written from documents

Memos, responses and filings drafted from what was read — every sentence traceable to a source.

Browse all 1,062 solutions, or start from an industry: insurance, lending, banking, life sciences, investment management, utilities, airlines, education and cross-industry.

Side by side

Template OCR, LLM-only extraction, Botminds IDP.

The question to ask any intelligent document processing software is not “can it read this?” Almost everything can, once. It is what happens on the thousandth document, the new layout, and the audit.

Template OCRLLM-only extractionBotminds IDP
A new layout arrivesA template is built and tested firstRead at once — but unverifiedRead at once, by meaning, and checked
Where a value came fromA zone on a known layoutUsually nowherePage and region, one click away
Handwriting and ticked boxesSeparate engine, separate setupRead, with no confidenceRead with a confidence per word; boxes from the ink
TablesFixed column zonesRows often merged or droppedGrid with header cells and spans, joined across pages, footed
ConfidencePer-engine scores, rarely calibratedNone, or the model’s own guessFused, grounded on the page, calibrated on your set
Documents checked against each otherLeft to peopleLeft to peopleAgents compare documents, rules and systems
RedactionA separate productNot doneProposed with a rule, approved, burned in, logged
Tampered documentsRarely checkedNot checkedFonts, white-out, editing traces, arithmetic — at intake
AccuracyQuoted from a demo setNot measuredGolden sets, field by field, on every change
Who decidesA reviewer, without the evidenceNobody, by defaultA named person, with the evidence, recorded
How the work is doneOne fixed pass per templateOne model, one promptA crew of agents that plan, use tools and check each other
VolumeServers sized for the average dayBound by one model’s rate limitScales out with the queue — a million pages in 30 minutes, sized for it
Who can see whatFolder permissionsWhoever holds the promptRoles down to the collection, stage and action; answers respect them
Where it runsA server you maintainWherever the model vendor runs itThe region you choose — our cloud, yours, or on-premises
What is Botminds IDP?

Botminds IDP is the intelligent document processing technology inside the Botminds platform. It reads any document or record — scans, handwriting, complex forms, tables, spreadsheets, emails, photos, call transcripts and video, in the language they were written in — extracts what matters, checks it against rules and other documents, and hands a cited result to a person or a system. Every value links to the page and region it came from.

What is intelligent document processing?

Intelligent document processing (IDP) is software that turns documents into checked, structured data and decisions. It sorts what arrives, extracts the fields and passages that matter, validates them against rules and other documents, and passes the result on, with a person reviewing what the system is unsure of. Our buyer’s guide explains IDP in depth.

What is the difference between OCR, ICR and IDP?

OCR (optical character recognition) turns printed text in an image into characters. ICR (intelligent character recognition) does the same for handwriting. IDP uses both as early steps, then understands the layout, classifies the document, extracts the meaning, validates it and routes the result. OCR gives you text; IDP gives you checked data you can act on.

What is agentic document processing?

Agentic document processing gives each job on a file to an AI agent with its own instructions, tools and limits. In Botminds IDP an intake agent sorts and splits the file, extraction agents read each document by meaning, a standardization agent puts values in your formats, a quality agent checks the reads, a cross-document agent compares the file, and redaction, answering and drafting agents do the rest. They stop at a person where judgment is needed, every step is recorded and every value is cited, so the work can be audited.

How are AI agents kept under control in Botminds IDP?

Each agent has a written boundary: the collections it may read, the tools on its allow-list, the rules it must follow and the cases that need a person. An agent whose tool settings are missing or broken gets no tools at all. Text inside a document is treated as evidence, never as instructions, so a page cannot widen what an agent may do. Tools that change something can wait for a named person’s approval, and every change to an agent is tested on a golden set before it publishes.

What are collections in Botminds IDP?

A collection is the home for one kind of work: its document types and fields, its review stages and the automations on each stage, the agents that run when a document arrives, the policy for when AI may skip the reviewers, and who may see and act on it. A mortgage program, for example, is a loan-file collection with a child collection for the documents in each file, a structured collection for income and asset lines, a knowledge collection of guidelines, a work queue of conditions and a golden set for testing.

Can Botminds IDP read handwriting?

Yes. Handwriting is read from the page image alongside printed text, with a confidence on every word. Ticked boxes are detected from the ink on the page, not guessed from text. Anything below the confidence threshold goes to a person, who sees the original image next to the reading.

How does Botminds IDP extract tables from scanned PDFs?

Scanned pages are put upright and read by OCR, then the layout model rebuilds each table as a grid — header cells, rows, merged cells and a confidence for every cell. Extraction agents join tables that continue across pages and read each cell into a typed value with its units. Totals are then re-added, so a misread number shows up as a sum that does not foot.

Which file types and languages does Botminds IDP handle?

Native and scanned PDFs up to 1,500 pages each; images (TIFF with every frame, JPEG, PNG, GIF, BMP, WebP); faxes; Word, PowerPoint and legacy Office files; Excel and CSV, kept whole; email (EML, MSG) with its attachments; HTML, text, JSON and XML; ZIP archives, unpacked safely; call and meeting transcripts; and video, sampled frame by frame. Documents are read in the language they were written in and cited to the original words.

How accurate is Botminds IDP?

We measure accuracy field by field on a golden set of your own documents and report the numbers together: the share of fields that pass automatically, the precision of those automatic passes, and how well confidence is calibrated. On held-out real financial statements — mostly French, a quarter of them scanned — fields above the confidence threshold passed automatically at 98% measured precision, and the rest went to a reviewer. Our target for what leaves the system after review is 99% field accuracy, and we run the test on your documents before you sign.

How fast can Botminds IDP process mortgage files?

Botminds IDP scales out with the queue: a deployment sized for the wave reads a million pages of mortgage files in 30 minutes — about 2,000 loan files of 500 pages, or roughly 556 pages a second. That is a sizing figure for a scaled-out deployment; the measured runs are single files. Pages, documents and sections fan out across workers that are added as the queue grows, model calls are pooled across several deployments, and intake is governed so nothing is dropped. Measured on single files, a 1,000-page loan file was read end to end in under 14 minutes, and a 607-page packet was split into 61 documents in about 10 minutes with no errors. In production, deployments have read 100,000 scanned invoice pages a day.

How does Botminds IDP prevent hallucinated values?

Every extracted value must point to the page and region it came from, and the confidence score checks that the value actually appears on that page. Values are re-read and compared, checked by a second reviewer agent, and tested against rules and other documents. Low-confidence values go to a person, and every change to a model or prompt re-runs the evaluation set before it ships.

Can Botminds IDP redact personal data?

Yes. Agents find personal, financial, health and privileged data and propose each redaction with the rule behind it; a reviewer approves before anything is removed. In PDFs the text is taken out of the page, not covered by a box, and in images the pixels are overwritten, so nothing can be copied back. Recordings and video are masked on playback. Every removal is logged with its reason.

Where does Botminds IDP run, and where is my data stored?

In the region you choose — in the Botminds cloud, a dedicated environment, your own cloud subscription on Azure, AWS, Google Cloud or Oracle Cloud, or on your premises. Original documents, page images, extracted values, indexes and run history stay in that region, with backup copies in its paired region in the same geography; model calls go only to the model deployments you approve. Each core service runs as at least two copies, workers scale with the queue, and the database has point-in-time restore.

How does role-based access control work in Botminds IDP?

Access is set by role and narrows from the platform to the workspace, the project, the collection, the review stage and the single action — see, correct, approve, export or configure. Sign-in goes through your identity provider with SSO and SAML; a workspace can be locked to it and require two-factor sign-in. Chat and search answer only from collections the asker may see, agents are scoped to the collections they are attached to, and one view shows any person’s effective access.

Is Botminds IDP secure and confidential enough for regulated documents?

Botminds holds SOC 2 Type II and ISO 27001 and supports GDPR. Data is encrypted with TLS in transit and AES-256 at rest, isolated per customer, and never used to train shared or third-party models; reviewers’ corrections improve only your own deployment. Every action by a person or an agent is in the audit trail, redaction removes data rather than covering it, and four-eyes review puts a second named person on the decisions that matter.

Can Botminds IDP detect document fraud?

Yes. Forensic checks look for mixed fonts, white-out overlays, editing-tool metadata and running balances that do not add up; they need no AI model, take well under a second, and hold a suspect document at intake. Exact duplicates are caught by fingerprint, and agents look for contradictions across documents. Each signal is shown for an investigator to judge.

Your hardest documents.
Read and proven.

Send us the files your current tools get wrong. We’ll run Botminds IDP on them and show you the scorecard, field by field.