Evaluate · testing the boarding check

Loan boarding accuracy: plant known errors in a test tape

The honest way to measure a loan boarding check is to plant errors you know about and count what it catches. This guide gives a 50-error test plan built from the faults regulators keep finding in servicing transfers, the sample sizes that make a spot check meaningful, and how Servicing Transfer Reconciliation reads on the same test.

Updated · 13 min read

Loan boarding is setting up transferred loans on the new servicer's system, and its accuracy can only be measured by testing the check that is supposed to catch errors. The method that works is a seeded test: take a copy of a real tranche, plant a known number of known errors of each type, in the tape, the field map, the documents and the old servicer's notes, and count how many the boarding check finds. It matters because a check that has never been tested reports "no exceptions" whether the loans are clean or not, and servicing transfers fail in places a quiet check cannot see. Botminds' Servicing Transfer Reconciliation compares every loan's tape with its signed documents, the prior servicer's notes and the boarded record, and a seeded test is the way to hold it, or any alternative, to account.

The figures for the solution come from a fictional sample transfer of 4,812 loans from Ashgrove Home Loans to Copperline Loan Servicing. The test plan is our own design, offered for a servicer to run on its own data.

Most differences in a transferred tranche are hygiene; one in ten would hurt a borrower within a month

Loans with a difference, by harm

10.2%
26.1%
63.6%
  • High · 38 · 10.2%
  • Medium · 97 · 26.1%
  • Low · 236 · 63.6%

All 4,812 loans

92.3%
7.7%
  • Clean on day one · 4,441 · 92.3%
  • 371 with a difference · 7.7%
Fictional sample transfer, Ashgrove Tranche 3, as matched by Servicing Transfer Reconciliation on day 11. High means money or credit harm to the borrower within 30 days; medium within 90 days or a notice at risk; low is data hygiene. Thresholds are settings.

Loan boarding accuracy is measured, not assumed

A boarding check that reports few exceptions has told you one of two things: the loans are clean, or the check cannot see the errors. Without a test the two are indistinguishable. The seeded test separates them by giving the check errors whose number and location you know in advance, so its catch rate, and its false alarms, become numbers rather than impressions.

The idea is old in software testing and rare in servicing operations, where boarding QC is usually judged by the complaints that do not arrive. That is a lagging measure with a long lag. In the sample transfer, the first harm on the worst loan was a late fee four days away, and the first complaint would have come after it.

What are common loan boarding errors?

The common loan boarding errors fall into a handful of families: balances and suspense, rates and adjustable-rate terms, escrow payees and due dates, payment history and autopay, insurance dates, investor and custody codes, borrower contacts, and loss mitigation status. Most of them are mapping decisions repeated on every loan; the most harmful are workouts that never reached the tape at all.

Where 1,463 differences fell in one tranche, by field family

Investor and custody
494
Borrower and contact
312
Balances
188
Escrow
141
Payment history
102
Loan terms
97
Insurance
83
Loss mitigation
46
Fictional sample transfer in Servicing Transfer Reconciliation: 1,463 field differences on 371 loans. Custody and contact hygiene dominate the count; escrow and loss mitigation, the two shaded families, hold most of the differences that reach a borrower.

The count and the harm point in opposite directions, which is the first thing a test must respect. A boarding QC tuned to the biggest bars spends its time on custody codes. The 46 loss mitigation differences include nine trial plans being billed in full; the 141 escrow differences include six insurance premiums due with nothing scheduled. A seeded test should weight its planted errors toward the families that hurt borrowers, not toward the families that are common.

Why a tape-to-system QC meets the bulletin's words and misses its point

The CFPB's transfer guidance asks for two kinds of testing. Before the transfer, "using tailored testing protocols to evaluate the compatibility of the transferred data with the transferee servicer's systems and data mapping protocols." After it, "engaging in quality control work after a transfer of preliminary data to validate that the data on the transferee's system matches the data submitted by the transferor," with mapping errors from de-boarding or on-boarding prioritised for resolution (CFPB Bulletin 2020-02).

Read literally, the second sentence describes a two-way check: the transferee's system against the transferor's submission. A servicer can perform it perfectly and still board every error that was already in the submission. The same guidance, and the rule behind it, expects more: the transferee must identify information that "may not have been transferred," and the bulletin's own list of data to receive includes "the terms of any loss mitigation that was offered to a borrower under which the borrower is performing." A test plan should therefore include errors that a faithful copy of the tape cannot reveal, because those are the ones the rule was written for.

How to test loan boarding accuracy: plant 50 known errors

Plant 50 errors of ten types in a copy of a real tranche, five of each, spread across the four places errors come from: the tape, the field map, the loan documents and the old servicer's notes. Then run the boarding check unchanged and count, by type, what it found, what it missed and what it raised that you did not plant.

A 50-error seeded test for a servicing transfer boarding check

Error planted (5 of each)Where it is plantedSeen by tape-to-systemSeen by a three-source check
Trial plan approved in the notes, blank on the tapeNotes and signed notice onlyNoYes, if notes and documents are read
Trial-sized payments with no plan anywhere on filePayment history onlyNoYes, if payments are searched for plan-sized amounts
ARM next change date mapped from the first-change columnField mapNo: both agreeYes: the note disagrees
Escrow payee or due date missing for an insurance renewalTapeNoYes: the policy or escrow analysis disagrees
Suspense balance dropped in conversionConversionYesYes
Principal balance off by more than toleranceConversionYesYes
Autopay enrolment made the day before transfer, not loadedSeparate enrolment fileNoYes, if the enrolment file is in scope
Mortgage insurance termination date missingTapeNoYes: the note date and amortisation disagree
Mailing address newer in the notes than on the tapeNotesNoYes
Loan number changed between tape and image bundleImage indexNo: no image to compareYes, if images are re-keyed to loans
Our test design, not a measured result. Each error type mirrors a fault the CFPB has described in transfer guidance or findings, or one found in the fictional sample tranche (trial plans in notes, the late autopay file, the ARM column).

Three rules keep the test honest. Plant errors in a copy, never in production. Have someone outside the boarding team plant them and hold the answer key until the run is done. And count false alarms as carefully as catches: a check that flags 2,000 loans to find 50 has moved the work, not done it. In the sample tranche the comparison flagged 371 loans of 4,812 and closed the other 4,441, which is the ratio a team can actually work.

Differences grouped by the cause behind them

Root causes panel for Ashgrove Tranche 3: three causes explain 25 of the 38 high-harm loans. Flex plans lived only in Ashgrove's notes while a workout system update was pending, so the plan type field is blank on the tape for 9 loans, with a button to board the 9 plans from the notes; the autopay file ACH_ENROLL_0930.csv arrived at 18:40 on 30 Sep after the 17:00 conversion cut-off and 11 enrolments were never loaded; and for 5/1 adjustable-rate loans modified since 2020 the map reads ORIG_FIRST_CHG_DT instead of NEXT_CHG_DT, pulling the next change forward to 1 Nov on 5 loans. Beside it, a bar chart of 1,463 field differences by family.
Servicing Transfer Reconciliation on the fictional sample tranche. A seeded test should be scored the same way: did the check find each planted error, and did it name the cause, so one fix closes all five of a type.

How to validate a transfer data tape before the transfer date

Validate the tape before the transfer by boarding it into a test environment and running the same three-source comparison on the documents and notes you already have. The 2014 transfer bulletin describes a transferor that gave buyers "advance access to a web portal containing loan documentation" 45 to 60 days before transfer; where that access exists, the test can run on the real tranche weeks before a borrower is affected (CFPB Bulletin 2014-01).

The pre-transfer run catches mapping errors cheaply, because a wrong column is fixed in the map once. It cannot catch what the seller sends late. The same bulletin warned that examiners would "carefully scrutinize the policies and procedures of any institution that regularly waits until after loan boarding to transfer information that it had in its possession prior to boarding." A test plan should therefore run twice: on the preliminary tape and documents before transfer, and on the final file, notes and boarded records after.

How many loans should be tested after a transfer?

Enough to have a real chance of seeing a rare pattern, which for the errors that matter is far more than most samples. If a defect affects nine loans in 4,812, a random sample of 100 loans misses all nine about 83% of the time. To be 95% sure of seeing at least one, you need a sample of about 1,400 loans, more than a quarter of the tranche.

Chance a random sample sees at least one loan from a rare pattern, in a tranche of 4,812

Loans affectedSample of 100Sample of 400Sample of 1,600Every loan
5 (0.10%)10%35%87%100%
9 (0.19%)17%54%97%100%
25 (0.52%)41%89%over 99%100%
100 (2.1%)88%over 99%over 99%100%
Our arithmetic: hypergeometric probability of drawing at least one affected loan without replacement. Seeing one loan of a pattern is the minimum; recognising it as a pattern needs more.

The table is the argument for comparing every loan. Sampling works for errors that are common and evenly spread, such as a rounding rule. It fails for the errors a transfer actually produces: a handful of plans set up in notes, one late file, one product's change date. That is why the solution's design target is every loan and every field, not a sample.

What errors do transferees miss? The regulators' list

The CFPB's examination record names the misses. In its 2014 bulletin it reported that in "a number of examinations" servicers "had failed to properly identify loans that were in a trial or permanent modification with the prior servicer at time of transfer," and that some "failed to honor trial or permanent modification offers unless they could independently confirm that the prior servicer properly offered a modification" (CFPB Bulletin 2014-01). Borrowers were asked to resubmit paperwork; some received modifications on worse terms; in some cases the servicer "actually conducted a foreclosure sale."

The Congressional Research Service put the history in one line in 2025: during the foreclosure crisis, "information about troubled borrowers' circumstances was frequently lost during transfers to specialty servicers," delaying loss mitigation and disrupting state foreclosure processes (CRS R48713). A seeded test that does not include workouts, payment patterns and late documents is testing the errors that were never the problem.

The tranche, by category and by harm

Ashgrove Tranche 3 overview on day 11: 4,812 of 4,812 loans compared, 186 fields each; 4,441 clean on day one (92.3%); 371 loans with a difference, 1,463 field differences; 38 high harm open. The agents' run: tape and image reader split 311,640 pages into 61,904 documents and re-keyed 7 loan numbers; field comparer made 895,032 comparisons; workout carry-over checker read 1,926,410 notes entries and found 9 Flex plans not on the tape and 4 trial-sized payment patterns with no signed agreement; escrow checker tied the $14,862,310.44 wire and found 6 premiums due with nothing scheduled; payment watcher read 1,286 forwarded payments and found 3 late fees and 11 autopay enrolments not carried; harm ranker found 38 high, 97 medium, 236 low and 3 root causes. A matrix shows loans with a difference by category and harm.
Servicing Transfer Reconciliation on the fictional sample tranche. Each agent's line is a count that a seeded test can be checked against.

Reading the results: catch rate by type, and what to do with a miss

Report the result as a catch rate by error type, not one number. Five of five trial plans and nought of five autopay enrolments is a different finding from fifty of fifty on balances, and it points at a specific gap: an input the check does not read. A miss is fixed by adding the source, not by adding reviewers.

Running a seeded loan boarding test

  1. Pick a recent tranche with workouts in it

    A clean flow of current loans will not exercise the checks that matter.

  2. Have someone outside boarding plant the errors

    Five of each of ten types; the answer key stays sealed until the run is scored.

  3. Plant in all four places

    Tape, field map, documents and the old servicer’s notes. Errors only in the tape test half the problem.

  4. Run the check exactly as in production

    Same tolerances, same field set, same reviewers. A tuned test proves the tuning.

  5. Score catch rate, cause and harm rank

    Was each error found, was its cause named, and was it ranked ahead of hygiene items?

  6. Count the false alarms

    Flags per real error is the cost of the check; report it beside the catch rate.

  7. Repeat after every map change

    A new seller layout or a system upgrade is a new check.

The test also serves the second line. Internal audit and compliance can rerun it without knowing how the check works, and the result goes into the post-transfer certification as evidence that the review was capable of finding what it certifies was absent. For the full comparison of approaches see what a loan onboarding system must check; for a test on real outcomes rather than planted errors, see piloting on a transfer you already closed. Botminds runs this kind of test on Servicing Transfer Reconciliation with a servicer's own tranche.

Questions people ask

What is a post-transfer QC review?

It is the check after boarding that the new servicer's records match what the prior servicer had, and that nothing needed was left behind. The CFPB recommends it in Bulletin 2020-02 alongside a post-transfer review of whether the transfer plan worked, and monitoring of complaints and loss mitigation results for at least four to six months.

What is a good loan boarding error rate?

No regulator publishes a target, and a raw error rate says little because most differences are hygiene. In the sample tranche 7.7% of loans had a difference but 0.8% had one that would hurt the borrower within 30 days. Track the harmful rate and its causes, and drive it toward zero before the first statement goes out.

Should we test the old servicer's data or our own boarding?

Both, because the rule splits the duty. The transferor must send information in a form that ensures its accuracy; the transferee must identify what was not sent and obtain it. A seeded test that plants errors in the tape and the notes tests your ability to find the transferor's mistakes, which is the half most checks skip.

How often should the boarding check be tested?

At least whenever the inputs change: a new seller, a new tape layout, a system conversion or a change to the field map. Each of those creates new places for an error to hide, and a check that passed on last quarter's layout has not been tested on this one.

Can a seeded test be run on live loans?

Not safely. Plant errors only in a copy of the tape, documents and boarded records in a test environment. The point is to measure the check, and a planted error that leaked into production would become the borrower harm the test exists to prevent.

Servicing Transfer Reconciliation.
See it on your own files.

An agentic solution from Botminds. Compares what the old servicer sent with what landed in your system, loan by loan, before a borrower finds the gap. Book a demo, or explore how it works.