- Before
- Runs a validation plan that needs 34,600 hours with a team that has 22,400, and hears about drift at the next annual validation.
- Now
- Sees each model’s control chart monthly, decides the 14 borderline entries, and signs validations drafted from the evidence.
CRE default model drift, the SR 26-2 re-scope and a signed validation
A sample bank with $41.3 billion in assets, 412 inventory entries and the Model Risk Committee in eight days. Here is one Monday, screen by screen, in the working solution.
A worked example on sample data. Names, IDs and figures on the screens and in this section come from the demo.
- 0108:52
Each model on its own control chart
Head of model risk managementAfter the 06:00 run, the monitor shows 184 models on monthly production data: 0 out of control, 2 trending, 182 in control. The CRE probability of default model is trending: rolling 12-month AUC 0.796, center 0.820, lower control limit 0.795. Then the month’s CRE defaults file arrives.
“3,084 CRE loans to score. The line has been below center for a year and falling each month since December.”
- 0209:15
Out of control, and a revalidation task opens
Outcomes analystThe new point lands at 0.788, below the lower control limit, and current loan-to-value PSI reaches 0.27 against a 0.25 limit. A revalidation task opens on its own with the trigger, the scope (office recalibration; construction-loan use), the lead validator, a link to the annual validation due later this month, and four pieces of evidence.
“AUC 0.788 against a 0.795 limit, after a year below center and nine months falling.”
- 03One click
The drift point opens its evidence
Head of model risk managementThe month’s point shows where the drop comes from. By segment, office has fallen to an AUC of 0.68 from 0.80 at development, while multifamily, retail, industrial and hospitality hold. Office loans defaulted at twice the predicted rate: 16 defaults against 8.1 expected. The office back-test, the latest quarterly monitoring report, the challenger results and the change log sit one click away.
- 044 min 10 s
The whole inventory, re-scoped to SR 26-2
Inventory scoper · Materiality tiererThe CRE model is not the only thing due before the committee. In the SR 26-2 re-scope, four agents test all 412 entries against the new definition of a model: 298 stay models, 86 move to the tools and calculations register, 28 to the AI tool register, and 14 borderline spreadsheets go to the head of model risk to decide. Re-tiered by materiality, the 12-month plan falls from 214 validations to 131, and from 34,600 hours to 22,320, inside the team’s 22,400.
“298 + 86 + 28 = 412 · nothing is deleted: each entry that leaves keeps its owner, history and reason.”
- 05Each entry
Model or not, with the reason written down
Inventory scoperEach entry carries its scope test against SR 26-2 §II and its materiality against §III. For the CRE default model: a complex quantitative method, statistical theory, quantitative estimates, not generative AI, so a model. Exposure of $11.8 billion and a financial-reporting purpose keep it in Tier 1.
“Logistic regression fitted to loan history: statistical theory turning inputs into default estimates, so a model.”
- 062 min 59 s
The annual validation, drafted from 61 documents
Evidence reader · Validation drafterThe lead validator starts from the evidence instead of a blank template. The agents read the 146-page development document, four monitoring reports, the change log, last year’s validation and the user guide, ran 23 of 23 tests, and drafted six report sections with 31 citations and four findings (one high, two medium, one low). The proposed rating is fit for use with conditions; the validator can change any severity.
- 07Next
The back-test a portfolio total would have missed
Outcomes analystAcross all CRE, 48 defaults on 3,084 loans (1.56% observed against 1.34% predicted) sits inside the range. Office does not: 3.65% observed against 1.84% predicted, outside the 99% range, p = 0.008. The draft asks for a governed overlay of +181 bp until the office segment is recalibrated, about $13.7 million added to the CRE allowance.
“Overall the model looks calibrated; the office segment is not. A test on the total alone would have missed it.”
- 08Signed
Two signatures, and conditions the committee approves
Head of model risk managementThe head of model risk approves this year’s validation of the CRE default model as fit for use with conditions: the governed office overlay, no construction loans rated with the model until that use is validated, and the office segment recalibrated and re-validated within 90 days of the committee. The signature records what it means, and the lead validator co-signs.
- 09Chased
Each finding to an owner and a date
Findings trackerThe four new findings join the tracker with due dates set by severity from the committee date: High in 90 days, Medium in 180, Low in 365. Open findings rise from 63 to 67. Reminders go out on the 7 overdue findings, the oldest 104 days late, and the tracker drafts the two extension requests.
The findings tracker never closes a finding; a validator does.
- 10Committee day
The committee decides what only it can
Chief risk officerThe pack closes the Friday before, with five agenda items and four decisions: ratify the 412 scope decisions and 298 tiers and adopt the 131-validation plan; approve the CRE default model with conditions; rule on 7 overdue findings and 2 extension requests; adopt the AI tool standard v1 with 4 control gaps to close in 30 days.