Every model here earned its status.
Model claims are easy to inflate and hard to audit — so we keep a registry that shows production models next to the entries that never earned the label, and a changelog that records the corrections, not just the wins.
One model = one jurisdiction × one case type × one prediction target. The entries that stay experimental, stubbed awaiting sufficient data, or recorded as failed are not overhead — they are the gate working. Status changes only through the same verification protocol that governs every published claim.
Prediction infrastructure that never corrects itself is not being measured. These are the material governance events on the fleet — including the ones where we found our own numbers wanting and withdrew them.
After the retrain, the production fleet stands at 10,470 predictive models, each cleared individually through temporal-holdout and calibration review. National-scope models joined the fleet only where they outperformed the narrower models beside them.
Federal civil models were retrained on labels taken directly from the court-recorded manner of termination, so every target describes what the record states: how a case ended and how long it took. Promotion now also requires a unique model signature, so one model is counted once. Every retrained model was re-cleared through the same gates before returning to production.
A fleet-wide temporal-holdout review identified a small set of production models performing below chance on the most recent evaluation window. All were moved back to experimental status pending label and evaluation audit, and the production count was reduced accordingly.
An internal audit found a previously computed fleet-level calibration summary had been evaluated on an unrepresentative sample. The figure was withdrawn from every surface rather than corrected in place, and per-model calibration review continues under the standard gates.
The primary corpus was deduplicated on a composite source key after cross-source identifier collisions were found, and the unique count was verified by a gated row-count check before the production data was swapped. The pre-deduplication file was archived, not deleted.
A provenance review found a small model family whose training data could not be traced to verifiable source records. The family was reverted to experimental status and its previously published metrics were withdrawn.
Every production model was retrained exclusively on real filed records.
Under NDA: walk the registry itself — model entries, training windows, holdout results, version history, status transitions. What this page says reconciles to that file.
A working session with the team on pipeline, gates, and evaluation protocol. Bring your hardest statistician.
The strongest test: we score your historical matters with known outcomes and you measure the models against what actually happened. Your data, your baseline.
Criterica Intelligence Research. (2026). The Model Registry and Public Changelog (Model Card MC-001, version 1.0). Criterica. https://critericaintelligence.com/registry
@misc{criterica_mc001_2026,
author = {{Criterica Intelligence Research}},
title = {The Model Registry and Public Changelog},
publisher = {Criterica},
howpublished = {Model Card},
number = {MC-001},
year = {2026},
month = oct,
note = {Version 1.0},
url = {https://critericaintelligence.com/registry}
}DOI: pending
Next step
See what your book is worth before you commit capital.
Describe the book. After qualification you receive a written report, a per-matter schedule and a review session.
Request an assessmentRelated reading
Need funding for a case, a firm or a book? Criterica Capital