VaulithNine questions, free
The canon · Inventory · AIS-2.4

Provide current model documentation for each high-risk system, reflecting the version now in production.

This is one of the twenty-five questions a carrier reviewer sends a vendor, in the words an examiner uses. Below it: the answers that make a reviewer stop on this item, derived by running Vaulith's rules engine on an estate that gets everything wrong, and the free questions that reach it.

What stops a reviewer here

3 findings reach this item.

Will escalateR-PROVENANCE · degrades this item

No training-data provenance for MDL-001

The training corpus is described in engineering documentation but has never been approved as a record. Because the model is consumer-impacting, it is the one an examiner is most likely to name, and the gap sits on exactly that model.

To fix: Produce a provenance record covering sources, date range, volume, de-identification step, and approval.

Will escalateR-MISSING-EV-GONE · blocks this item

Validation report not provided

1 response depend on an artifact that does not exist. An answer with nothing behind it is an assertion, and a reviewer under time pressure treats an assertion as an open question.

To fix: Produce the artifact, or withdraw the claims that rest on it.

Will be questionedR-STALE-CARD-MDL-001 · blocks this item

MDL-001 model card predates the current production model

The card was approved 2025-01-15 and the model was retrained 2026-06-01, 17 months later. The content may be strong; the date is the problem. A reviewer cannot tell whether the document describes what is running now, and that question costs them four seconds to ask and costs you a week to answer once the review is already running.

To fix: Compare the approved card against the model that is running today, write down what changed, and have the new version approved.

How it is scored

Credit per verdict, times the weight.

A standard item carries weight 2. A pass earns 1.00 of it, a questioned answer 0.60, an escalated one 0.20 and a stop 0.00. An unanswered item earns nothing and still takes the citation penalty, so a profile cannot be improved by leaving an inconvenient question blank. The whole arithmetic is shown on the homepage and in every assessment.

Try it in ninety seconds

The free snapshot asks about this.