VaulithNine questions, free
The canon · Inventory · AIS-2.4

Provide current model documentation for each high-risk system, reflecting the version now in production.

This is one of the twenty-five questions a carrier reviewer sends a vendor, in the words an examiner uses. Below it: the answers that make a reviewer stop on this item, derived by running Vaulith's rules engine on an estate that gets everything wrong, and the free questions that reach it.

What stops a reviewer here

3 findings reach this item.

Will escalateR-PROVENANCE-PROVIDER · degrades this item

No approved record of the provider model behind Claims triage (MDL-001)

Claims triage (MDL-001) calls a third-party model as it is, so the training data is the provider's, and the record a reviewer needs is different: which model, which version, the provider's own documentation of its data, and what your product adds to it. Because the model reaches a consumer, a reviewer who cannot find that record cannot tell whether the provider's data practices were ever looked at before the model touched insurer data.

To fix: Record the provider's published model documentation by name, version and date, together with the data your product adds to it, and have that one page approved. The provider's documentation is the provenance record; your page is the evidence that somebody read it.

Will escalateR-MISSING-EV-GONE · blocks this item

Validation report not provided

1 response depends on an artifact that does not exist. An answer with nothing behind it is an assertion, and a reviewer under time pressure treats an assertion as an open question.

To fix: Produce the artifact, or withdraw the claims that rest on it.

Will be questionedR-STALE-CARD-MDL-001 · blocks this item

Claims triage (MDL-001) model card predates the current production model

The card was approved 2025-01-15 and the model was retrained 2026-06-01, 17 months later. The content may be strong; the date is the problem. A reviewer cannot tell whether the document describes what is running now, and that question costs them four seconds to ask and costs you a week to answer once the review is already running.

To fix: Compare the approved card against the model that is running today, write down what changed, and have the new version approved.

How it is scored

Credit per verdict, times the weight.

A standard item carries weight 2. A pass earns 1.00 of it, a questioned answer 0.60, an escalated one 0.20 and a stop 0.00. An unanswered item earns nothing and still takes the citation penalty, so a profile cannot be improved by leaving an inconvenient question blank. The whole arithmetic is shown on the homepage and in every assessment.

Try it in ninety seconds

The free snapshot asks about this.