Yes, someone outside the team
No rule fires on this answer, for a model that influences a decision reaching a consumer. A reviewer moves on.
Free snapshot · question 5 of 9
Has anyone outside the team that built it validated your highest-risk model?
Independent means the review was carried out by people who did not build the model. Your own data scientists testing a model they trained does not count as independent validation, because they are checking their own work. A separate internal team with no stake in the model, your internal audit function, or an outside firm all count.
Why a carrier asks
What the answer decides.
A reviewer is not evaluating how accurate your model is here. They are checking whether anyone other than its authors has examined it, which is the difference between a model your company trusts and a model your company has checked.
What the engine does with each answer
Derived, not written.
Each outcome below was produced by running Vaulith's rules engine on that answer, for a model that influences a decision reaching a consumer. The same rules run in the paid assessment, on your whole estate, with the arithmetic shown.
No, only the team that built it
Will escalateR-VALIDATION
Independent validation missing for the system you described
A high-risk consumer-impacting model with no independent validation reads as an unmanaged model, however well it performs. The reviewer is not evaluating your accuracy, they are evaluating whether anyone other than the people who built it has checked it.
The examination items it touches
Where this lands in the questionnaire.
- AIS-3.7 Describe independent validation performed on each high-risk model, including who performed it and when.NAIC AI model bulletin §4.3, validation and testing
- AIS-2.3 Describe the risk classification applied to each AI system and the criteria that place a system in the highest tier.NAIC AI Systems Evaluation Tool, high-risk model identification
- AIS-2.4 Provide current model documentation for each high-risk system, reflecting the version now in production.NAIC AI Systems Evaluation Tool, model documentation
- AIS-5.3 Provide the most recent testing results for each consumer-impacting system.NAIC AI model bulletin §4.4
Answer it about your own estate.
The snapshot asks this and eight more, in about ninety seconds, with nothing leaving your browser, and returns every finding with its reasoning and its remediation.