Evidence-led executive learning · reviewed August 2026
Annotated evidence sufficiency audit
Fictional example: extracting renewal dates from approved supplier-contract templates.
| Field | Exemplar entry | Why it is decision-quality |
|---|---|---|
| Intended use | Propose renewal date, notice period and clause citation for administrator verification. No automatic calendar or supplier action. | Limits the consequential action. |
| Data fitness | Current executed contracts across three approved templates; handwritten amendments and non-English documents mapped as excluded segments. | Makes coverage and missing populations visible. |
| Task set | 120 unseen documents stratified by template and age, plus 20 challenge cases with conflicting dates, missing clauses or scans. | Combines realistic prevalence with deliberate failure probes. |
| Measures | Exact-field result by field/template; valid clause support; every missed notice period; reviewer correction time. | Separates average performance from consequential errors. |
| Gate | Stop for an unflagged missed notice date; restrict an unsupported template; proceed only after field and citation thresholds pass independently. | Threshold follows consequence and exists before results. |
| Residual uncertainty | Test does not establish performance on amendments, new templates, other jurisdictions or automatic actions. | Prevents evidence from being promoted outside its boundary. |
Weak counterexample
“It was 95% accurate on 20 contracts.” No field definition, sample design, template segments, citation check, material-error review or operating boundary is visible.