Standard : Evidence-Based Decision Coverage

Description

Evidence-Based Decision Coverage measures the proportion of significant decisions that are documented with their evidence basis, options considered, and reasoning — enabling review, learning, and accountability while improving decision quality over time. This measure operationalises the principle that decisions made on evidence, with documented reasoning, are systematically more durable and more learnable-from than decisions made on intuition or authority.

Documentation is not bureaucracy — it is the mechanism that allows organisations to learn from their decision history, to review the quality of their reasoning, and to hold themselves accountable for the quality of the thinking that produced consequential choices.

How to Use

What to Measure

Proportion of significant decisions with a documented decision record including: the question being decided, options considered, evidence reviewed, reasoning applied, and outcome
Proportion of documented decisions that include a pre-defined outcome metric to enable post-decision learning
Proportion of decisions reviewed in after-action or retrospective processes
Quality rating of decision documentation (does it contain sufficient evidence and reasoning to be useful for learning?)

Formula

Evidence-Based Decision Coverage = (Significant decisions with compliant documentation / Total significant decisions made) × 100

Optional:

Quality-weighted coverage: rather than binary (documented/not), rate documentation quality on a 1–4 scale and report average quality alongside coverage
Learning loop closure rate: proportion of documented decisions that were subsequently reviewed in an after-action process

Instrumentation Tips

Define a minimum documentation standard for significant decisions — what must be present in a decision record for it to count as documented
Use lightweight decision record templates (e.g. Architecture Decision Records adapted for leadership) rather than lengthy documentation requirements
Integrate documentation into the decision-making workflow — the record is created during the decision process, not after it
Review coverage rate and documentation quality in leadership governance forums quarterly
Build decision archives that are searchable and accessible, not buried in email threads or meeting notes

Benchmarks

Coverage	Interpretation
85–100%	Excellent — strong decision documentation culture; accountability and learning are well-supported
65–84%	Good — most significant decisions are documented; close gaps through process improvement
40–64%	Moderate — substantial proportion of decisions made without documentation; learning and accountability gaps present
Below 40%	Poor — decisions are largely undocumented; the organisation is flying blind and cannot learn from its decision history

Why It Matters

Undocumented decisions cannot be learned from Without a record of the evidence and reasoning that produced a decision, organisations repeat mistakes, cannot identify patterns in decision quality, and are unable to improve their decision-making processes systematically.
Documentation creates accountability without surveillance When leaders document their reasoning, they create an artefact that can be reviewed — creating a healthy form of accountability that drives more rigorous thinking before commitment.
Decision archives compound in value over time A history of documented decisions enables pattern recognition: which types of decisions tend to produce good outcomes, which evidence sources have proven reliable, and which assumptions have been consistently wrong.
Documentation surfaces hidden assumptions The act of documenting reasoning forces leaders to make their assumptions explicit — and explicit assumptions can be challenged, tested, and improved in ways that implicit ones cannot.

Best Practices

Introduce decision record templates that are brief and practical — a decision record that takes 15 minutes to complete will be used; one that takes 3 hours will not
Make decision records accessible to the team and broader organisation where appropriate — transparency in reasoning builds trust and enables better-informed follow-on decisions
Use decision records as the basis for after-action reviews — comparing what the decision anticipated with what actually occurred
Train leaders in the difference between documenting reasoning and post-hoc rationalisation — the goal is honest capture of pre-decision thinking, not justification of outcomes
Include decision documentation coverage in leadership reviews as a quality indicator alongside decision outcomes

Common Pitfalls

Creating documentation requirements so burdensome that they are routinely bypassed for all but the most formal decisions
Documenting decisions after the outcome is known rather than at the time of the decision — creating post-hoc rationalisation rather than genuine evidence capture
Treating coverage as sufficient without reviewing documentation quality — a decision record that documents no evidence or reasoning is not useful
Storing decision records in inaccessible locations that prevent them from being used for learning or accountability

Signals of Success

Leaders proactively reference prior decision records when facing analogous decisions, demonstrating that the archive is being used
After-action reviews consistently have access to the original decision documentation, enabling honest comparison of intent and outcome
Decision quality improves measurably over time, reflecting that documented reasoning is creating a learning loop
The organisation can quickly reconstruct the reasoning behind historical decisions when context changes and earlier choices need to be revisited

[[Decision Reversal Rate]]
[[After-Action Review Completion Rate]]
[[Decision Lead Time]]

Aligned Industry Research

Thinking in Bets (Annie Duke, 2018) Duke's work on decision quality demonstrates that documenting pre-decision reasoning and probability estimates — before outcomes are known — is the most reliable mechanism for improving decision-making over time and separating skill from luck.
Architecture Decision Records (Michael Nygard, 2011) Nygard's influential approach to lightweight decision documentation — capturing context, decision, and consequences in brief, accessible records — provides a practical model for implementing evidence-based decision coverage without bureaucratic overhead.