Home/Soccer Analytics/Decision Process Auditing

Decision Process Auditing

Data InfrastructureLevel 3 — Advanced

What It Is

Systematic logging and retrospective evaluation of the reasoning chain behind each football operations decision — including rejected options and the criteria used at each fork — to distinguish process quality from outcome quality. A good decision that produces a bad outcome should not be penalized; a bad decision that produces a good outcome should not be rewarded. This is the "decision scientist" role from big tech (Meta/Google) applied to football.

Correct Execution

For each major decision (signing, tactical change, lineup): (1) log the options considered, (2) log the criteria and data used, (3) log what was rejected and why, (4) log the expected outcome. Retrospectively evaluate: was the process sound even if the outcome was bad? The compounding effect of consistently good processes produces structural optionality for future decisions.

Diagnostic Tree

Edges

🔑 Hidden Causal Lever

Good Decisions That Produce Bad Outcomes Get Punished — Destroying Future Decision Quality

Without systematic decision process logging, organizations evaluate on outcomes, not process quality. A signing that works out masks a flawed process that will fail next time. A signing that fails despite a sound process gets punished, discouraging the correct approach. The compounding effect of consistently good processes produces structural optionality, but only if the organization evaluates process separately from outcome.

What most people do
Run post-mortems on outcomes (did the signing work?) rather than process (did we consider the right options with the right data?). Good outcomes validate the process; bad outcomes condemn it.
What the best do
Log every major decision with: options considered, criteria used, rejected alternatives and why, expected outcome. Retrospectively evaluate whether the process was sound regardless of outcome. Build institutional memory of decision quality that compounds over time.
Why it's an edge: This is the "decision scientist" role from big tech (Meta/Google) applied to football. Clubs that separate process from outcome make better decisions over time because they're not punishing correct-but-unlucky choices or rewarding incorrect-but-lucky ones.
How to exploit: Implement a decision log for all recruitment, tactical, and lineup decisions. Review quarterly: was the process sound? Track the ratio of sound-process decisions to outcomes. Over 3+ years, the process-outcome correlation will improve because bad processes get identified before they produce catastrophic outcomes.
Ravi Ramineni, Source Football, StatsBomb Conference, 2023-10-26. Decision scientist role from big tech applied to football operations.
💎 Elite-Only Behavior

The Gap Between What a Player Chose and What Was Available Is the Purest Skill Signal

When EPV of the best available action is known, comparing it to the EPV of the player's chosen action reveals decision quality independent of execution. A player who consistently chooses actions within 5% of the optimal available action has elite vision — even if their execution sometimes fails. A player who chooses actions 30% below optimal is making poor decisions regardless of their completion rate. This "decision gap" metric is the closest available proxy for football intelligence.

What most people do
Evaluate decisions by outcomes (did the pass complete? did the shot score?).
What the best do
Evaluate decisions by optimality gap: how close was the chosen action to the best available action? A bad decision that succeeds is still a bad decision. A good decision that fails is still a good decision.
Why it's an edge: Decision quality is the most stable and least coachable component of player performance. A player with a small optimality gap will perform well across systems and contexts because they consistently identify the highest-value action. This is the closest data gets to measuring "football IQ."
How to exploit: Compute per-player optimality gap from EPV option analysis. Use as a primary filter in recruitment — it's system-independent and predicts adaptation to new teams better than any on-ball metric.
Javier Fernandez, FC Barcelona, 2019-10-22. EPV-based decision quality as the core of the option-aware evaluation framework.

Sources

  • Ravi Ramineni, Source Football, StatsBomb Conference 2023, YouTube, 2023-10-26