Per-Agent Calibration Scores: Spain vs Belgium

Result: ESP 2-1 BEL (90') β€” FabiΓ‘n Ruiz 30', De Ketelaere 41' (BEL), Merino 88'. ESP won in regulation, advance to SF vs France.
Auto-scored baseline: winner_90 + advance + scoreline β†’ mm3 25/50 | g4 45/50 | g5 45/50. who_scores 0/20 all (no #1 or top-3 pick scored for any agent).

πŸ†• g4 = Kimi K2.7 Code (ollama/kimi-k2.7-code:cloud) β€” DEBUT MATCH. This is the first data point for the new g4 model (replaced glm-5-turbo Jul 9). The 24-match glm-5-turbo era record (avg 58/80, Band C) is now closed; Kimi starts a fresh calibration record here. Result: g4 = A (90%) β€” the highest of the three, driven by being the ONLY agent to correctly project Spain's possession dominance (~62%) instead of applying the R32-5c flip cap. One match is a small sample; do not over-extrapolate.

Headline calibration learning: All three correctly picked ESP to advance and win in 90', and all three staked the right model-breakers (no GK change, Oliver lenient, F11 neutralized, BEL Plan-A restoration, Courtois open-shape diluted). The spread (mm3 47 / g5 67 / g4 72, a 25pt gap) is driven by two genuine reasoning differences: (1) the scoreline modal (mm3 draw-hedged 1-1 β†’ 0/25; g4/g5 ESP 1-0 with 2-1 in-list β†’ 20/25), and (2) the possession projection (g4 dominance βœ… 5/5; mm3/g5 flip-cap ❌ 0/5). Both are honest signals, not noise.


mm3 (MiniMax-M3)

Findings: 13/20

# Finding staked Direction Magnitude Score Note
1 ESP 0 GA compound = load-bearing edge (+5pt momentum cap); SimΓ³n "clean-sheet form real but Γ—0.25 weight β€” untested vs sustained pressure" βœ… ❌ 3 Defensive edge held (ESP won, best block at the WC), but the 0 GA magnitude broke at 41' (De Ketelaere). The "untested vs sustained pressure" caveat was prescient β€” exactly what materialized. Direction right, magnitude wrong.
2 R32-5f: Courtois confirmed-form but in OPEN 4-2-3-1 (not low block) β†’ draw-forcing muted to Γ—0.25-0.3 (not Γ—0.5-0.6) βœ… βœ… 5 Courtois conceded 2 from ESP's ~2.0 xG / 17 shots. Hot-GK diluted in open shape validated (3rd QF after Bounou FRA-MAR). Exact call.
3 F11 weather NEUTRALIZED β€” 22.8Β°C, fixed ETFE canopy, no heat penalty βœ… βœ… 5 Brief confirms 22.8Β°C, canopy, F11 neutral. Clean.
4 F8/R32-5c possession flip cap β€” "Cap ESP possession at 48-52% per R32-5c" (favorite_possession=52) ❌ ❌ 0 Actual ESP 67.8% / BEL 32.2% β€” NO flip; classic possession-dominant win. Brief: "the KO-favorite possession-flip pattern did NOT fire here." Note: a defensible ~50% default that lost the coin-flip, not a reasoning failure β€” but as staked (cap applies), it did not apply.

(Additional staked findings, not in top 4: F12 conservation 0% = 5/5 βœ… both desperate, no conservation; BEL bench cavalry (Lukaku 14.3% sub-impact as BEL's "main path to victory") = 3/5 β€” direction right (it's genuinely BEL's edge) but magnitude wrong, Lukaku 0 goals, cavalry deployed-but-ineffective, brief learning #5 "bench is a threat, not a guarantee.")

Model-breaking: 9/10

All material model-breakers caught. GKs confirmed pre-match (SimΓ³n + Courtois, no change) βœ…. Oliver behaved exactly as projected: 4 yellows (projected 3-4 βœ…), 0 pens (projected 10-15% β†’ 0 βœ…), 0 reds βœ…. The ESP FabiΓ‘n-Ruiz-for-Pedri rotation was anticipated AND FabiΓ‘n Ruiz was listed at 6% in Who Scores (he scored the opener). The 🚨 BEL Plan-A restoration (KDB+Dokuβ†’START, 4-3-3β†’4-2-3-1) was explicitly called ("USA low-block was a surprise; QF = Plan A 4-2-3-1"). Weather + formation (both 4-2-3-1) correct. Only soft miss: Merino as the sub-scorer (mm3 had him in the bench list but not weighted). Deduction is conservative β€” no agent is perfect; the 0 GA prior was treated as near-immutable (mm3 at least caveated it).

TOTAL: 47/80 β†’ 59% β†’ Band D

(auto 25 + findings 13 + MB 9. Slipped to D on two genuine misses: the 1-1 draw-hedged modal cost the auto scoreline, and the possession flip cap cost a finding. The draw band itself β€” 30% β€” was a reasonable QF hedge, not docked here; the modal-winner was right (38% ESP win βœ…).)


g4 (Kimi K2.7 Code β€” DEBUT)

Findings: 18/20

# Finding staked Direction Magnitude Score Note
1 ESP 0 GA compound = "the single biggest edge," +5pt (confirmed-form Γ—0.5-0.6) βœ… ❌ 3 Edge held (ESP won), clean sheet broke at 41'. Direction right, magnitude wrong. g4 treated it as near-immutable without mm3's "untested" caveat, but the directional call was sound.
2 ESP possession DOMINANT β€” "Spain will dominate the ball (projected ~62%)" + F8 flip "Already priced into WDM; marginal" (0% delta, favorite_possession=62) βœ… βœ… 5 KEY DIFFERENTIATOR. Actual 67.8%. g4 was the ONLY agent to reject the R32-5c flip cap and project dominance β€” and it held. Worth highlighting as the strongest single analytical call of the match.
3 R32-5f: Courtois "elite reputation but barely tested" / "draw-producer compound does not fire" βœ… βœ… 5 Courtois conceded 2 in open 4-2-3-1. Correctly declined to treat him as a draw-forcer.
4 F11 weather neutralized (22.8Β°C, ETFE canopy) βœ… βœ… 5 Confirmed.

(Additional staked findings, not in top 4: F12 conservation 0% = 5/5 βœ…; BEL bench cavalry (Lukaku, "the live swing factor") = 3/5 β€” deployed but didn't fire; F22 blowout-exclusion βœ… β€” no 4+ margin; R32-4 draw band 24% reasonable.)

Model-breaking: 9/10

All material model-breakers caught. GKs confirmed βœ…. Oliver 4Y/0 pens/0R matches the 3-4Y/10-15%-pen projection βœ…. FabiΓ‘n-Ruiz rotation anticipated. 🚨 BEL Plan-A restoration (KDB+Doku START, 4-2-3-1) explicitly called ("Belgium at full attacking power β€” KDB + Doku RESTORED"). Weather + formation correct. Weaker than mm3/g5 only on scorer depth: g4's TOML lists just #1 per side (Yamal 22 / De Bruyne 16) and missed both De Ketelaere and Merino as secondary threats β€” but that is a who-scores issue (scored separately, 0/20), not a model-breaking-input miss. On the pure model-breaking rubric (GK/ref/lineup/weather/formation) g4 caught everything.

TOTAL: 72/80 β†’ 90% β†’ Band A

(auto 45 + findings 18 + MB 9. Strong debut. The A is driven by: ESP 1-0 modal (right winner) with 2-1 as the #2 scoreline at 14% β†’ 20/25 partial; the correct possession-dominance projection (+5 findings vs mm3/g5's flip-cap miss); and clean model-breaking. ⚠️ ONE data point β€” do not anchor the Kimi record on a single QF. The headline to watch: g4's willingness to buck the validated-but-~50% R32-5c flip default.)


g5 (zai/glm-5.2)

Findings: 13/20

# Finding staked Direction Magnitude Score Note
1 ESP 0 GA compound = "the load-bearing factor," +5pt deviation cap βœ… ❌ 3 Edge held (ESP won), clean sheet broke at 41'. g5 framed 0 GA as "the single reason ESP edge a near-even QF" β€” direction right, clean-sheet magnitude wrong.
2 R32-5f: "Courtois = reputation-only (Γ—0.25), NOT a draw-forcer" β€” cleanest explicit caveat of the three βœ… βœ… 5 Courtois conceded 2 in open 4-2-3-1. Most forcefully staked of the three.
3 F11 weather neutralized (22.8Β°C, canopy) βœ… βœ… 5 Confirmed.
4 F8/R32-5c possession flip cap β€” "Cap ESP KO possession ~52%; BEL's Plan A competes for the ball" (favorite_possession=52) ❌ ❌ 0 Actual 67.8% β€” NO flip, ESP dominated. Same defensible-but-lost coin-flip as mm3. Brief: flip "did NOT fire here."

(Additional staked findings, not in top 4: F12 conservation 0% = 5/5 βœ…; BEL bench cavalry (Lukaku) = 3/5 β€” didn't fire. g5's tighter draw band (23% vs mm3's 30%) and cleaner Courtois caveat were sound, but these don't offset the shared possession-flip miss.)

Model-breaking: 9/10

All material model-breakers caught. GKs βœ…. Oliver 4Y/0 pens/0R matches projection βœ…. FabiΓ‘n-Ruiz rotation anticipated. 🚨 BEL Plan-A restoration caught. Best scorer-anticipation depth of the three: De Ketelaere listed at 10% (#5) and Merino at 8% (#4) β€” both actual scorers were in g5's list, just outside the auto-scored top-3. Courtois caveat the cleanest. Weather + formation correct.

TOTAL: 67/80 β†’ 84% β†’ Band B

(auto 45 + findings 13 + MB 9. Solid B. g5 edges mm3 on the auto scoreline (ESP 1-0 modal β†’ partial 20/25 vs mm3's 1-1 draw modal β†’ 0/25) but shares the possession-flip finding miss, capping findings at 13. The Courtois caveat + secondary-scorer depth (De Ketelaere/Merino both listed) were g5's best work.)


Cross-agent notes


Scores Summary (machine-readable β€” DO NOT EDIT)

{
  "match": "esp-vs-bel",
  "result": { "score90": "2-1", "final": "2-1", "outcome90": "win", "advance": "a", "route": "90" },
  "agents": {
    "mm3": { "auto": 25, "winner_90": 15, "advance": 10, "scoreline": 0, "findings": 13, "model_breaking": 9, "total": 47, "pct": 59, "band": "D", "who_scores": 0 },
    "g4":  { "auto": 45, "winner_90": 15, "advance": 10, "scoreline": 20, "findings": 18, "model_breaking": 9, "total": 72, "pct": 90, "band": "A", "who_scores": 0 },
    "g5":  { "auto": 45, "winner_90": 15, "advance": 10, "scoreline": 20, "findings": 13, "model_breaking": 9, "total": 67, "pct": 84, "band": "B", "who_scores": 0 }
  }
}