Research note

How well do the models predict tournaments specifically?

Status: Shipped (research note; no model change)Backtest date: 22 May 2026Topline + full note · 1,608 words

Topline

The shipping backtest in documentation/methodology.md reports Brier / log-loss / ECE on a single-fold 5-year holdout (2021-05-23 → 2026-05-22). That holdout is dominated by friendlies — only ~15% of the matches are major-tournament games. A reader who skims the numbers gets a Brier near 0.510 and assumes the model is that accurate on the matches it actually has to predict in June 2026.

This note answers: **what do those same metrics look like when we restrict the evaluation slice to major-t…

Full note

Standard Pass

Read the full research note

How well do the models predict tournaments specifically? runs 1,608 words. The Standard Pass unlocks every research note in full, plus the complete forecast and per-team and per-player ratings, valid through the tournament.

Get the Pass, $15

Every forecast graded against the real result, scored on 987 matches since 2014. See the scorecard.

24h money-back, no questions asked·No subscription, no auto-renewal·Access through 31 Dec 2026. See refund policy.