Research2026-08-06

Epoch AI published Mystery Game Puzzles, a benchmark of 100 mid-game positions from a puzzle-oriented variant of an undisclosed well-known game, in which models must select the single best next move. The setup mirrors Epoch's existing Chess Puzzles benchmark, but the game's identity is withheld to reduce the risk of benchmark-specific preparation by model developers. Puzzles were generated programmatically by sampling random games, rolling forward to mid-game states, and filtering to states with a single best move. Models receive the state as text in a minimal agent scaffold and submit a move through a tool; submissions are normalized to the game's standard notation, illegal moves are marked incorrect, and unextractable responses are recorded as unanswered. Epoch is not publishing the prompt, example positions, or model transcripts.

Send this to someone who needs it

Shares the story and its sources. Nothing about you.

What does this mean for your job?

This is the story as everyone gets it. Once a week we send you the version written for your role — what changed, why it matters for the work you actually do, and one thing to try. Free while we tune it.