Research2026-08-03

Epoch AI published a public GitHub repository for MirrorCode, a coding benchmark built on the UK AI Safety Institute's Inspect framework. The repository contains the evaluation harness and the public task definitions, sufficient to run the benchmark, while the private tasks are withheld. Prebuilt container images are published to ghcr.io/epoch-research/mirrorcode, and the maintainers note that the longest run in the MirrorCode paper took 19 days for a single sample, making cloud execution the recommended approach; paper results were produced using METR's Hawk. The code is MIT licensed, includes both MirrorCode and BIG-Bench canary strings to limit training-data contamination, and the repository had 59 stars, 10 forks and 28 commits at publication.

Send this to someone who needs it

Shares the story and its sources. Nothing about you.

What does this mean for your job?

This is the story as everyone gets it. Once a week we send you the version written for your role — what changed, why it matters for the work you actually do, and one thing to try. Free while we tune it.