Research2026-10-20

Christopher Temt invites disciplines outside AI to engage in evaluation. He borrows a principle from art: the measure must predate what it measures. His project feeds texts to AIs and records their answers verbatim with name and date. He then compares these answers against a fixed measure set before any questions were asked. Labs currently run evaluations internally at high cost. His method runs externally on public models. Anyone can replicate it with any AI they choose. It is a small practice, not a formal benchmark. Its key contribution is preventing goalpost-moving once answers are recorded.

What it unlocks

Evaluating AI outputs against a fixed, pre-defined measure that cannot be altered after answers are recorded.

Send this to someone who needs it

Shares the story and its sources. Nothing about you.

What does this mean for your job?

This is the story as everyone gets it. Once a week we send you the version written for your role — what changed, why it matters for the work you actually do, and one thing to try. Free while we tune it.