Research2026-10-20

OpenAI researchers introduced two new metrics for AI monitorability. Pair-matched metric compares models on shared task instances to reduce bias. Post-control integration metric simulates monitor-gated rejection sampling. It estimates how often a system deploys bad outputs and how retries change this. They also derived a lower bound for intervention g-mean² to make causal attribution uncertainty explicit. The metrics address distribution mismatch and deployment risk gaps in g-mean². Pair matching isolates monitorability from capability-driven instance selection. HodgeRank ordering combines pairwise comparisons for multiple models. Synthetic experiments validate the metrics' ability to recover true monitorability orderings.

What it unlocks

Compare AI models on shared task instances and estimate deployment risk under monitor-gated rejection sampling.

Send this to someone who needs it

Shares the story and its sources. Nothing about you.

What does this mean for your job?

This is the story as everyone gets it. Once a week we send you the version written for your role — what changed, why it matters for the work you actually do, and one thing to try. Free while we tune it.