Noesion Radarnoesion.ai
Release2026-08-03

Microsoft published SocialReasoningBench (srbench), an open-source benchmark for evaluating the social reasoning of LLM agents in multi-party settings, released under the MIT license on GitHub. The repository ships a CLI that runs an experiment sweep (version v0.1.0) against any model exposed through an OpenAI-compatible endpoint, plus a results dashboard; it requires Python 3.11+ and uv. Reproducing Microsoft's published results uses Gemini as the counterparty model, configured via a GEMINI_API_KEY. Microsoft Research accompanied the release with a blog post framed around measuring whether AI agents act in users' best interests. At the time of capture the repository had 18 stars, 4 forks and 513 commits, with no tagged releases listed.

Send this to someone who needs it

Shares the story and its sources. Nothing about you.

What does this mean for your job?

This is the story as everyone gets it. Once a week we send you the version written for your role — what changed, why it matters for the work you actually do, and one thing to try. Free while we tune it.