Microsoft Research released EvoLib, the official code for the paper "Test-Time Learning with an Evolving Library" (arXiv:2605.14477) by Weijia Xu, Alessandro Sordoni, Chandan Singh, Zelalem Gero, Michel Galley, Xingdi Yuan and Jianfeng Gao. EvoLib lets black-box LLMs accumulate and reuse knowledge across problem instances without parameter updates or ground-truth supervision, maintaining a library of modular skills and reflective insights extracted from the model's own inference trajectories, weighted by Information Gain and Future IG and periodically consolidated. Reported cost-performance curves show higher accuracy than Best-of-N, RSA and Dynamic Cheatsheet on BigCodeBench Hard (GPT-4o), LiveCodeBench v6 Hard and HMMT 2025-2026 (o4-mini), plus AgentBoard ScienceWorld/PDDL agentic tasks. The MIT-licensed release uses Azure OpenAI endpoints and is stated to be for research purposes only, not recommended for commercial or high-risk use.
- github.com2026-08-03