Research2026-09-16

Researchers proposed the Infinite-Parameter LLM architecture. A compact hypernetwork turns live data into a low-rank modulation of a shared base network. Weights are generated from live data rather than stored in a fixed bank. The model carries a Bayesian belief over the generator’s latent code and updates it online. Effective weights are re-derived from that evolving belief as the session proceeds. Stored footprint stays fixed while the weights the model can compile are effectively infinite. Knowledge and behavior supplied at run time are carried in the weights rather than the prompt. This is amortized in compute, frees the context window, persists across turns, and can generalize better than in-context use. The paper specifies an evaluation protocol testing this against in-context learning and retrieval.

What changed

Models learn only from static pretraining data and cannot update weights from live interaction.

What it unlocks

Models can now learn from live interaction by writing it into their weights instead of the prompt.

Sources

Send this to someone who needs it

Shares the story and its sources. Nothing about you.

What does this mean for your job?

This is the story as everyone gets it. Once a week we send you the version written for your role — what changed, why it matters for the work you actually do, and one thing to try. Free while we tune it.