Research2026-09-02

Ian Barber examined a research paper on test-time training and argued the label covers two different things. The paper is titled "Test-Time Training with KV Binding Is Secretly Linear Attention". Its authors say such designs can be rewritten as a learned form of linear attention. That contradicts the usual view that these layers memorise key-value pairs while running. Barber distinguished slow weights, which are updated by ordinary training, from fast weights, produced during a single pass. The paper trains fast weights, using a matrix that does not grow with sequence length. Barber noted the fast weights reset for each new input sequence. So the approach does not deliver continual learning, in his reading.

Send this to someone who needs it

Shares the story and its sources. Nothing about you.

What does this mean for your job?

This is the story as everyone gets it. Once a week we send you the version written for your role — what changed, why it matters for the work you actually do, and one thing to try. Free while we tune it.