Perplexity introduced Joint On-policy Learning and Teaching. It trains one model as both teacher and student. The teacher uses privileged information to guide the student. The student learns from dense feedback instead of sparse rewards. The teacher adapts its guidance to the student’s current ability. The method improves performance and training efficiency. It works on math, coding and agentic tasks. A paper describes the approach in detail.
What it unlocks
A single model can act as both teacher and student to improve reasoning and agentic performance.
What you need to act on it
- a language model trained for reasoning or agentic tasks
Sources