Research2026-09-12

Ivan Silajev published a paper showing TF-IDF and BM25 are exact Kullback-Leibler divergences. The work covers the BM25 variant with the plus 1 IDF correction. It also discusses the original BM25 formulation without that correction. The paper provides a unified probabilistic framework for both methods. It clarifies what TF-IDF and BM25 measure. It enables theoretical comparison with other information retrieval methods. The paper is five pages long. It was submitted to arXiv on 12 September 2026.

What it unlocks

Treating TF-IDF and BM25 as exact Kullback-Leibler divergences between probability models.

Sources

Send this to someone who needs it

Shares the story and its sources. Nothing about you.

What does this mean for your job?

This is the story as everyone gets it. Once a week we send you the version written for your role — what changed, why it matters for the work you actually do, and one thing to try. Free while we tune it.