paper7Updated Nov 21, 2026 · Português
← All papers

InRanker: Distilled Rankers for Zero-shot Information Retrieval

Thiago Laitz, Konstantinos Papakostas, Roberto Lotufo, Rodrigo Nogueira

Abstract

Despite multi-billion parameter neural rankers being common components of state-of-the-art information retrieval pipelines, they are rarely used in production due to the enormous amount of compute required for inference. In this work, we propose a new method for distilling large rankers into their smaller versions focusing on out-of-domain effectiveness. We introduce InRanker, a version of monoT5 distilled from monoT5-3B with increased effectiveness on out-of-domain scenarios. Our key insight is to use language models and rerankers to generate as much as possible synthetic "in-domain" training…

Who it is from

Other papers from the same organizations