paper7Atualizado em 21/11/2026 · English
← Todos os papers

InRanker: Distilled Rankers for Zero-shot Information Retrieval

Thiago Laitz, Konstantinos Papakostas, Roberto Lotufo, Rodrigo Nogueira

Resumo

Despite multi-billion parameter neural rankers being common components of state-of-the-art information retrieval pipelines, they are rarely used in production due to the enormous amount of compute required for inference. In this work, we propose a new method for distilling large rankers into their smaller versions focusing on out-of-domain effectiveness. We introduce InRanker, a version of monoT5 distilled from monoT5-3B with increased effectiveness on out-of-domain scenarios. Our key insight is to use language models and rerankers to generate as much as possible synthetic "in-domain" training…

De quem é

Outros papers das mesmas organizações