mMARCO: A Multilingual Version of the MS MARCO Passage Ranking Dataset
Luiz Bonifacio, Vitor Jeronymo, Hugo Queiroz Abonizio, Israel Campiotti, Marzieh Fadaee, Roberto Lotufo, Rodrigo Nogueira
Abstract
The MS MARCO ranking dataset has been widely used for training deep learning models for IR tasks, achieving considerable effectiveness on diverse zero-shot scenarios. However, this type of resource is scarce in languages other than English. In this work, we present mMARCO, a multilingual version of the MS MARCO passage ranking dataset comprising 13 languages that was created using machine translation. We evaluated mMARCO by finetuning monolingual and multilingual reranking models, as well as a multilingual dense retrieval model on this dataset. We also evaluated models finetuned using the mMAR…
Who it is from
NeuralMindautor: Roberto Lotufo (cofundador e CTO)
Other papers from the same organizations
- Structural Segmentation for Brazilian Legal Document RetrievalNeuralMind
- Legal Nugget Extraction for Granular Retrieval over Long Jurisprudential TextsNeuralMind
- Domain-Adaptive Dense Retrieval for Brazilian Legal SearchNeuralMind
- Teaching LLMs Brazilian Healthcare: Injecting Knowledge from Official Clinical GuidelinesMaritaca AI
- JUÁ -- A Benchmark for Information Retrieval in Brazilian Legal Text CollectionsNeuralMind
- Comparing Knowledge Injection Methods for LLMs in a Low-Resource RegimeMaritaca AI