mMARCO: A Multilingual Version of the MS MARCO Passage Ranking Dataset
Luiz Bonifacio, Vitor Jeronymo, Hugo Queiroz Abonizio, Israel Campiotti, Marzieh Fadaee, Roberto Lotufo, Rodrigo Nogueira
Resumo
The MS MARCO ranking dataset has been widely used for training deep learning models for IR tasks, achieving considerable effectiveness on diverse zero-shot scenarios. However, this type of resource is scarce in languages other than English. In this work, we present mMARCO, a multilingual version of the MS MARCO passage ranking dataset comprising 13 languages that was created using machine translation. We evaluated mMARCO by finetuning monolingual and multilingual reranking models, as well as a multilingual dense retrieval model on this dataset. We also evaluated models finetuned using the mMAR…
De quem é
NeuralMindautor: Roberto Lotufo (cofundador e CTO)
Outros papers das mesmas organizações
- Structural Segmentation for Brazilian Legal Document RetrievalNeuralMind
- Legal Nugget Extraction for Granular Retrieval over Long Jurisprudential TextsNeuralMind
- Domain-Adaptive Dense Retrieval for Brazilian Legal SearchNeuralMind
- Teaching LLMs Brazilian Healthcare: Injecting Knowledge from Official Clinical GuidelinesMaritaca AI
- JUÁ -- A Benchmark for Information Retrieval in Brazilian Legal Text CollectionsNeuralMind
- Comparing Knowledge Injection Methods for LLMs in a Low-Resource RegimeMaritaca AI