JUÁ -- A Benchmark for Information Retrieval in Brazilian Legal Text Collections
Jayr Pereira, Leandro Fernandes, Erick de Brito, Roberto Lotufo, Luiz Bonifacio
Abstract
Legal information retrieval in Portuguese remains difficult to evaluate systematically because available datasets differ widely in document type, query style, and relevance definition. We present JUÁ, a public benchmark for Brazilian legal retrieval designed to support more reproducible and comparable evaluation across heterogeneous legal collections. More broadly, JUÁ is intended not only as a benchmark, but as a continuous evaluation infrastructure for Brazilian legal IR, combining shared protocols, common ranking metrics, fixed splits when applicable, and a public leaderboard. The benchmark…
Who it is from
NeuralMindautor: Roberto Lotufo (cofundador e CTO)
Other papers from the same organizations
- Structural Segmentation for Brazilian Legal Document RetrievalNeuralMind
- Legal Nugget Extraction for Granular Retrieval over Long Jurisprudential TextsNeuralMind
- Domain-Adaptive Dense Retrieval for Brazilian Legal SearchNeuralMind
- Teaching LLMs Brazilian Healthcare: Injecting Knowledge from Official Clinical GuidelinesMaritaca AI
- Comparing Knowledge Injection Methods for LLMs in a Low-Resource RegimeMaritaca AI
- BR-TaxQA-R: A Dataset for Question Answering with References for Brazilian Personal Income Tax Law, including case lawNeuralMind