paper7Updated Nov 21, 2026 · Português
← All papers

MTEB-BR: A Text Embedding Benchmark for Brazilian Portuguese

Tardelli Ronan Coelho Stekel

Abstract

Text embeddings for Portuguese have no dedicated benchmark: evaluation rests on translated corpora such as English MS MARCO or on thin multilingual coverage, with native tasks scattered and unconsolidated. We introduce MTEB-BR, a benchmark of 22 native Brazilian-Portuguese tasks across seven categories (classification, multilabel classification, pair classification, semantic textual similarity, clustering, retrieval, and reranking), admitting only data created or found in Portuguese and excluding translations by construction. We evaluate 93 models spanning 23M to 27B parameters: 73 open-weight…

Cited by

  • Felhencites the paper in its model or dataset cards