paper7Atualizado em 21/11/2026 · English
← Todos os papers

BLUEX: A benchmark based on Brazilian Leading Universities Entrance eXams

Thales Sales Almeida, Thiago Laitz, Giovana K. Bonás, Rodrigo Nogueira

Resumo

One common trend in recent studies of language models (LMs) is the use of standardized tests for evaluation. However, despite being the fifth most spoken language worldwide, few such evaluations have been conducted in Portuguese. This is mainly due to the lack of high-quality datasets available to the community for carrying out evaluations in Portuguese. To address this gap, we introduce the Brazilian Leading Universities Entrance eXams (BLUEX), a dataset of entrance exams from the two leading universities in Brazil: UNICAMP and USP. The dataset includes annotated metadata for evaluating the p…

De quem é

Outros papers das mesmas organizações