paper7Atualizado em 21/11/2026 · English
← Todos os papers

Brasilidade: Measuring Brazilian Identity for Large Language Models

José Roberto Homeli da Silva, Felipe Jorge do Nascimento, Lucas Coutinho Freitas, William Alberto Cruz Castañeda, Marcellus Amadeus

Resumo

This work presents a new benchmark that aims to address the limitations of current methods for evaluating LLMs in Brazilian Portuguese. We introduced Brasilidade, an assessment methodology comprised of standardized tasks distributed across four different domains, and we are making available the tasks from its first domain, which address nuances of the language, grammar, and variations of Brazilian Portuguese. The results show that model size, by itself, does not determine performance; several medium-sized models outperformed larger models in the protocols evaluated. Specific models for Portugu…

De quem é

  • SoberanIAcuradoria: o artigo traz só a afiliação SoberanIA