GlórIA -- A Generative and Open Large Language Model for Portuguese
Ricardo Lopes, João Magalhães, David Semedo
Resumo
Significant strides have been made in natural language tasks, largely attributed to the emergence of powerful large language models (LLMs). These models, pre-trained on extensive and diverse corpora, have become increasingly capable of comprehending the intricacies of language. Despite the abundance of LLMs for many high-resource languages, the availability of such models remains limited for European Portuguese. We introduce GlórIA, a robust European Portuguese decoder LLM. To pre-train GlórIA, we assembled a comprehensive PT-PT text corpus comprising 35 billion tokens from various sources. We…
Citado por
- Polygl0tcita o paper na ficha dos modelos ou datasets