paper7Updated Nov 21, 2026 · Português
← All papers

Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free

Zihan Qiu, Zekun Wang, Bo Zheng, Zeyu Huang, Kaiyue Wen, Songlin Yang, Rui Men, Le Yu and 5 more

Who it is from

Other papers from the same organizations