DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models
Damai Dai, Chengqi Deng, Chenggang Zhao, R.x. Xu, Huazuo Gao, Deli Chen, Jiashi Li, Wangding Zeng and 9 more
Who it is from
- Nanjing Universityaffiliation declared by the authors, according to OpenAlex
- Peking Universityaffiliation declared by the authors, according to OpenAlex
Tsinghua Universityaffiliation declared by the authors, according to OpenAlex
Other papers from the same organizations
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language ModelsPeking University · 12,684 citations
- DETRs Beat YOLOs on Real-time Object DetectionBaidu · 8,096 citations
- Intern VL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic TasksChinese Academy of Sciences · 3,956 citations
- DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code IntelligencePeking University · 2,491 citations
- A Comprehensive Survey of Continual Learning: Theory, Method and ApplicationTsinghua University · 2,465 citations
- VBench: Comprehensive Benchmark Suite for Video Generative ModelsNanjing University · 2,431 citations