EAGLE-2: Faster Inference of Language Models with Dynamic Draft Trees
Yuhui Li, Fangyun Wei, Chao Zhang, Hongyang Zhang
Who it is from
University of Waterlooaffiliation declared by the authors, according to OpenAlex- Vector Instituteaffiliation declared by the authors, according to OpenAlex
Other papers from the same organizations
- AI models collapse when trained on recursively generated dataUniversity of Toronto · 2,565 citations
- $τ^2$-Bench: Evaluating Conversational Agents in a Dual-Control EnvironmentUniversity of Toronto · 862 citations
- The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree SearchUniversity of British Columbia · 734 citations
- Unleashing the Power of Edge-Cloud Generative AI in Mobile Networks: A Survey of AIGC ServicesKyung Hee University · 572 citations
- Towards end-to-end automation of AI researchUniversity of British Columbia · 551 citations
- Fine-Tuning LLaMA for Multi-Stage Text RetrievalMicrosoft Research Asia · 540 citations