SpecInfer: Accelerating Large Language Model Serving with Tree-based Speculative Inference and Verification
Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, Xinhao Cheng, Zeyu Wang, Zhengxin Zhang, Rae Ying Yee Wong, Alan Zhu e mais 7
De quem é
- Carnegie Mellon Universityafiliação declarada pelos autores, segundo o OpenAlex
- Shanghai Jiao Tong Universityafiliação declarada pelos autores, segundo o OpenAlex
- University of California San Diegoafiliação declarada pelos autores, segundo o OpenAlex
Outros papers das mesmas organizações
- VM-UNet: Vision Mamba UNet for Medical Image SegmentationShanghai Jiao Tong University · 1.481 citações
- Explainability for Large Language Models: A SurveyBaidu · 1.443 citações
- Medical SAM adapter: Adapting segment anything model for medical image segmentationAgency for Science, Technology and Research · 1.361 citações
- A comprehensive survey on pretrained foundation models: a history from BERT to ChatGPTBeihang University · 1.211 citações
- Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?Shanghai Artificial Intelligence Laboratory · 1.186 citações
- Multimodal Chain-of-Thought Reasoning in Language ModelsShanghai Jiao Tong University · 1.170 citações