Splitwise: Efficient Generative LLM Inference Using Phase Splitting
Pratyush Patel, Esha Choukse, Chaojie Zhang, Aashaka Shah, Íñigo Goiri, Saeed Maleki, Ricardo Bianchini
Who it is from
Microsoftaffiliation declared by the authors, according to OpenAlex- University of Washingtonaffiliation declared by the authors, according to OpenAlex
Other papers from the same organizations
- s1: Simple test-time scalingStanford University · 1,957 citations
- Instruction Tuning for Large Language Models: A SurveyAlibaba Group · 1,416 citations
- REPLUG: Retrieval-Augmented Black-Box Language ModelsKorea Advanced Institute of Science and Technology · 1,206 citations
- OCRBench: on the hidden mystery of OCR in large multimodal modelsInstitute of Automation · 1,084 citations
- Improving Text Embeddings with Large Language ModelsMicrosoft · 1,029 citations
- Counterfactual Explanations and Algorithmic Recourses for Machine Learning: A ReviewUniversity of Washington · 949 citations