ShuffleInfer: Disaggregate LLM Inference for Mixed Downstream Workloads
C.-C. Hu, Heyang Huang, Liangliang Xu, Xusheng Chen, Chenxi Wang, Jiang Xu, Shuang Chen, Hao Feng and 4 more
Who it is from
- Institute of Computing Technologyaffiliation declared by the authors, according to OpenAlex
- Xidian Universityaffiliation declared by the authors, according to OpenAlex
Other papers from the same organizations
- Explainability for Large Language Models: A SurveyBaidu · 1,443 citations
- Tool learning with large language models: a surveyBaidu · 496 citations
- Recent advances in 3D Gaussian splattingInstitute of Computing Technology · 426 citations
- Exploring Progress in Multivariate Time Series Forecasting: Comprehensive Benchmarking and Heterogeneity AnalysisInstitute of Computing Technology · 398 citations
- IRSAM: Advancing Segment Anything Model for Infrared Small Target DetectionXidian University · 310 citations
- CMUNEXT: An Efficient Medical Image Segmentation Network Based on Large Kernel and Skip FusionInstitute of Computing Technology · 303 citations