ShuffleInfer: Disaggregate LLM Inference for Mixed Downstream Workloads
C.-C. Hu, Heyang Huang, Liangliang Xu, Xusheng Chen, Chenxi Wang, Jiang Xu, Shuang Chen, Hao Feng e mais 4
De quem é
- Institute of Computing Technologyafiliação declarada pelos autores, segundo o OpenAlex
- Xidian Universityafiliação declarada pelos autores, segundo o OpenAlex
Outros papers das mesmas organizações
- Explainability for Large Language Models: A SurveyBaidu · 1.443 citações
- Tool learning with large language models: a surveyBaidu · 496 citações
- Recent advances in 3D Gaussian splattingInstitute of Computing Technology · 426 citações
- Exploring Progress in Multivariate Time Series Forecasting: Comprehensive Benchmarking and Heterogeneity AnalysisInstitute of Computing Technology · 398 citações
- IRSAM: Advancing Segment Anything Model for Infrared Small Target DetectionXidian University · 310 citações
- CMUNEXT: An Efficient Medical Image Segmentation Network Based on Large Kernel and Skip FusionInstitute of Computing Technology · 303 citações