A Survey on Inference Engines for Large Language Models: Perspectives on Optimization and Efficiency
Sihyeong Park, Sungryeol Jeon, Chaelyn Lee, Seokhun Jeon, Byung-Soo Kim, Jemin Lee
De quem é
- Korea Electronics Technology Instituteafiliação declarada pelos autores, segundo o OpenAlex
Outros papers das mesmas organizações
- Exploring the Trade-Offs: Quantization Methods, Task Difficulty, and Model Size in Large Language Models From Edge to GiantKorea Electronics Technology Institute · 34 citações
- PersonaBooth: Personalized Text-to-Motion GenerationKorea Electronics Technology Institute · 28 citações
- Zero-Shot Scene Change DetectionKorea Electronics Technology Institute · 26 citações
- Q-HyViT: Post-Training Quantization of Hybrid Vision Transformers With Bridge Block Reconstruction for IoT SystemsKorea Electronics Technology Institute · 25 citações