A Survey on Inference Engines for Large Language Models: Perspectives on Optimization and Efficiency
Sihyeong Park, Sungryeol Jeon, Chaelyn Lee, Seokhun Jeon, Byung-Soo Kim, Jemin Lee
Who it is from
- Korea Electronics Technology Instituteaffiliation declared by the authors, according to OpenAlex
Other papers from the same organizations
- Exploring the Trade-Offs: Quantization Methods, Task Difficulty, and Model Size in Large Language Models From Edge to GiantKorea Electronics Technology Institute · 34 citations
- PersonaBooth: Personalized Text-to-Motion GenerationKorea Electronics Technology Institute · 28 citations
- Zero-Shot Scene Change DetectionKorea Electronics Technology Institute · 26 citations
- Q-HyViT: Post-Training Quantization of Hybrid Vision Transformers With Bridge Block Reconstruction for IoT SystemsKorea Electronics Technology Institute · 25 citations