Exploring the Trade-Offs: Quantization Methods, Task Difficulty, and Model Size in Large Language Models From Edge to Giant
Jemin Lee, Sihyeong Park, Jinse Kwon, Jihun Oh, Yongin Kwon
Who it is from
- Korea Electronics Technology Instituteaffiliation declared by the authors, according to OpenAlex
Other papers from the same organizations
- A Survey on Inference Engines for Large Language Models: Perspectives on Optimization and EfficiencyKorea Electronics Technology Institute · 47 citations
- PersonaBooth: Personalized Text-to-Motion GenerationKorea Electronics Technology Institute · 28 citations
- Zero-Shot Scene Change DetectionKorea Electronics Technology Institute · 26 citations
- Q-HyViT: Post-Training Quantization of Hybrid Vision Transformers With Bridge Block Reconstruction for IoT SystemsKorea Electronics Technology Institute · 25 citations