Exploring the Trade-Offs: Quantization Methods, Task Difficulty, and Model Size in Large Language Models From Edge to Giant
Jemin Lee, Sihyeong Park, Jinse Kwon, Jihun Oh, Yongin Kwon
De quem é
- Korea Electronics Technology Instituteafiliação declarada pelos autores, segundo o OpenAlex
Outros papers das mesmas organizações
- A Survey on Inference Engines for Large Language Models: Perspectives on Optimization and EfficiencyKorea Electronics Technology Institute · 47 citações
- PersonaBooth: Personalized Text-to-Motion GenerationKorea Electronics Technology Institute · 28 citações
- Zero-Shot Scene Change DetectionKorea Electronics Technology Institute · 26 citações
- Q-HyViT: Post-Training Quantization of Hybrid Vision Transformers With Bridge Block Reconstruction for IoT SystemsKorea Electronics Technology Institute · 25 citações