Survey on Knowledge Distillation for Large Language Models: Methods, Evaluation, and Application
Chuanpeng Yang, Yao Tai Zhu, Lu Wang, Yidong Wang, Qian Chen, Chenlong Gao, Bingjie Yan, Yiqiang Chen
Who it is from
- Institute of Computing Technologyaffiliation declared by the authors, according to OpenAlex
- Institute of Information Engineeringaffiliation declared by the authors, according to OpenAlex
Other papers from the same organizations
- Explainability for Large Language Models: A SurveyBaidu · 1,443 citations
- A Survey on Model Compression for Large Language ModelsInstitute of Information Engineering · 817 citations
- Tool learning with large language models: a surveyBaidu · 496 citations
- Logit Standardization in Knowledge DistillationInstitute of Information Engineering · 484 citations
- Recent advances in 3D Gaussian splattingInstitute of Computing Technology · 426 citations
- Exploring Progress in Multivariate Time Series Forecasting: Comprehensive Benchmarking and Heterogeneity AnalysisInstitute of Computing Technology · 398 citations