Logit Standardization in Knowledge Distillation
Shangquan Sun, Wenqi Ren, Jingzhi Li, Rui Wang, Xiaochun Cao
Who it is from
- Institute of Information Engineeringaffiliation declared by the authors, according to OpenAlex
- Sun Yat-sen Universityaffiliation declared by the authors, according to OpenAlex
Other papers from the same organizations
- A Survey on Model Compression for Large Language ModelsInstitute of Information Engineering · 817 citations
- Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video UnderstandingPeng Cheng Laboratory · 575 citations
- Aligning Cyber Space With Physical World: A Comprehensive Survey on Embodied AIPeng Cheng Laboratory · 527 citations
- Causal World Modeling for Robot ControlSun Yat-sen University · 494 citations
- Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications, and OpportunitiesNortheastern University · 434 citations
- Photo-SLAM: Real-Time Simultaneous Localization and Photorealistic Mapping for Monocular, Stereo, and RGB-D CamerasSun Yat-sen University · 410 citations