Logit Standardization in Knowledge Distillation
Shangquan Sun, Wenqi Ren, Jingzhi Li, Rui Wang, Xiaochun Cao
De quem é
- Institute of Information Engineeringafiliação declarada pelos autores, segundo o OpenAlex
- Sun Yat-sen Universityafiliação declarada pelos autores, segundo o OpenAlex
Outros papers das mesmas organizações
- A Survey on Model Compression for Large Language ModelsInstitute of Information Engineering · 817 citações
- Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video UnderstandingPeng Cheng Laboratory · 575 citações
- Aligning Cyber Space With Physical World: A Comprehensive Survey on Embodied AIPeng Cheng Laboratory · 527 citações
- Causal World Modeling for Robot ControlSun Yat-sen University · 494 citações
- Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications, and OpportunitiesNortheastern University · 434 citações
- Photo-SLAM: Real-Time Simultaneous Localization and Photorealistic Mapping for Monocular, Stereo, and RGB-D CamerasSun Yat-sen University · 410 citações