InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management
Wonbeom Lee, Jungi Lee, Jung-Hwan Seo, Jaewoong Sim
De quem é
- Seoul National Universityafiliação declarada pelos autores, segundo o OpenAlex
Outros papers das mesmas organizações
- A comprehensive survey of deep learning for time series forecasting: architectural diversity and open challengesLG · 502 citações
- Scalable Parallel Algorithm for Graph Neural Network Interatomic Potentials in Molecular Dynamics SimulationsSeoul National University · 413 citações
- Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot ImagesSeoul National University · 341 citações
- LucidDreamer: Domain-Free Generation of 3D Gaussian Splatting ScenesSeoul National University · 289 citações
- Who Wrote this Code? Watermarking for Code GenerationNAVER Cloud · 248 citações
- Recommended implementation of quantitative susceptibility mapping for clinical research in the brain: A consensus of the ISMRM electro‐magnetic tissue properties study groupDonders Institute for Brain, Cognition and Behaviour · 204 citações