Inference Acceleration for the 70B LLaMA-2 Large Language Model

Last updated on Aug 4, 2025
Large Language Models Large Language Models Inference Acceleration Inference Acceleration VLLM VLLM ASC24 ASC24
Qingyu Zhang
Qingyu Zhang
Master Student of Computer Science and Technology

Research interests include LLM Long Context and Post-training.