Inference Acceleration for the 70B LLaMA-2 Large Language Model

Qingyu Zhang
Qingyu Zhang
Master’s Student in Computer Science

I build LLM agents that hold reliable multi-turn conversations in real-world settings, and I work on making large models more efficient.