FMInference/FlexLLMGen

Running large language models on a single GPU for throughput-oriented scenarios.

语言：Python · GitHub 星标：9,343 · Fork：587

话题：deep-learning · gpt-3 · high-throughput · large-language-models · machine-learning · offloading · opt

在 GitHub 上查看原仓库