LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!
语言:Rust · GitHub 星标:112 · Fork:5
话题:cuda · deep-learning · inference · language-model · llama · neural-network · rust · rust-lang
在 GitHub 上查看原仓库