INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
语言:C++ · GitHub 星标:1,590 · Fork:131
话题:deep-learning · ggml · language-model · llm · machine-learning · quantization · rwkv
在 GitHub 上查看原仓库