neul-labs/fast-litellm

High-performance Rust acceleration for LiteLLM - providing significant performance improvements for connection pooling, rate limiting, and memory-intensive workloads.

语言：Python · GitHub 星标：48 · Fork：4

话题：ai-infrastructure · connection-pool · drop-in · litellm · llm-gateway · neul-labs · performance · pypi

在 GitHub 上查看原仓库