Dynamic routing control-plane for multi-node LLM serving with normalized metrics and cost accounting
语言:Perl · GitHub 星标:2 · Fork:0
话题:ai · cpan · langertha · llm · llm-proxy · perl
在 GitHub 上查看原仓库