agus-official/inferx-sdk

Privacy‑first, on‑device LLM SDK powered by llama.cpp — unified C API with Android/iOS/Flutter bindings, low‑latency streaming, OpenAI‑compatible chat/function calling, multi‑LoRA stacking.

语言：Dart · GitHub 星标：9 · Fork：4

话题：agent · android · edge-ai · flutter · inferx · ios · local-llm · lora

在 GitHub 上查看原仓库