therezor/cardputer-ai

Fully offline tiny LLM chatbot on the ESP32-S3 Cardputer ADV - 8M params, Q4 weights baked into the firmware, ~5 tok/s.

语言：C++ · GitHub 星标：126 · Fork：14

话题：ai · ai-chat · cardputer · cardputer-adv · local-ai · local-llm

在 GitHub 上查看原仓库