carloslfu/slotstream

Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.

语言：Swift · GitHub 星标：637 · Fork：53

话题：apple-silicon · claude-code · inference-engine · llm · llm-inference · local-ai · local-llm · macos

在 GitHub 上查看原仓库