01
TurboFieldfare — 26B on the Mac you already own
A Swift-and-Metal inference engine that runs Gemma 4 26B-A4B — 4-bit, instruction-tuned, ~14.3 GB installed — in about 2 GB of resident memory on any Apple Silicon Mac. Apache-2.0, 1.7k stars, and 832 points with 294 comments on Show HN. It ships a native Mac app, a CLI, and an experimental OpenAI-compatible loopback server; you build from source, and a streaming installer fetches and repacks the weights on first run. The numbers are measured, not projected: 5.1–6.3 tokens/sec on an M2 MacBook Air, 31–35 on an M5 Pro.
The trick is treating the SSD as slow memory with an opinion about what to read next. Only ~3.9B of the 26B parameters are active per token, and where llama.cpp and Ollama mmap the file and let the OS page blindly, TurboFieldfare issues explicit parallel pread calls for exactly the experts the router selected — the author measured that single change at 0.5 to ~4 tokens/sec. Experts get reused (~41% on the next token), so a 16-slot cache hits 59–69% and SSD traffic settles around 250–320 MB per generated token. The thread did the QA: SSD wear is a non-issue (the engine only reads), and the author supplies his own anti-hype line — if you have 14 GB of RAM free, MLX runs the same model at 75 tokens/sec and you should use MLX. This exists for the memory you don't have.
Reach for it when you want private, local drafting on the 8 GB Air everyone said was a thin client. Delete the assumption that 26B-class local inference starts at 16 GB. Tradeoffs: exactly one model (the technique is MoE-specific and Gemma-tuned), text-only, macOS 26+ for the 2.4× prefill path, 5–6 tokens/sec on an M2 is dictation speed rather than agent speed, and a fanless Air will throttle on sustained runs.