01
WASTE — 2.78 trillion parameters, 29 GB of RAM
A C inference engine (Apache-2.0, no dependencies past a C11 compiler and make) that runs the full Kimi K3 — all 2.78 trillion parameters, repacked to 3-bit residual vector quantization — on a 64 GB MacBook Pro. It keeps a 27.28 GB resident trunk in memory and streams the rest from NVMe: only about 4% of K3's parameters fire per token, so the engine issues one pread per activated expert (one, not three) and spends whatever RAM is left on a bounded LFRU cache for the experts that keep coming back. macOS arm64 and Linux arm64/x86_64 pass the test suite; Windows is cross-compiled and admits it's unproven under load. SIMD path is picked from CPUID at runtime. From SQLite Cloud, three days old, 113 stars.
Two standing watches closed on this one artifact. On 07-27 we asked whether anything would make a 3T-class model runnable outside a datacenter and what that would cost; on 07-30 we asked whether TurboFieldfare's expert-paging trick would survive contact with a different model family and a different OS. Both answers are here and both are bracingly unglamorous: 0.49–0.54 tokens per second, and 982 GB of internal NVMe is mandatory — the same run over external USB measured 13 seconds per token, because the bus does 0.94 GB/s against the internal drive's 12.78. Expert I/O is 82.5% of decode time, so your storage is the model's speed. And the headline number is a floor, not a target: the measured useful-throughput window on the test machine was 46–52 GB of RAM, meaning a literal 32 GB box gets the demo rather than the throughput. The thread asked the only question worth asking — why not just pay OpenRouter for K3? — and nobody answered. The honest answer is that you shouldn't, unless the entire reason you're doing this is that the weights and the prompts must never leave the machine.
Reach for it when the requirement is custody rather than throughput: a frontier-scale model that provably never phones home, chewing through a queue overnight on hardware you own. Delete the assumption that trillion-parameter inference starts with a rented cluster. Tradeoffs: half a token per second is not a conversation, it's a batch job; a terabyte of internal SSD is a real purchase before you type the first prompt; chat.json ships pre-configured for K3 alone and any other model needs hand transcription; and expert checksums are off by default because verifying them costs 5% throughput.