01
Frugon — find where your LLM bill leaks before you pay it
A free, MIT, fully local CLI that reads your LLM call logs and tells you which calls a cheaper model could have handled. It runs entirely on your machine — no network, no LLM calls, just tokenizing, applying provider pricing, and doing arithmetic — so nothing about your prompts leaves the box. Feed it two ways: point it at existing OpenAI-format JSONL, or run frugon capture as a local proxy that logs your traffic with no added latency. uvx frugon analyze ./logs.jsonl and you get a per-model breakdown; the demo run flagged $205/mo in potential savings (37%) on a $549 baseline, using the 30–50% range from the RouteLLM research it's built on.
Reach for it before you touch any gateway config — it's the audit that tells you whether routing is even worth it for your specific workload, rather than assuming it is. Delete the eyeball-the-dashboard guesswork about which endpoints are burning tokens. The honest part is the caveat Frugon writes itself: "quality is not verified — 'within tolerance' is an offline estimate; run --measure to confirm it on your real outputs before you switch." That --measure flag samples your traffic through candidate models using your own keys sent straight to the provider, never through Frugon — the verification step most cost dashboards quietly skip. Tradeoff: three weeks old, 53 stars, and the savings it estimates are a starting point to test, not a promise.