Three Agentic Coders Walked Into My 28 GB Rig
Or: how a reasoning model lost six points to my own benchmark harness, an 80B model fit into RAM that “had no …
#Nvidia (2)
Squeezing 2.7x More Tokens Per Second Out of Two Mismatched GPUs
Or: how I spent a weekend benchmarking local LLM inference, caught my optimization guide lying to me four times, and …