https://dustinmorgan.org/tags/quantization/Recent content in Quantization on Dustin MorganHugoen-usWed, 26 Aug 2026 00:00:00 +0000https://dustinmorgan.org/blog/what-i-got-wrong-about-sq4/Wed, 26 Aug 2026 00:00:00 +0000https://dustinmorgan.org/blog/what-i-got-wrong-about-sq4/I published a 4-bit quantization format and called its quality indistinguishable from FP16. Once I measured it properly, standard 4-bit formats beat it. I’ve retired it.https://dustinmorgan.org/blog/sq4-is-live-llama-cpp-pr-and-whitepaper/Wed, 13 May 2026 00:00:00 +0000https://dustinmorgan.org/blog/sq4-is-live-llama-cpp-pr-and-whitepaper/We published the SQ4 whitepaper and opened a PR to bring percentile-calibrated 4-bit quantization to llama.cpp.