Research
-
What I Got Wrong About SQ4
I published a 4-bit quantization format and called its quality indistinguishable from FP16. Once I measured it properly, standard 4-bit formats beat it. I've retired it.
I published a 4-bit quantization format and called its quality indistinguishable from FP16. Once I measured it properly, standard 4-bit formats beat it. I've retired it.