Pushing the Limits of Large Language Model Quantization via the Linearity Theorem.

Malinovskii Vladimir, Andrei Panferov, Ivan Ilin, Han Guo, Peter Richtárik, Dan Alistarh

November, 2024 ML