Pushing the Limits of Large Language Model Quantization via the Linearity Theorem.

Malinovskii Vladimir, Andrei Panferov, Ivan Ilin, Han Guo, Peter Richtárik, Dan Alistarh
November, 2024 ML
PDF
Type
Preprint