PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression.

Vladimir Malinovskii, Denis Mazur, Ivan Ilin, Denis Kuznedelev, Konstantin Burlachenko, Kai Yi, Dan Alistarh, Peter Richtárik

May, 2024 ML