🧵 New paper: SQuAT: Spherical Lattice Vector Quantization-Aware Training
We scale lattice VQ-QAT to billion-parameter LLMs and 10B training tokens, outperforming standard VQ-QAT and integer QAT at 2.25 bits per weight.
Work from my internship at Qualcomm AI Research 👇
We scale lattice VQ-QAT to billion-parameter LLMs and 10B training tokens, outperforming standard VQ-QAT and integer QAT at 2.25 bits per weight.
Work from my internship at Qualcomm AI Research 👇