Sub-1-Bit LLM Compression via Latent Factorization
Presents novel model compression technique for researchers working on efficient AI deployment and quantization.
AI Summary
Samsung Labs releases LittleBit and LittleBit-2, a sub-1-bit LLM compression method using latent factorization that achieves extreme compression down to 0.1 bits per weight while maintaining original architecture.
