This repository contains the training code of ParetoQ introduced in our work "ParetoQ Scaling Laws in Extremely Low-bit LLM Quantization"

LLM OrchestrationOpen Source AI & Machine LearningOpen Source