LLM Awq
[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
LLM OrchestrationOpen Source AI & Machine LearningOpen Source
About
Efficient and accurate low-bit weight quantization (INT3/4) for LLMs, supporting instruction-tuned models and multi-modal LMs.
Open Source Health
- Stars
- 3,633
- Forks
- 325
- License
- MIT
- Last commit
- 1 years ago
Python
Alternatives to LLM Awq
The Algorithmby TwitterSource code for the X Recommendation Algorithm
Recommendersby TensorFlowTensorFlow Recommenders is a library for building recommender system models using TensorFlow.- RPG_KDD2025by FacebookresearchThis repository provides the code for implementing RPG described in our KDD'25 paper "Generating Long Semantic IDs in Parallel for Recommendation".
- Pairecby AlibabaA Go web framework for quickly building recommendation online services based on JSON configuration.
Textrankby Summa NLPTextRank implementation for Python 3.
Resources & Links
Related Categories
Using LLM Awq?
Track its cost next to the rest of your stack and get a reminder before it renews.
Add to my stackVendor
MIT HAN Lab
Efficient AI Computing. PI: Song Han
