Neural Compressor
LLM OrchestrationOpen Source AI & Machine Learning

Neural Compressor

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

Open Source

About

Intel® Neural Compressor An open-source Python library supporting popular model compression techniques on mainstream deep learning frameworks (PyTorch, TensorFlow, and JAX)

Open Source Health

Not enough history
Stars
2,706
Forks
322
License
Apache-2.0
Last commit
27 days ago
Python

Related Categories