FairScale
Machine Learning Model TrainingML Frameworks

FairScale

PyTorch extensions for high performance and large scale training.

Open Source

About

FairScale is a PyTorch extension library for high performance and large scale training. This library extends basic PyTorch capabilities while adding new SOTA scaling techniques. FairScale makes available the latest distributed training techniques in the form of composable modules and easy to use APIs. These APIs are a fundamental part of a researcher's toolbox as they attempt to scale models with limited resources.

Open Source Health

Not enough history
Stars
3,406
Forks
293
License
Not stated
Last commit
1 years ago
Python

Related Categories