FairScale

PyTorch extensions for high performance and large scale training.

Machine Learning Model TrainingML FrameworksOpen Source

About

FairScale is a PyTorch extension library for high performance and large scale training. This library extends basic PyTorch capabilities while adding new SOTA scaling techniques. FairScale makes available the latest distributed training techniques in the form of composable modules and easy to use APIs. These APIs are a fundamental part of a researcher's toolbox as they attempt to scale models with limited resources.

Open Source Health

Not enough history
Stars
3,406
Forks
293
License
Not stated
Last commit
1 years ago
Python

Related Categories

Using FairScale?

Track its cost next to the rest of your stack and get a reminder before it renews.

Add to my stack

Vendor

Facebookresearch

Publisher of Fairseq

View vendor profile

More by Facebookresearch