BMTrain
Efficient Training (including pre-training and fine-tuning) for Big Models
About
BMTrain is an efficient large model training toolkit that can be used to train large models with tens of billions of parameters. It can train models in a distributed manner while keeping the code as simple as stand-alone training.
Open Source Health
- Stars
- 624
- Forks
- 89
- License
- Apache-2.0
- Last commit
- 3 months ago
Related Categories
Vendor
OpenBMB
OpenBMB (Open Lab for Big Model Base) aims to build foundation models and systems towards AGI
Quick Links
Open Source
More by OpenBMB
Related Products
Peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
Top category match
Sophia Script For Windows
zap: The most powerful PowerShell module for fine-tuning Windows 10 & Windows 11 on GitHub
Top category match
KTransformers
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
Top category match
LongWriter
[ICLR 2025] LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs
Top category match
Regress Lm
Library for sequence-to-sequence numeric prediction, applicable to any tokenizable input, and allows pretraining and fine-tuning over multiple tasks.
Top category match