TencentPretrain
Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo
About
Pre-training has become an essential part of AI technology. TencentPretrain is a toolkit for pre-training and fine-tuning on data of different modalities (e.g. text and vision). TencentPretrain is characterized by modular design. It facilitates the use of existing pre-training models, and provides interfaces for users to further extend upon. With TencentPretrain, we build a model zoo which contains pre-trained models of different properties. TencentPretrain inherits the open source toolkit UER (https://github.com/dbiir/UER-py/) and extends it to a multimodal pre-training framework.
Open Source Health
- Stars
- 1,093
- Forks
- 148
- License
- Not stated
- Last commit
- 2 years ago
Resources & Links
Related Categories
Vendor
Tencent
Publisher of Bugly and TDesign
Quick Links
Open Source
More by Tencent
Related Products
Peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
Top category match
Sophia Script For Windows
zap: The most powerful PowerShell module for fine-tuning Windows 10 & Windows 11 on GitHub
Top category match
KTransformers
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
Top category match
LongWriter
[ICLR 2025] LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs
Top category match
Regress Lm
Library for sequence-to-sequence numeric prediction, applicable to any tokenizable input, and allows pretraining and fine-tuning over multiple tasks.
Top category match