bert4torch
An elegent pytorch implement of transformers
About
| 功能 | bert4torch | transformers | 备注 | | ----------------------------------- | ---------- | ------------ | ---------------------------------- | | 训练进度条 | ✅ | ✅ | 进度条打印loss和定义的metrics | | 分布式训练dp/ddp | ✅ | ✅ | torch自带dp/ddp | | 各类callbacks | ✅ | ✅ | 日志/tensorboard/earlystop/wandb等 | | 大模型推理，stream/batch输出 | ✅ | ✅ | 各个模型是通用的，无需单独维护脚本 | | 大模型微调 | ✅ | ✅ | lora依赖peft库，pv2自带 | | 丰富tricks | ✅ | ❌ | 对抗训练等tricks即插即用 | | 代码简洁易懂，自定义空间大 | ✅ | ❌ | 代码复用度高, keras代码训练风格 | | 仓库的维护能力/影响力/使用量/兼容性 | ❌ | ✅ | 目前仓库个人维护 | | 一键部署大模型 | | |
Open Source Health
- Stars
- 1,326
- Forks
- 166
- License
- MIT
- Last commit
- 5 months ago
Related Categories
Vendor
Bo仔很忙
LLM & NLP & ML
Quick Links
Open Source
Related Products
The Algorithm
Source code for the X Recommendation Algorithm
Shared categories
Recommenders
TensorFlow Recommenders is a library for building recommender system models using TensorFlow.
Shared categories
RPG_KDD2025
This repository provides the code for implementing RPG described in our KDD'25 paper "Generating Long Semantic IDs in Parallel for Recommendation".
Shared categories
Pairec
A Go web framework for quickly building recommendation online services based on JSON configuration.
Shared categories
Textrank
TextRank implementation for Python 3.
Shared categories