nanoGPT
The simplest, fastest repository for training/finetuning medium-sized GPTs.
About
Update Nov 2025 nanoGPT has a new and improved cousin called nanochat. It is very likely you meant to use/find nanochat instead. nanoGPT (this repo) is now very old and deprecated but I will leave it up for posterity.
Open Source Health
- Stars
- 63,044
- Forks
- 10,846
- License
- MIT
- Last commit
- 11 months ago
Related Categories
Vendor
Karpathy
Publisher of Nn Zero To Hero, Char Rnn and Llm.C
Quick Links
Open Source
More by Karpathy
Related Products
Peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
Top category match
Sophia Script For Windows
zap: The most powerful PowerShell module for fine-tuning Windows 10 & Windows 11 on GitHub
Top category match
KTransformers
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
Top category match
LongWriter
[ICLR 2025] LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs
Top category match
Regress Lm
Library for sequence-to-sequence numeric prediction, applicable to any tokenizable input, and allows pretraining and fine-tuning over multiple tasks.
Top category match