Dolma
byAllenai
Data and tools for generating and inspecting OLMo pre-training data.
LLM OrchestrationOpen Source AI & Machine LearningOpen Source
About
Dolma is an open dataset of 3 trillion tokens from a diverse mix of web content, academic publications, code, books, and encyclopedic materials. It was created as a training corpus for OLMo, a language model from the Allen Institute for AI (AI2).
Open Source Health
- Stars
- 1,543
- Forks
- 202
- License
- Apache-2.0
- Last commit
- 2 months ago
Python
Alternatives to Dolma
Dont Stop Pretrainingby AllenaiCode associated with the Don't Stop Pretraining ACL 2020 paper
The Algorithmby TwitterSource code for the X Recommendation Algorithm
Recommendersby TensorFlowTensorFlow Recommenders is a library for building recommender system models using TensorFlow.- RPG_KDD2025by FacebookresearchThis repository provides the code for implementing RPG described in our KDD'25 paper "Generating Long Semantic IDs in Parallel for Recommendation".
- Pairecby AlibabaA Go web framework for quickly building recommendation online services based on JSON configuration.
Resources & Links
Related Categories
Using Dolma?
Track its cost next to the rest of your stack and get a reminder before it renews.
Add to my stackVendor
Allenai
Publisher of Dont Stop Pretraining, Objaverse Xl and Procthor