Olmes
byAllenai
Reproducible, flexible LLM evaluations
LLM OrchestrationOpen Source AI & Machine LearningOpen Source
About
The OLMES (Open Language Model Evaluation System) repository is used within Ai2's Open Language Model efforts to evaluate base and instruction-tuned LLMs on a range of tasks.
Open Source Health
- Stars
- 395
- Forks
- 105
- License
- Apache-2.0
- Last commit
- 7 months ago
Python
Alternatives to Olmes
Dont Stop Pretrainingby AllenaiCode associated with the Don't Stop Pretraining ACL 2020 paper
The Algorithmby TwitterSource code for the X Recommendation Algorithm
Recommendersby TensorFlowTensorFlow Recommenders is a library for building recommender system models using TensorFlow.- RPG_KDD2025by FacebookresearchThis repository provides the code for implementing RPG described in our KDD'25 paper "Generating Long Semantic IDs in Parallel for Recommendation".
- Pairecby AlibabaA Go web framework for quickly building recommendation online services based on JSON configuration.
Resources & Links
Related Categories
Using Olmes?
Track its cost next to the rest of your stack and get a reminder before it renews.
Add to my stackVendor
Allenai
Publisher of Dont Stop Pretraining, Objaverse Xl and Procthor