Olmes
Reproducible, flexible LLM evaluations
About
The OLMES (Open Language Model Evaluation System) repository is used within Ai2's Open Language Model efforts to evaluate base and instruction-tuned LLMs on a range of tasks.
Open Source Health
- Stars
- 395
- Forks
- 105
- License
- Apache-2.0
- Last commit
- 7 months ago
Resources & Links
Related Categories
Vendor
Allenai
Publisher of Dont Stop Pretraining, Objaverse Xl and Procthor
Quick Links
Open Source
More by Allenai
Related Products
Dont Stop Pretraining
Code associated with the Don't Stop Pretraining ACL 2020 paper
More from this vendor
The Algorithm
Source code for the X Recommendation Algorithm
Shared categories
Recommenders
TensorFlow Recommenders is a library for building recommender system models using TensorFlow.
Shared categories
RPG_KDD2025
This repository provides the code for implementing RPG described in our KDD'25 paper "Generating Long Semantic IDs in Parallel for Recommendation".
Shared categories
Pairec
A Go web framework for quickly building recommendation online services based on JSON configuration.
Shared categories