InfiniteBench

Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718

LLM OrchestrationOpen Source AI & Machine LearningOpen Source

About

Welcome to InfiniteBench, a cutting-edge benchmark tailored for evaluating the capabilities of language models to process, understand, and reason over super long contexts (100k+ tokens). Long contexts are crucial for enhancing applications with LLMs and achieving high-level interaction. InfiniteBench is designed to push the boundaries of language models by testing them against a context length of 100k+, which is 10 times longer than traditional datasets.

Open Source Health

Not enough history
Stars
393
Forks
32
License
MIT
Last commit
2 years ago
Python

Resources & Links

Related Categories

Using InfiniteBench?

Track its cost next to the rest of your stack and get a reminder before it renews.

Add to my stack

Vendor

OpenBMB

OpenBMB (Open Lab for Big Model Base) aims to build foundation models and systems towards AGI

View vendor profile

More by OpenBMB