RL4LMs

A modular RL library to fine-tune language models to human preferences

AI TranslationOpen Source AI & Machine LearningOpen Source

About

RL4LMs is designed for training language models to align with human preferences through customizable building blocks. It supports various NLP tasks such as summarization, dialogue generation, and machine translation, utilizing on-policy algorithms and diverse reward functions. Users can adapt the library to optimize transformer-based models on their chosen datasets, making it suitable for researchers and developers in natural language processing.

Open Source Health

Not enough history
Stars
2,395
Forks
201
License
Apache-2.0
Last commit
3 years ago
Python

Resources & Links

Related Categories

Using RL4LMs?

Track its cost next to the rest of your stack and get a reminder before it renews.

Add to my stack

Vendor

Allenai

Publisher of Dont Stop Pretraining, Objaverse Xl and Procthor

View vendor profile

More by Allenai