LoRA
Machine Learning Model TrainingML Frameworks

LoRA

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

Open Source

About

This repo contains the source code of the Python package loralib and several examples of how to integrate it with PyTorch models, such as those in Hugging Face. We only support PyTorch for now. See our paper for a detailed description of LoRA.

Open Source Health

Not enough history
Stars
13,789
Forks
926
License
MIT
Last commit
2 years ago
Python

Related Categories