LongLoRA
LLM OrchestrationOpen Source AI & Machine Learning

LongLoRA

Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)

Open Source

About

LongAlpaca-12k contains 9k long QA data that we collected and 3k short QA sampled from the original Alpaca data. This is to avoid the case that the model might degrade at short instruction following. The data we collect contains various types and amounts as the following figure.

Open Source Health

Not enough history
Stars
2,686
Forks
279
License
Apache-2.0
Last commit
2 years ago
Python

Related Categories