Dont Stop Pretraining
Code associated with the Don't Stop Pretraining ACL 2020 paper
About
The 'dont-stop-pretraining' repository provides code related to the adaptation of language models as discussed in the ACL 2020 paper. It focuses on techniques for continuing the pretraining of language models to improve their performance on specific tasks and domains. The repository includes pretrained models and instructions for installation and usage, making it suitable for researchers and practitioners in natural language processing looking to enhance model capabilities.
Open Source Health
- Stars
- 544
- Forks
- 72
- License
- Not stated
- Last commit
- 5 years ago
Resources & Links
Related Categories
Vendor
Allenai
Publisher of Dont Stop Pretraining, Objaverse Xl and Procthor
Quick Links
Open Source
More by Allenai
Related Products
Textrank
TextRank implementation for Python 3.
Top category match
KoBERT
Korean BERT pre-trained cased (KoBERT)
Top category match
TAADpapers
Must-read Papers on Textual Adversarial Attack and Defense
Top category match
AutoPhrase
AutoPhrase: Automated Phrase Mining from Massive Text Corpora
Top category match
Recognizers-Text
Recognizers-Text offers entity recognition and resolution for numbers, dates, and units in multiple languages.
Top category match