Dont Stop Pretraining
byAllenai
Code associated with the Don't Stop Pretraining ACL 2020 paper
NLP & Text AnalysisOpen Source AI & Machine LearningOpen Source
About
The 'dont-stop-pretraining' repository provides code related to the adaptation of language models as discussed in the ACL 2020 paper. It focuses on techniques for continuing the pretraining of language models to improve their performance on specific tasks and domains. The repository includes pretrained models and instructions for installation and usage, making it suitable for researchers and practitioners in natural language processing looking to enhance model capabilities.
Open Source Health
- Stars
- 544
- Forks
- 72
- License
- Not stated
- Last commit
- 5 years ago
Python
Alternatives to Dont Stop Pretraining
Textrankby Summa NLPTextRank implementation for Python 3.
KoBERTby SK T-BrainKorean BERT pre-trained cased (KoBERT)
TAADpapersby THUNLPMust-read Papers on Textual Adversarial Attack and Defense
AutoPhraseby Jingbo ShangAutoPhrase: Automated Phrase Mining from Massive Text Corpora
Recognizers-Textby MicrosoftRecognizers-Text offers entity recognition and resolution for numbers, dates, and units in multiple languages.
Resources & Links
Related Categories
Using Dont Stop Pretraining?
Track its cost next to the rest of your stack and get a reminder before it renews.
Add to my stackVendor
Allenai
Publisher of Dont Stop Pretraining, Objaverse Xl and Procthor