microsoft/LoRA
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
4 Releases
Latest: 4y ago
RoBERTa large LoRA checkpointsRoBERTa-largeLatestPre-release
edwardjhu·4y ago·September 16, 2021LoRA checkpoints for RoBERTa large. Please see NLU/README.md for steps to reproduce our results.
RoBERTa base LoRA checkpointsRoBERTa-basePre-release
edwardjhu·4y ago·September 16, 2021LoRA checkpoints for RoBERTa base. Please see NLU/README.md for steps to reproduce our results.
GPT-2 LoRA checkpointsGPT-2Pre-release
edwardjhu·4y ago·September 16, 2021LoRA checkpoints for GPT-2 medium and large. Please see NLG/README.md for steps to reproduce our results.
DeBERTa LoRA checkpointsDeBERTaPre-release
edwardjhu·4y ago·September 16, 2021LoRA checkpoints for DeBERTa XXL. Please see NLU/README.md for steps to reproduce our results.