Gold IV
1,550 Elo
- #4,413 on the ladder
- −7 today · −18 this week
- Peak 1,568
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
microsoft/LoRA is #4,413 on the bestofgithub Elo ladder, in Gold IV, with a rating of 1,550 (−18 this week). It has 13,923 stars, 10 gained in the last week.
1,550 Elo
13,923
git clone https://github.com/microsoft/LoRA.gitAn implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
git clone https://github.com/EleutherAI/gpt-neo.gitRWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
git clone https://github.com/BlinkDL/RWKV-LM.gitAn implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
git clone https://github.com/EleutherAI/gpt-neox.gitLoading README…