EleutherAI/gpt-neo

• Silver III

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

• 1,475−6 Elo, change today
• 14.7k stars
• 1k forks
• 11d ago

git clone https://github.com/BlinkDL/RWKV-LM.git

• attention-mechanism
• chatgpt
• deep-learning
• gpt

• Bronze III

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

• 1,396±0 Elo, change today
• 7.4k stars
• 1.1k forks
• 8d ago

git clone https://github.com/EleutherAI/gpt-neox.git

• deepspeed-library
• gpt-3
• language-model
• transformers

• Gold IV

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

• 1,550−7 Elo, change today
• 13.9k stars
• 936 forks
• 1y ago

git clone https://github.com/microsoft/LoRA.git

• adaptation
• deberta
• deep-learning
• gpt-2

• Gold III

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

• 1,578+3 Elo, change today
• 11.2k stars
• 1.2k forks
• 8h ago

git clone https://github.com/huggingface/tokenizers.git

• bert
• gpt
• language-model
• natural-language-processing

• Bronze V

🤖 Awesome list for ChatGPT — an artificial intelligence chatbot developed by OpenAI [SUBMISSIONS ARE TEMPORARILY PAUSED BECAUSE OF TOO MANY LOW QUALITY SUBMISSIONS]

• 1,371−7 Elo, change today
• 6.4k stars
• 489 forks
• 4h ago

git clone https://github.com/sindresorhus/awesome-chatgpt.git

• ai
• artificial-intelligence
• awesome
• awesome-list

• Silver III

This repository contains demos I made with the Transformers library by HuggingFace.

• 1,471−6 Elo, change today
• 11.7k stars
• 1.7k forks
• 1mo ago

git clone https://github.com/NielsRogge/Transformers-Tutorials.git

• bert
• gpt-2
• layoutlm
• pytorch