huggingface/text-generation-inference

• Emerald III

Nano vLLM

• 1,816−7 Elo, change today
• 16.4k stars
• 2.8k forks
• 86 watchers
• 6mo ago

git clone https://github.com/GeeeekExplorer/nano-vllm.git

• deep-learning
• inference
• llm
• nlp

• Silver I

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

• 1,512−2 Elo, change today
• 10.7k stars
• 657 forks
• 2y ago

git clone https://github.com/bigscience-workshop/petals.git

• bloom
• chatbot
• deep-learning
• distributed-systems

• Copper II

Google AI 2018 BERT pytorch implementation

• 1,336−1 Elo, change today
• 6.5k stars
• 1.3k forks
• 3y ago

git clone https://github.com/codertimo/BERT-pytorch.git

• bert
• language-model
• nlp
• pytorch

• Copper II

Transformer related optimization, including BERT, GPT

• 1,334−2 Elo, change today
• 6.4k stars
• 933 forks
• 2y ago

git clone https://github.com/NVIDIA/FasterTransformer.git

• bert
• gpt
• pytorch
• transformer

• Silver IV

An open-source NLP research library, built on PyTorch.

• 1,461−4 Elo, change today
• 11.8k stars
• 2.2k forks
• 3y ago
• archived

git clone https://github.com/allenai/allennlp.git

• data-science
• deep-learning
• natural-language-processing
• nlp

• Diamond V

Faster Whisper transcription with CTranslate2

• 1,919−3 Elo, change today
• 26.7k stars
• 2.2k forks
• 164 watchers
• 3d ago

git clone https://github.com/SYSTRAN/faster-whisper.git

• deep-learning
• inference
• openai
• quantization