vllm-project/vllm-omni

• Emerald III

Nano vLLM

• 1,816−7 Elo, change today
• 16.4k stars
• 2.8k forks
• 86 watchers
• 6mo ago

git clone https://github.com/GeeeekExplorer/nano-vllm.git

• deep-learning
• inference
• llm
• nlp

• Diamond IV

🚀 AI 全自动短视频引擎 | AI Fully Automated Short Video Engine

• 1,965+4 Elo, change today
• 30.1k stars
• 4.3k forks
• 116 watchers
• 5mo ago

git clone https://github.com/ATH-MaaS/Pixelle-Video && cd Pixelle-Video && docker compose up -d

• aigc
• comfyui
• image-generation
• tts

• Diamond I

High-throughput LLM serving engine with PagedAttention and an OpenAI-compatible server.

• 2,222−2 Elo, change today
• 96.9k stars
• 24.8k forks
• 604 watchers
• 1h ago

pip install vllm

• llm
• serving
• gpu

• Silver V

Large Language Model Text Generation Inference

• 1,436−2 Elo, change today
• 10.8k stars
• 1.2k forks
• 7mo ago
• archived

git clone https://github.com/huggingface/text-generation-inference.git

• bloom
• deep-learning
• falcon
• gpt

• Diamond III

Port of OpenAI's Whisper model in C/C++

• 1,992−2 Elo, change today
• 55.2k stars
• 6.3k forks
• 399 watchers
• 2d ago

brew install whisper.cpp

• inference
• openai
• speech-recognition
• speech-to-text

• Copper II

Transformer related optimization, including BERT, GPT

• 1,334−2 Elo, change today
• 6.4k stars
• 933 forks
• 2y ago

git clone https://github.com/NVIDIA/FasterTransformer.git

• bert
• gpt
• pytorch
• transformer