vllm-project/vllm-omni
Open on GitHubPythonA framework for efficient model inference with omni-modality models
- 1,792±0 Elo, change today
- 7.7k stars
- 2.1k forks
- 59 watchers
pipx install vllm-omniRepositories with the GitHub topic “pytorch”: 177 repositories with 3.5M stars between them, mostly written in Python, Jupyter Notebook and C++. The highest-rated is Comfy-Org/ComfyUI, #62 on the bestofgithub Elo ladder.
A framework for efficient model inference with omni-modality models
pipx install vllm-omniFlashInfer: Kernel Library for LLM Serving
git clone https://github.com/flashinfer-ai/flashinfer.gitAn open, programmable decision layer for models and compute.
git clone https://github.com/vllm-project/semantic-router.gitFault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters
git clone https://github.com/higgsfield-ai/higgsfield.gitNeural building blocks for speaker diarization: speech activity detection, speaker change detection, overlapped speech detection, speaker embedding
git clone https://github.com/pyannote/pyannote-audio.gitSilero VAD: pre-trained enterprise-grade Voice Activity Detector
git clone https://github.com/snakers4/silero-vad.gitThe most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface. The fastest local…
High-throughput LLM serving engine with PagedAttention and an OpenAI-compatible server.
The reference library for pretrained text, vision and audio models: load, fine-tune and run thousands of checkpoints.
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning
Ultralytics YOLO27, YOLO26, YOLO11, YOLOv8 — object detection, instance segmentation, semantic segmentation, image…
Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward…
Stable Diffusion web UI
We write your reusable computer vision tools. 💜
GUI for a Vocal Remover that uses Deep Neural Networks.
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML…
Real-ESRGAN aims at developing Practical Algorithms for General Image/Video Restoration.
Learn how to develop, deploy and iterate on production-grade ML applications.
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original…
State-of-the-art 2D and 3D Face Analysis Project
Nano vLLM
JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf
Interactive deep learning book with multi-framework code, math, and discussions. Adopted at 500 universities from 70…
A framework for efficient model inference with omni-modality models
🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization…
🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production
Deep Learning for humans
Ultralytics YOLOv5 in PyTorch for object detection, instance segmentation, classification, training, and export.
Clone a voice in 5 seconds to generate arbitrary speech in real-time
FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.
🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
Visualizer for neural network, deep learning and machine learning models
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and…
Materials for the Learn PyTorch for Deep Learning: Zero to Mastery course.
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports…
Open standard for machine learning interoperability
ncnn is a high-performance neural network inference framework optimized for the mobile platform
🐍 Geometric Computer Vision Library for Spatial AI
OpenMMLab Detection Toolbox and Benchmark
The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and…
The fastai deep learning library
Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic…
Learn ML engineering for free in 4 months! Register here 👇🏼
Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
deep learning for image processing including classification and object-detection etc.
PyTorch Tutorial for Deep Learning Researchers
Machine Learning Engineering Open Book
GFPGAN aims at developing Practical Algorithms for Real-world Face Restoration.
FlashInfer: Kernel Library for LLM Serving
Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency…
Graph Neural Network Library for PyTorch
Image-to-Image Translation in PyTorch
Silero VAD: pre-trained enterprise-grade Voice Activity Detector
Open3D: A Modern Library for 3D Data Processing
Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
PyTorch version of Stable Baselines, reliable implementations of reinforcement learning algorithms.
[NeurIPS 2022] Towards Robust Blind Face Restoration with Codebook Lookup Transformer
🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.
A collaboration friendly studio for NeRFs
Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document…
Open-source SenseVoiceSmall model for Mandarin, Cantonese, English, Japanese, and Korean ASR, language ID, emotion…
深度学习入门教程, 优秀文章, Deep Learning Tutorial
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference…
pytorch handbook是一本开源的书籍,目标是帮助那些希望和使用PyTorch进行深度学习开发和研究的朋友快速入门,其中包含的Pytorch教程全部通过测试保证可以成功运行
🚀Clone a voice in 5 seconds to generate arbitrary speech in real-time
An open, programmable decision layer for models and compute.
The Cloud Native AI Platform
A comprehensive list of pytorch related content on github,such as different models,implementations,helper…
High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO…
本项目将《动手学深度学习》(Dive into Deep Learning)原书中的MXNet实现改为PyTorch实现。
Neural building blocks for speaker diarization: speech activity detection, speaker change detection, overlapped speech…
SANA & Sol: Efficient Generative Models and Full-Stack Training & Inference Engines for Image, Video, and World Modeling
Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with…
An open source implementation of CLIP.
SoftVC VITS Singing Voice Conversion
Image inpainting tool powered by SOTA AI Model. Remove any unwanted object, defect, people from your pictures or erase…
Real-time, local speech-to-text with streaming ASR, speaker diarization, translation, and OpenAI/Deepgram-compatible…
A theoretical reconstruction of the Claude Mythos architecture, built from first principles using the available…
Lab Materials for MIT 6.S191: Introduction to Deep Learning
人工智能学习路线图,整理近200个实战案例与项目,免费提供配套教材,零基础入门,就业实战!包括:Python,数学,机器学习,数据分析,深度学习,计算机视觉,自然语言处理,PyTorch tensorflow…
Python 开源项目之「自学编程之路」,保姆级教程:AI实验室、宝藏视频、数据结构、学习指南、机器学习实战、深度学习实战、网络爬虫、大厂面经、程序人生、资源分享。
pix2tex: Using a ViT to convert images of equations into LaTeX code.
A PyTorch-based Speech Toolkit
State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and…
YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO…
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
AI Toolkit for Healthcare Imaging
PyTorch implementation of the U-Net for image semantic segmentation with high quality images
Implementation of paper - YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors
Fast and Accurate ML in 3 Lines of Code
🦙 LaMa Image Inpainting, Resolution-robust Large Mask Inpainting with Fourier Convolutions, WACV 2022
OpenMMLab Pose Estimation Toolbox and Benchmark.
Convert Machine Learning Code Between Frameworks
Natural Language Processing Tutorial for Deep Learning Researchers
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
PyTorch tutorials and fun projects including neural talk, neural style, poem writing, anime generation…
深度学习入门开源书,基于TensorFlow 2.0案例实战。Open source Deep Learning book, based on TensorFlow 2.0 framework.
Semantic segmentation models with 500+ pretrained convolutional and transformer-based backbones.
A very simple framework for state-of-the-art Natural Language Processing (NLP)
Stock AI Trader: 1-stop platform for learning, sim & live trading. Covers: stock basics, strategies, LLMs, factor…