flashinfer-ai/flashinfer

• Gold I

CUDA Templates and Python DSLs for High-Performance Linear Algebra

• 1,609−12 Elo, change today
• 10.7k stars
• 2.1k forks
• 9d ago

git clone https://github.com/NVIDIA/cutlass.git

• cpp
• cuda
• deep-learning
• deep-learning-library

• Platinum I

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

• 1,742−10 Elo, change today
• 15k stars
• 2.9k forks
• 119 watchers
• 7h ago

git clone https://github.com/NVIDIA/TensorRT-LLM.git

• blackwell
• cuda
• llm-serving
• moe

• Bronze III

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

• 1,398−4 Elo, change today
• 8.8k stars
• 1.4k forks
• 9mo ago
• archived

git clone https://github.com/intel/ipex-llm.git

• gpu
• llm
• pytorch
• transformers

• Silver V

A PyTorch implementation of the Transformer model in "Attention is All You Need".

• 1,440−5 Elo, change today
• 9.8k stars
• 2k forks
• 2y ago

git clone https://github.com/jadore801120/attention-is-all-you-need-pytorch.git

• attention
• attention-is-all-you-need
• deep-learning
• natural-language-processing

• Gold V

A Python framework for GPU-accelerated simulation, robotics, and machine learning.

• 1,527+8 Elo, change today
• 7.3k stars
• 697 forks
• 2h ago

git clone https://github.com/NVIDIA/warp.git

• cuda
• differentiable-programming
• gpu
• gpu-acceleration