bestofgithub.dev

← Back to the directory

triton-inference-server/server

View on GitHub

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

triton-inference-server/server is #4,979 on the bestofgithub Elo ladder, in Gold V, with a rating of 1,520 (−1 this week). It has 11,144 stars, 11 gained in the last week.

Gold V

1,520 Elo

  • #4,979 on the ladder
  • ±0 today · −1 this week
  • Peak 1,556
18 Elo to Gold IV

Stars

11,144

  • +2 today
  • +11 this week
  • – this month

Repository

Forks
1.8k
Language
Python
Last push
Category
AI & Agents

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/triton-inference-server/server.svg?style=card)](https://bestofgithub.dev/repo/triton-inference-server/server)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/triton-inference-server/server.svg)](https://bestofgithub.dev/repo/triton-inference-server/server)

Install

git
git clone https://github.com/triton-inference-server/server.git

Similar repositories

openai/CLIP

Open on GitHubJupyter Notebook

CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

  • 1,769−12 Elo, change today
  • 34.6k stars
  • 4k forks
  • 322 watchers
git
git clone https://github.com/openai/CLIP.git
  • deep-learning
  • machine-learning

apple/turicreate

Open on GitHubC++

Turi Create simplifies the development of custom machine learning models.

  • 1,418−5 Elo, change today
  • 11.1k stars
  • 1.1k forks
  • archived
git
git clone https://github.com/apple/turicreate.git
  • deep-learning
  • machine-learning
  • python

FlashML-org/FreeToken

Open on GitHubPython

FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.

  • 1,944−6 Elo, change today
  • 17.2k stars
  • 1.7k forks
  • 104 watchers
pip
pipx install freetoken
v0.2.26d ago
  • deepseek-v4
  • edge
  • glm
  • inference

alexellis/k3sup

Open on GitHubGo

bootstrap K3s over SSH in < 60s 🚀

  • 1,347−3 Elo, change today
  • 7.4k stars
  • 433 forks
git
git clone https://github.com/alexellis/k3sup.git
  • cloud
  • cloud-native
  • devops
  • devtools

README

Loading README…