bestofgithub.dev

← Back to the directory

bentoml/OpenLLM

View on GitHub

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

bentoml/OpenLLM is #5,339 on the bestofgithub Elo ladder, in Silver I, with a rating of 1,504 (+9 this week). It has 12,601 stars, 14 gained in the last week.

Silver I

1,504 Elo

  • #5,339 on the ladder
  • −8 today · +9 this week
  • Peak 1,530
16 Elo to Gold V

Stars

12,601

  • +1 today
  • +14 this week
  • – this month

Repository

Forks
848
Language
Python
Last push
Category
AI & Agents

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/bentoml/OpenLLM.svg?style=card)](https://bestofgithub.dev/repo/bentoml/OpenLLM)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/bentoml/OpenLLM.svg)](https://bestofgithub.dev/repo/bentoml/OpenLLM)

Install

git
git clone https://github.com/bentoml/OpenLLM.git

Similar repositories

liguodongiot/llm-action

Open on GitHubHTML

本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

  • 1,695−6 Elo, change today
  • 25.2k stars
  • 2.8k forks
  • 200 watchers
git
git clone https://github.com/liguodongiot/llm-action.git
  • llm
  • llm-inference
  • llm-serving
  • llm-training

ludwig-ai/ludwig

Open on GitHubPython

Low-code framework for building custom LLMs, neural networks, and other AI models

  • 1,433+3 Elo, change today
  • 11.7k stars
  • 1.2k forks
git
git clone https://github.com/ludwig-ai/ludwig.git
  • computer-vision
  • data-centric
  • data-science
  • deep

bentoml/BentoML

Open on GitHubPython

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

  • 1,446+2 Elo, change today
  • 8.9k stars
  • 1k forks
git
git clone https://github.com/bentoml/BentoML.git
  • ai-inference
  • deep-learning
  • generative-ai
  • inference-platform

higgsfield-ai/higgsfield

Open on GitHubJupyter Notebook

Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters

  • 1,586+9 Elo, change today
  • 6.3k stars
  • 1.2k forks
  • archived
git
git clone https://github.com/higgsfield-ai/higgsfield.git
  • cluster-management
  • deep-learning
  • distributed
  • llama

README

Loading README…