bestofgithub.dev

← Back to the directory

bentoml/BentoML

View on GitHub

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

bentoml/BentoML is #6,666 on the bestofgithub Elo ladder, in Silver V, with a rating of 1,446 (+12 this week). It has 8,941 stars, 7 gained in the last week.

Silver V

1,446 Elo

  • #6,666 on the ladder
  • +2 today · +12 this week
  • Peak 1,458
1 Elo to Silver IV

Stars

8,941

  • +0 today
  • +7 this week
  • – this month

Repository

Forks
1k
Language
Python
Last push
Category
AI & Agents

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/bentoml/BentoML.svg?style=card)](https://bestofgithub.dev/repo/bentoml/BentoML)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/bentoml/BentoML.svg)](https://bestofgithub.dev/repo/bentoml/BentoML)

Install

git
git clone https://github.com/bentoml/BentoML.git

Similar repositories

liguodongiot/llm-action

Open on GitHubHTML

本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

  • 1,695−6 Elo, change today
  • 25.2k stars
  • 2.8k forks
  • 200 watchers
git
git clone https://github.com/liguodongiot/llm-action.git
  • llm
  • llm-inference
  • llm-serving
  • llm-training

tensorzero/tensorzero

Open on GitHubRust

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

  • 1,406−2 Elo, change today
  • 11.7k stars
  • 966 forks
  • archived
git
git clone https://github.com/tensorzero/tensorzero.git
  • ai
  • ai-engineering
  • anthropic
  • artificial-intelligence

jina-ai/serve

Open on GitHubPython

☁️ Build multimodal AI applications with cloud-native stack

  • 1,568−5 Elo, change today
  • 21.8k stars
  • 2.2k forks
git
git clone https://github.com/jina-ai/serve.git
  • cloud-native
  • cncf
  • deep-learning
  • docker

Lightning-AI/litgpt

Open on GitHubPython

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

  • 1,530±0 Elo, change today
  • 13.7k stars
  • 1.5k forks
git
git clone https://github.com/Lightning-AI/litgpt.git
  • ai
  • artificial-intelligence
  • deep-learning
  • large-language-models

bentoml/OpenLLM

Open on GitHubPython

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

  • 1,504−8 Elo, change today
  • 12.6k stars
  • 848 forks
git
git clone https://github.com/bentoml/OpenLLM.git
  • bentoml
  • fine-tuning
  • llama
  • llama2

GoogleCloudPlatform/agent-starter-pack

Open on GitHub

Ship AI Agents to Google Cloud in minutes, not months. Production-ready templates with built-in CI/CD, evaluation, and observability.

  • 1,365−2 Elo, change today
  • 6.5k stars
  • 1.4k forks
  • archived
git
git clone https://github.com/GoogleCloudPlatform/agent-starter-pack.git
  • agents
  • gcp
  • gemini
  • genai-agents

README

Loading README…