← Back to the directory

kvcache-ai/Mooncake

View on GitHub

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

kvcache-ai/Mooncake is #2,882 on the bestofgithub Elo ladder, in Platinum V, with a rating of 1,646 (+53 this week). It has 7,045 stars, 41 gained in the last week.

Platinum V

1,646 Elo

  • #2,882 on the ladder
  • +2 today · +53 this week
  • Peak 1,646
1 Elo to Platinum IV

Stars

7,045

  • +5 today
  • +41 this week
  • – this month

Repository

Forks
1.4k
Language
C++
Last push
Category
AI & Agents

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/kvcache-ai/Mooncake.svg?style=card)](https://bestofgithub.dev/repo/kvcache-ai/Mooncake)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/kvcache-ai/Mooncake.svg)](https://bestofgithub.dev/repo/kvcache-ai/Mooncake)

Install

git
git clone https://github.com/kvcache-ai/Mooncake.git

Similar repositories

eagle-hq/EAGLE-4

Open on GitHubPython

Official Inference Code of EAGLE-4

  • 692−20 Elo, change today
  • 1.2k stars
  • 43 forks
git
git clone https://github.com/eagle-hq/EAGLE-4.git
  • eagle
  • gpu
  • llm-inference
  • sglang

xorbitsai/inference

Open on GitHubPython

Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.

  • 1,479+8 Elo, change today
  • 9.6k stars
  • 901 forks
git
git clone https://github.com/xorbitsai/inference.git
  • artificial-intelligence
  • diffusers
  • gemma
  • glm

README

Loading README…