bestofgithub.dev

← Back to the directory

kvcache-ai/ktransformers

View on GitHub

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

kvcache-ai/ktransformers is #3,361 on the bestofgithub Elo ladder, in Gold I, with a rating of 1,613 (±0 this week). It has 19,676 stars, 17 gained in the last week.

Gold I

1,613 Elo

  • #3,361 on the ladder
  • +10 today · ±0 this week
  • Peak 1,681
13 Elo to Platinum V

Stars

19,676

  • +5 today
  • +17 this week
  • – this month

Repository

Forks
1.6k
Language
Python
Last push

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/kvcache-ai/ktransformers.svg?style=card)](https://bestofgithub.dev/repo/kvcache-ai/ktransformers)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/kvcache-ai/ktransformers.svg)](https://bestofgithub.dev/repo/kvcache-ai/ktransformers)

Install

git
git clone https://github.com/kvcache-ai/ktransformers.git

README

Loading README…