bestofgithub.dev

← Back to the directory

magnitudedev/magnitude

View on GitHub

Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.

magnitudedev/magnitude is #3,150 on the bestofgithub Elo ladder, in Platinum V, with a rating of 1,626 (+71 this week). It has 7,847 stars, 94 gained in the last week.

Platinum V

1,626 Elo

  • #3,150 on the ladder
  • +21 today · +71 this week
  • Peak 1,626
21 Elo to Platinum IV

Stars

7,847

  • +43 today
  • +94 this week
  • – this month

Repository

Forks
570
Language
Rust
Last push

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/magnitudedev/magnitude.svg?style=card)](https://bestofgithub.dev/repo/magnitudedev/magnitude)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/magnitudedev/magnitude.svg)](https://bestofgithub.dev/repo/magnitudedev/magnitude)

Install

git
git clone https://github.com/magnitudedev/magnitude.git

README

Loading README…