bestofgithub.dev

← Back to the directory

wici-ai/inferssd

View on GitHub

Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

wici-ai/inferssd is #10,083 on the bestofgithub Elo ladder, in Copper V, with a rating of 838 (+72 this week). It has 1,179 stars.

Copper V

838 Elo

  • #10,083 on the ladder
  • +65 today · +72 this week
  • Peak 838
113 Elo to Copper IV

Stars

1,179

  • +62 today
  • – this week
  • – this month

Repository

Forks
99
Language
C++
Last push
Category
AI & Agents

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/wici-ai/inferssd.svg?style=card)](https://bestofgithub.dev/repo/wici-ai/inferssd)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/wici-ai/inferssd.svg)](https://bestofgithub.dev/repo/wici-ai/inferssd)

Install

git
git clone https://github.com/wici-ai/inferssd.git

Similar repositories

synchopate/llama-modchip

Open on GitHubPython

Run 284B DeepSeek-V4-Flash (<59GiB RAM: 41.1 cold pp, 9.1 N=1 tg, up to 25.3 spec tok/s) & 30B MoEs (22.4 N=1 / 111.6 spec tok/s) on 64GB CPU (0 GPUs).

  • 885+18 Elo, change today
  • 1.2k stars
  • 112 forks
git
git clone https://github.com/synchopate/llama-modchip.git
  • ai-agents
  • apple-silicon
  • avx512
  • claude-code

dgraph-io/badger

Open on GitHubGo

Fast key-value DB in Go.

  • 1,524+3 Elo, change today
  • 15.8k stars
  • 1.3k forks
git
git clone https://github.com/dgraph-io/badger.git
  • database
  • document-database
  • go
  • golang

drumih/turbo-fieldfare

Open on GitHubSwift

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

  • 1,634+17 Elo, change today
  • 7.3k stars
  • 480 forks
git
git clone https://github.com/drumih/turbo-fieldfare.git
  • apple-silicon
  • gemma
  • gemma4
  • gemma4-26b-a4b

AlexsJones/llmfit

Open on GitHubRust

Hundreds of models & providers. One command to find what runs on your hardware.

  • 1,939−15 Elo, change today
  • 39k stars
  • 2.5k forks
  • 113 watchers
brew
brew install llmfit
v1.1.2012d ago
  • gguf
  • llm
  • localai
  • mlx

altic-dev/FluidVoice

Open on GitHubSwift

Fastest and only macOS Dictation app with on-device STT and custom trained AI enhancement model. Windows, iOS testflight! Android, Linux waitlist open! A local Wispr Flow alternative. Follow https://x.com/fluidvoiceapp for more

  • 1,825+16 Elo, change today
  • 13k stars
  • 985 forks
  • 47 watchers
brew
brew install --cask fluidvoice
v1.6.132d ago
  • ai
  • dictation
  • ios
  • llama-cpp

README

Loading README…