bestofgithub.dev

← Back to the directory

google-ai-edge/LiteRT-LM

View on GitHub

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

google-ai-edge/LiteRT-LM is #4,084 on the bestofgithub Elo ladder, in Gold III, with a rating of 1,569 (+73 this week). It has 6,889 stars, 47 gained in the last week.

Gold III

1,569 Elo

  • #4,084 on the ladder
  • +12 today · +73 this week
  • Peak 1,569
11 Elo to Gold II

Stars

6,889

  • +7 today
  • +47 this week
  • – this month

Repository

Forks
795
Language
C++
Last push

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/google-ai-edge/LiteRT-LM.svg?style=card)](https://bestofgithub.dev/repo/google-ai-edge/LiteRT-LM)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/google-ai-edge/LiteRT-LM.svg)](https://bestofgithub.dev/repo/google-ai-edge/LiteRT-LM)

Install

git
git clone https://github.com/google-ai-edge/LiteRT-LM.git

Similar repositories

Edge0-AI/Edge0

Open on GitHubC++

Device-native foundation models: 145B on a laptop, 35B on a phone. Latent MoE, SSD-streamed weights, a router that predicts loads a step ahead. Mac, iPhone, Android, Windows.

  • 1,953+44 Elo, change today
  • +274 stars gained
  • 11.7k stars
  • 1.8k forks
  • 850 watchers
git
git clone https://github.com/Edge0-AI/Edge0.git
v0.2.04d ago
  • edge-ai
  • foundation-model
  • on-device-ai

drumih/turbo-fieldfare

Open on GitHubSwift

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

  • 1,634+17 Elo, change today
  • 7.3k stars
  • 480 forks
git
git clone https://github.com/drumih/turbo-fieldfare.git
  • apple-silicon
  • gemma
  • gemma4
  • gemma4-26b-a4b

cactus-compute/cactus

Open on GitHubPython

Sub-50mb agentic, voice and vision intelligence for consumer devices.

  • 1,802+9 Elo, change today
  • 14.7k stars
  • 1k forks
  • 82 watchers
pip
pipx install cactus-compute
  • cactus
  • edge-ai
  • foundation-model
  • function-calling

README

Loading README…