← Back to the directory

jundot/omlx

View on GitHub

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

jundot/omlx is #725 on the bestofgithub Elo ladder, in Emerald I, with a rating of 1,911 (+28 this week). It has 23,654 stars, 185 gained in the last week.

Emerald I

1,911 Elo

  • #725 on the ladder
  • +1 today · +28 this week
  • Peak 1,912
3 Elo to Diamond V

Stars

23,654

  • +14 today
  • +185 this week
  • – this month

Repository

Forks
2.1k
Watchers
113
Language
Python
Last push
Category
AI & Agents

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/jundot/omlx.svg?style=card)](https://bestofgithub.dev/repo/jundot/omlx)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/jundot/omlx.svg)](https://bestofgithub.dev/repo/jundot/omlx)

Install

git
git clone https://github.com/jundot/omlx.git

Similar repositories

Neywa-Labs/mlx-audio

Open on GitHubPython

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

  • 1,585+7 Elo, change today
  • 8.2k stars
  • 795 forks
git
git clone https://github.com/Neywa-Labs/mlx-audio.git
  • apple-silicon
  • audio-processing
  • mlx
  • multimodal

mizorewww/laya-mlx

Open on GitHubPython

Native MLX runtime for Laya typed decision models — 7–14 ms short decisions on M3 Max. No text generation, PyTorch, or cloud API.

  • 1,457−4 Elo, change today
  • 7.1k stars
  • 576 forks
git
git clone https://github.com/mizorewww/laya-mlx.git
  • apple-silicon
  • decision-model
  • inference
  • laya

openai/openai-cookbook

Open on GitHubJupyter Notebook

Examples and guides for using the OpenAI API

  • 1,995+12 Elo, change today
  • 77.1k stars
  • 13k forks
  • 1k watchers
git
git clone https://github.com/openai/openai-cookbook.git
  • chatgpt
  • gpt-4
  • openai
  • openai-api

README

Loading README…