← Back to the directory

FMInference/FlexLLMGen

View on GitHub

Running large language models on a single GPU for throughput-oriented scenarios.

FMInference/FlexLLMGen is #9,115 on the bestofgithub Elo ladder, in Copper I, with a rating of 1,344 (−25 this week). It has 9,336 stars.

Copper I

1,344 Elo

  • #9,115 on the ladder
  • −1 today · −25 this week
  • Peak 1,417
13 Elo to Bronze V

Stars

9,336

  • +0 today
  • +0 this week
  • – this month

Repository

Forks
588
Language
Python
Last push
Category
AI & Agents
Status
Archived

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/FMInference/FlexLLMGen.svg?style=card)](https://bestofgithub.dev/repo/FMInference/FlexLLMGen)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/FMInference/FlexLLMGen.svg)](https://bestofgithub.dev/repo/FMInference/FlexLLMGen)

Install

git
git clone https://github.com/FMInference/FlexLLMGen.git

Similar repositories

01-ai/Yi

Open on GitHubJupyter Notebook

A series of large language models trained from scratch by developers @01-ai

  • 1,331+11 Elo, change today
  • 7.8k stars
  • 500 forks
git
git clone https://github.com/01-ai/Yi.git
  • large-language-models

openai/CLIP

Open on GitHubJupyter Notebook

CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

  • 1,769−12 Elo, change today
  • 34.6k stars
  • 4k forks
  • 322 watchers
git
git clone https://github.com/openai/CLIP.git
  • deep-learning
  • machine-learning

apple/turicreate

Open on GitHubC++

Turi Create simplifies the development of custom machine learning models.

  • 1,418−5 Elo, change today
  • 11.1k stars
  • 1.1k forks
  • archived
git
git clone https://github.com/apple/turicreate.git
  • deep-learning
  • machine-learning
  • python

mrdbourke/pytorch-deep-learning

Open on GitHubJupyter Notebook

Materials for the Learn PyTorch for Deep Learning: Zero to Mastery course.

  • 1,749+2 Elo, change today
  • 19.4k stars
  • 5.2k forks
  • 155 watchers
git
git clone https://github.com/mrdbourke/pytorch-deep-learning.git
  • deep-learning
  • machine-learning
  • pytorch

README

Loading README…