bestofgithub.dev

← Back to the directory

InternLM/lmdeploy

View on GitHub

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

InternLM/lmdeploy is #6,652 on the bestofgithub Elo ladder, in Silver V, with a rating of 1,446 (+25 this week). It has 8,143 stars, 8 gained in the last week.

Silver V

1,446 Elo

  • #6,652 on the ladder
  • +12 today · +25 this week
  • Peak 1,446
1 Elo to Silver IV

Stars

8,143

  • +1 today
  • +8 this week
  • – this month

Repository

Forks
781
Language
Python
Last push
Category
AI & Agents

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/InternLM/lmdeploy.svg?style=card)](https://bestofgithub.dev/repo/InternLM/lmdeploy)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/InternLM/lmdeploy.svg)](https://bestofgithub.dev/repo/InternLM/lmdeploy)

Install

git
git clone https://github.com/InternLM/lmdeploy.git

Similar repositories

yangjianxin1/Firefly

Open on GitHubPython

Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

  • 1,300−3 Elo, change today
  • 6.6k stars
  • 583 forks
git
git clone https://github.com/yangjianxin1/Firefly.git
  • alpaca
  • aquila
  • baichuan
  • chatglm

getumbrel/llama-gpt

Open on GitHubTypeScript

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

  • 1,392−2 Elo, change today
  • 10.9k stars
  • 701 forks
git
git clone https://github.com/getumbrel/llama-gpt.git
  • ai
  • chatgpt
  • code-llama
  • codellama

Tiiny-AI/PowerInfer

Open on GitHubC++

High-speed Large Language Model Serving for Local Deployment

  • 1,484+2 Elo, change today
  • 9.8k stars
  • 619 forks
git
git clone https://github.com/Tiiny-AI/PowerInfer.git
  • large-language-models
  • llama
  • llm
  • llm-inference

cocktailpeanut/dalai

Open on GitHubCSS

The simplest way to run LLaMA on your local machine

  • 1,444−4 Elo, change today
  • 12.8k stars
  • 1.3k forks
git
git clone https://github.com/cocktailpeanut/dalai.git
  • ai
  • llama
  • llm

higgsfield-ai/higgsfield

Open on GitHubJupyter Notebook

Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters

  • 1,586+9 Elo, change today
  • 6.3k stars
  • 1.2k forks
  • archived
git
git clone https://github.com/higgsfield-ai/higgsfield.git
  • cluster-management
  • deep-learning
  • distributed
  • llama

meta-llama/llama-cookbook

Open on GitHubJupyter Notebook

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services

  • 1,607−9 Elo, change today
  • 18.5k stars
  • 2.7k forks
git
git clone https://github.com/meta-llama/llama-cookbook.git
  • ai
  • finetuning
  • langchain
  • llama

README

Loading README…