← Back to the directory

mistralai/mistral-inference

View on GitHub

Official inference library for Mistral models

mistralai/mistral-inference is #7,210 on the bestofgithub Elo ladder, in Bronze I, with a rating of 1,425 (−13 this week). It has 10,814 stars.

Bronze I

1,425 Elo

  • #7,210 on the ladder
  • −3 today · −13 this week
  • Peak 1,495
7 Elo to Silver V

Stars

10,814

  • +0 today
  • +0 this week
  • – this month

Repository

Forks
1k
Language
Jupyter Notebook
Last push
Category
AI & Agents
Status
Archived

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/mistralai/mistral-inference.svg?style=card)](https://bestofgithub.dev/repo/mistralai/mistral-inference)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/mistralai/mistral-inference.svg)](https://bestofgithub.dev/repo/mistralai/mistral-inference)

Install

git
git clone https://github.com/mistralai/mistral-inference.git

Similar repositories

Lightning-AI/litgpt

Open on GitHubPython

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

  • 1,530±0 Elo, change today
  • 13.7k stars
  • 1.5k forks
git
git clone https://github.com/Lightning-AI/litgpt.git
  • ai
  • artificial-intelligence
  • deep-learning
  • large-language-models

Tiiny-AI/PowerInfer

Open on GitHubC++

High-speed Large Language Model Serving for Local Deployment

  • 1,484+2 Elo, change today
  • 9.8k stars
  • 619 forks
git
git clone https://github.com/Tiiny-AI/PowerInfer.git
  • large-language-models
  • llama
  • llm
  • llm-inference

liguodongiot/llm-action

Open on GitHubHTML

本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)

  • 1,695−6 Elo, change today
  • 25.2k stars
  • 2.8k forks
  • 200 watchers
git
git clone https://github.com/liguodongiot/llm-action.git
  • llm
  • llm-inference
  • llm-serving
  • llm-training

README

Loading README…