Platinum III
1,695 Elo
- #2,308 on the ladder
- −6 today · −61 this week
- Peak 1,791
本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)
liguodongiot/llm-action is #2,308 on the bestofgithub Elo ladder, in Platinum III, with a rating of 1,695 (−61 this week). It has 25,278 stars, 16 gained in the last week.
1,695 Elo
25,278
git clone https://github.com/liguodongiot/llm-action.git《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
git clone https://github.com/bojieli/ai-infra-book.gitThe easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
git clone https://github.com/bentoml/BentoML.gitSupercharge Your LLM Application Evaluations 🚀
pipx install ragasOfficial inference library for Mistral models
git clone https://github.com/mistralai/mistral-inference.git20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
git clone https://github.com/Lightning-AI/litgpt.gitRun any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
git clone https://github.com/bentoml/OpenLLM.gitLoading README…