Tiiny-AI/PowerInfer

• Gold V

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

• 1,530±0 Elo, change today
• 13.7k stars
• 1.5k forks
• 5d ago

git clone https://github.com/Lightning-AI/litgpt.git

• ai
• artificial-intelligence
• deep-learning
• large-language-models

• Silver V

The simplest way to run LLaMA on your local machine

• 1,444−4 Elo, change today
• 12.8k stars
• 1.3k forks
• 2y ago

git clone https://github.com/cocktailpeanut/dalai.git

• ai
• llama
• llm

• Copper II

A series of large language models trained from scratch by developers @01-ai

• 1,331+11 Elo, change today
• 7.8k stars
• 500 forks
• 1y ago

git clone https://github.com/01-ai/Yi.git

• large-language-models

• Emerald III

Automated Penetration Testing Agentic Framework Powered by Large Language Models

• 1,834−4 Elo, change today
• 16.4k stars
• 2.8k forks
• 378 watchers
• 4mo ago

pipx install pentestgpt

• large-language-models
• llm
• penetration-testing
• python

• Bronze I

Official inference library for Mistral models

• 1,425−3 Elo, change today
• 10.8k stars
• 1k forks
• 5mo ago
• archived

git clone https://github.com/mistralai/mistral-inference.git

• llm
• llm-inference
• mistralai

• Platinum I

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

• 1,752−12 Elo, change today
• 77.3k stars
• 8.2k forks
• 693 watchers
• 1y ago

brew install --cask gpt4all

• ai-chat
• llm-inference