Top Language Model repositories

Repositories with the GitHub topic “language-model”: 28 repositories with 744k stars between them, mostly written in Python, TypeScript and Jupyter Notebook. The highest-rated is microsoft/generative-ai-for-beginners, #69 on the bestofgithub Elo ladder.

Biggest movers this week

neuml/txtai

Open on GitHubPython

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

  • 1,752−1 Elo, change today
  • 13.4k stars
  • 1k forks
  • 115 watchers
git
git clone https://github.com/neuml/txtai.git
  • agents
  • ai
  • ai-agents
  • embeddings

qingjian-team/qingjian

Open on GitHubRust

青简 Qingjian:用 Rust 写的拼音输入法,候选词旁多一条正在学的语言的译词

  • 1,744+2 Elo, change today
  • 7.8k stars
  • 682 forks
  • 16 watchers
git
git clone https://github.com/qingjian-team/qingjian.git
  • chinese
  • chinese-input-method
  • english-learning
  • ime

huggingface/tokenizers

Open on GitHubRust

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

  • 1,578+3 Elo, change today
  • 11.2k stars
  • 1.2k forks
git
git clone https://github.com/huggingface/tokenizers.git
  • bert
  • gpt
  • language-model
  • natural-language-processing

mlc-ai/mlc-llm

Open on GitHubPython

Universal LLM Deployment Engine with ML Compilation

  • 1,731+14 Elo, change today
  • 23.4k stars
  • 2.2k forks
  • 271 watchers
git
git clone https://github.com/mlc-ai/mlc-llm.git
  • language-model
  • llm
  • machine-learning-compilation
  • tvm

vercel/ai

Open on GitHubTypeScript

The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents

  • 1,958+12 Elo, change today
  • 27.9k stars
  • 5.6k forks
  • 155 watchers
git
git clone https://github.com/vercel/ai.git
  • anthropic
  • artificial-intelligence
  • gemini
  • generative-ai

EleutherAI/gpt-neox

Open on GitHubPython

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

  • 1,396±0 Elo, change today
  • 7.4k stars
  • 1.1k forks
git
git clone https://github.com/EleutherAI/gpt-neox.git
  • deepspeed-library
  • gpt-3
  • language-model
  • transformers

Top 28 on the Elo ladder

  1. #69
    microsoft/generative-ai-for-beginners

    21 Lessons, Get Started Building with Generative AI

    2,286 Elo −50123kJupyter Notebook
  2. #147
    rasbt/LLMs-from-scratch

    Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

    2,172 Elo +1108kJupyter Notebook
  3. #405
    dair-ai/Prompt-Engineering-Guide

    🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.

    2,013 Elo −1880.1kMDX
  4. #545
    vercel/ai

    The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building…

    1,958 Elo +2927.9kTypeScript
  5. #1,076
    xtekky/gpt4free

    The official gpt4free repository | various collection of powerful language models | opus 4.6 gpt 5.3 kimi 2.5 deepseek…

    1,844 Elo −3967kPython
  6. #1,185
    yamadashy/repomix

    📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you…

    1,829 Elo +429.2kTypeScript
  7. #1,663
    EleutherAI/lm-evaluation-harness

    A framework for few-shot evaluation of language models.

    1,765 Elo −1314.4kPython
  8. #1,779
    neuml/txtai

    💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

    1,752 Elo +17013.4kPython
  9. #1,854
    qingjian-team/qingjian

    青简 Qingjian:用 Rust 写的拼音输入法,候选词旁多一条正在学的语言的译词

    1,744 Elo +867.8kRust
  10. #1,964
    mlc-ai/mlc-llm

    Universal LLM Deployment Engine with ML Compilation

    1,731 Elo +3023.4kPython
  11. #2,586
    huggingface/speech-to-speech

    Build voice agents with open-source models

    1,668 Elo +413.6kPython
  12. #3,191
    mlc-ai/web-llm

    High-performance In-browser LLM Inference Engine

    1,624 Elo −2519.3kTypeScript
  13. #3,227
    LAION-AI/Open-Assistant

    OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve…

    1,622 Elo +1237.3kPython
  14. #3,343
    arc53/DocsGPT

    Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document…

    1,615 Elo −3818.3kPython
  15. #3,416
    tatsu-lab/stanford_alpaca

    Code and documentation to train Stanford's Alpaca models, and generate the data.

    1,610 Elo −6830.2kPython
  16. #3,804
    mlfoundations/open_clip

    An open source implementation of CLIP.

    1,585 Elo +1314.2kPython
  17. #3,919
    huggingface/tokenizers

    💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

    1,578 Elo +4111.2kRust
  18. #4,329
    speechbrain/speechbrain

    A PyTorch-based Speech Toolkit

    1,555 Elo −311.9kPython
  19. #4,413
    microsoft/LoRA

    Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

    1,550 Elo −1813.9kPython
  20. #5,967
    BlinkDL/RWKV-LM

    RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT…

    1,475 Elo −3414.7kPython
  21. #7,405
    brightmart/nlp_chinese_corpus

    大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP

    1,417 Elo −219.9k
  22. #7,620
    OpenNMT/OpenNMT-py

    Open Source Neural Machine Translation and (Large) Language Models in PyTorch

    1,410 Elo −227kPython
  23. #7,989
    EleutherAI/gpt-neox

    An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

    1,396 Elo +167.4kPython
  24. #8,341
    BlinkDL/ChatRWKV

    ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

    1,382 Elo −89.4kPython
  25. #8,574
    EleutherAI/gpt-neo

    An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

    1,372 Elo −168.2kPython
  26. #8,791
    OptimalScale/LMFlow

    An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

    1,362 Elo −228.4kPython
  27. #9,242
    codertimo/BERT-pytorch

    Google AI 2018 BERT pytorch implementation

    1,337 Elo −126.5kPython
  28. #9,811
    zai-org/CogVLM

    a state-of-the-art-level open visual language model | 多模态预训练模型

    1,273 Elo −166.7kPython