Top Transformers repositories

Biggest movers this week

git clone https://github.com/neuml/txtai.git

git clone https://github.com/Neywa-Labs/mlx-audio.git

git clone https://github.com/niedev/RTranslator.git

git clone https://github.com/argosopentech/argos-translate.git

pipx install soup-cli

git clone https://github.com/data-privacy-stack/presidio && cd presidio && docker compose up -d

Top 41 on the Elo ladder

1. #69
   microsoft/generative-ai-for-beginners

   21 Lessons, Get Started Building with Generative AI

   • Legendary #69

   2,286 Elo −50123kJupyter Notebook
2. #82
   rohitg00/ai-engineering-from-scratch

   Learn AI Engineering! Learn it. Build it. Ship it for others.

   • Legendary #82

   2,265 Elo −1379kPython
3. #147
   rasbt/LLMs-from-scratch

   Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

   • Diamond I

   2,172 Elo +1108kJupyter Notebook
4. #507
   hiyouga/LlamaFactory

   Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

   • Diamond IV

   1,972 Elo −1976kPython
5. #1,010
   MakazhanAlpamys/Soup

   Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

   • Emerald II

   1,854 Elo +5210.5kPython
6. #1,211
   labmlai/annotated_deep_learning_paper_implementations

   🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original…

   • Emerald III

   1,826 Elo −10567.7kPython
7. #1,435
   NVIDIA/Megatron-LM

   Ongoing research training transformer models at scale

   • Emerald IV

   1,793 Elo −318.4kPython
8. #1,551
   data-privacy-stack/presidio

   An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images…

   • Emerald V

   1,778 Elo +5211.8kPython
9. #1,779
   neuml/txtai

   💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

   • Platinum I

   1,752 Elo +17013.4kPython
10. #1,856
    FareedKhan-dev/train-llm-from-scratch

    A straightforward method for training your LLM, from downloading data to generating text.

    • Platinum I

    1,744 Elo +2413.2kPython
11. #2,497
    huggingface/peft

    🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

    • Platinum III

    1,676 Elo −2121.8kPython
12. #2,530
    openvinotoolkit/openvino

    OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

    • Platinum III

    1,673 Elo +1211.1kC++
13. #2,539
    stas00/ml-engineering

    Machine Learning Engineering Open Book

    • Platinum III

    1,672 Elo −119.7kPython
14. #2,880
    lucidrains/vit-pytorch

    Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single…

    • Platinum V

    1,646 Elo −4725.5kPython
15. #3,280
    amusi/CVPR2026-Papers-with-Code

    CVPR 2026 论文和开源项目合集

    • Gold I

    1,618 Elo −4822.9k
16. #3,343
    arc53/DocsGPT

    Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document…

    • Gold I

    1,615 Elo −3818.3kPython
17. #3,603
    NVlabs/Sana

    SANA & Sol: Efficient Generative Models and Full-Stack Training & Inference Engines for Image, Video, and World Modeling

    • Gold II

    1,598 Elo +389.8kPython
18. #3,788
    huggingface/transformers.js

    State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!

    • Gold II

    1,586 Elo −1816.4kJavaScript
19. #3,805
    Neywa-Labs/mlx-audio

    A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework…

    • Gold II

    1,585 Elo +788.2kPython
20. #3,919
    huggingface/tokenizers

    💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

    • Gold III

    1,578 Elo +4111.2kRust
21. #4,008
    niedev/RTranslator

    Open source real-time translation app for Android that runs locally

    • Gold III

    1,573 Elo +7210.6kJava
22. #4,329
    speechbrain/speechbrain

    A PyTorch-based Speech Toolkit

    • Gold IV

    1,555 Elo −311.9kPython
23. #4,854
    PaddlePaddle/PaddleNLP

    Easy-to-use and powerful LLM and SLM library with awesome model zoo.

    • Gold V

    1,526 Elo −1912.9kPython
24. #4,862
    amazon-science/chronos-forecasting

    Chronos: Pretrained Models for Time Series Forecasting

    • Gold V

    1,526 Elo +456.3kPython
25. #5,144
    OpenRLHF/OpenRLHF

    An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS…

    • Silver I

    1,512 Elo +1410.1kPython
26. #5,193
    qubvel-org/segmentation_models.pytorch

    Semantic segmentation models with 500+ pretrained convolutional and transformer-based backbones.

    • Silver I

    1,510 Elo −1411.8kPython
27. #5,869
    xorbitsai/inference

    Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with…

    • Silver III

    1,479 Elo −29.6kPython
28. #5,967
    BlinkDL/RWKV-LM

    RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT…

    • Silver III

    1,475 Elo −3414.7kPython
29. #6,043
    NielsRogge/Transformers-Tutorials

    This repository contains demos I made with the Transformers library by HuggingFace.

    • Silver III

    1,471 Elo −3411.7kJupyter Notebook
30. #6,153
    MaartenGr/BERTopic

    Leveraging BERT and c-TF-IDF to create easily interpretable topics.

    • Silver III

    1,467 Elo +157.9kPython
31. #6,868
    argosopentech/argos-translate

    Open-source offline translation library written in Python

    • Silver V

    1,438 Elo +626.6kPython
32. #7,924
    intel/ipex-llm

    Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM…

    • Bronze III

    1,398 Elo −168.8kPython
33. #7,989
    EleutherAI/gpt-neox

    An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

    • Bronze III

    1,396 Elo +167.4kPython
34. #8,119
    vladmandic/sdnext

    SD.Next: All-in-one WebUI for AI generative image and video creation, captioning and processing

    • Bronze III

    1,391 Elo +107.3kPython
35. #8,226
    jessevig/bertviz

    BertViz: Visualize Attention in Transformer Models

    • Bronze IV

    1,386 Elo −18.2kPython
36. #8,574
    EleutherAI/gpt-neo

    An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

    • Bronze V

    1,372 Elo −168.2kPython
37. #8,604
    FoundationVision/VAR

    [NeurIPS 2024 Best Paper Award][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual…

    • Bronze V

    1,370 Elo +58.7kJupyter Notebook
38. #8,675
    argmaxinc/argmax-oss-swift

    On-device Speech AI for Apple Silicon

    • Bronze V

    1,367 Elo +216.4kSwift
39. #9,176
    lucidrains/PaLM-rlhf-pytorch

    Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT…

    • Copper II

    1,340 Elo −67.8kPython
40. #9,481
    SkalskiP/courses

    This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)

    • Copper III

    1,320 Elo −86.4kPython
41. #10,154
    divagr18/qwenputer

    A computer, compiled into the weights of a language model. An exact CPU inside Qwen3.5-4B, with Gated DeltaNet state as…

    • Copper V

    734 Elo −5814Python