Top NLP repositories

Biggest movers this week

git clone https://github.com/neuml/txtai.git

git clone https://github.com/epoko77-ai/im-not-ai.git

git clone https://github.com/argosopentech/argos-translate.git

git clone https://github.com/data-privacy-stack/presidio && cd presidio && docker compose up -d

pipx install unstructured

git clone https://github.com/adbar/trafilatura.git

Top 81 on the Elo ladder

1. #135
   huggingface/transformers

   The reference library for pretrained text, vision and audio models: load, fine-tune and run thousands of checkpoints.

   • Diamond I

   2,186 Elo −5169kPython
2. #350
   microsoft/AI-For-Beginners

   12 Weeks, 24 Lessons, AI for All!

   • Diamond III

   2,038 Elo −2770.8kJupyter Notebook
3. #401
   NandhaKishorM/laya

   Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward…

   • Diamond III

   2,014 Elo −1335.5kPython
4. #507
   hiyouga/LlamaFactory

   Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

   • Diamond IV

   1,972 Elo −1976kPython
5. #808
   666ghj/BettaFish

   微舆：人人可用的多Agent舆情分析助手，打破信息茧房，还原舆情原貌，预测未来走向，辅助决策！从0实现，不依赖任何框架。

   • Emerald I

   1,893 Elo +2742.7kPython
6. #837
   ashishpatel26/500-AI-Machine-learning-Deep-learning-Computer-vision-NLP-Projects-with-code

   500 AI Machine learning Deep learning Computer vision NLP Projects with code

   • Emerald I

   1,887 Elo −2337.7k
7. #1,127
   NirDiamant/RAG_Techniques

   This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. Each technique…

   • Emerald III

   1,837 Elo −4730.3kJupyter Notebook
8. #1,277
   GeeeekExplorer/nano-vllm

   Nano vLLM

   • Emerald III

   1,816 Elo −116.4kPython
9. #1,320
   stanford-oval/storm

   An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.

   • Emerald III

   1,809 Elo −2731.8kPython
10. #1,551
    data-privacy-stack/presidio

    An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images…

    • Emerald V

    1,778 Elo +5211.8kPython
11. #1,693
    google/langextract

    A Python library for extracting structured information from unstructured text using LLMs with precise source grounding…

    • Emerald V

    1,761 Elo −6639.3kPython
12. #1,742
    AI4Finance-Foundation/FinGPT

    FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.

    • Platinum I

    1,756 Elo +1421.5kJupyter Notebook
13. #1,771
    huggingface/datasets

    🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

    • Platinum I

    1,752 Elo −422.1kPython
14. #1,779
    neuml/txtai

    💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

    • Platinum I

    1,752 Elo +17013.4kPython
15. #1,852
    explosion/spaCy

    💫 Industrial-strength Natural Language Processing (NLP) in Python

    • Platinum I

    1,744 Elo −5834kPython
16. #1,986
    AccumulateMore/CV

    ✅（已完结）超级全面的 深度学习 笔记【土堆 Pytorch】【李沐 动手学深度学习】【吴恩达 深度学习】【大飞 大模型Agent】

    • Platinum I

    1,729 Elo −6724.2kJupyter Notebook
17. #2,045
    apachecn/ailearning

    AiLearning：数据分析+机器学习实战+线性代数+PyTorch+NLTK+TF2

    • Platinum II

    1,722 Elo −7842.6kPython
18. #2,309
    Unstructured-IO/unstructured

    Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex…

    • Platinum III

    1,695 Elo +4615.7kHTML
19. #2,387
    hankcs/HanLP

    Natural Language Processing for the next decade. Tokenization, Part-of-Speech Tagging, Named Entity Recognition…

    • Platinum III

    1,687 Elo −7036.5kPython
20. #2,530
    openvinotoolkit/openvino

    OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

    • Platinum III

    1,673 Elo +1211.1kC++
21. #2,711
    keon/awesome-nlp

    :book: A curated list of resources dedicated to Natural Language Processing (NLP)

    • Platinum IV

    1,659 Elo −3519.1k
22. #2,817
    memvid/memvid

    Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give your agents…

    • Platinum IV

    1,651 Elo 17.4kRust
23. #3,116
    lukasmasuch/best-of-ml-python

    🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.

    • Platinum V

    1,628 Elo −4223.8k
24. #3,190
    google-research/bert

    TensorFlow code and pre-trained models for BERT

    • Gold I

    1,624 Elo −4340kPython
25. #3,215
    epoko77-ai/im-not-ai

    AI가 쓴 한글을 사람 글처럼 윤문하는 Claude 스킬 — Korean AI-text humanizer: detects and rewrites translationese, mechanical…

    • Gold I

    1,622 Elo +826.5kPython
26. #3,321
    RasaHQ/rasa

    💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management…

    • Gold I

    1,616 Elo −6321.3kPython
27. #3,462
    botpress/botpress

    The open-source hub to build & deploy GPT/LLM Agents ⚡️

    • Gold I

    1,608 Elo 15kTypeScript
28. #3,554
    bharathgs/Awesome-pytorch-list

    A comprehensive list of pytorch related content on github,such as different models,implementations,helper…

    • Gold II

    1,602 Elo −1816.7k
29. #3,650
    AiHubCN/Awesome-Chinese-LLM

    整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

    • Gold II

    1,595 Elo −5822.7k
30. #3,919
    huggingface/tokenizers

    💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

    • Gold III

    1,578 Elo +4111.2kRust
31. #4,023
    piskvorky/gensim

    Topic Modelling for Humans

    • Gold III

    1,572 Elo −6616.5kPython
32. #4,219
    microsoft/unilm

    Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

    • Gold III

    1,561 Elo −6522.2kPython
33. #4,224
    tangyudi/Ai-Learn

    人工智能学习路线图，整理近200个实战案例与项目，免费提供配套教材，零基础入门，就业实战！包括：Python，数学，机器学习，数据分析，深度学习，计算机视觉，自然语言处理，PyTorch tensorflow…

    • Gold III

    1,561 Elo −413.4k
34. #4,255
    NLP-LOVE/ML-NLP

    此项目是机器学习(Machine Learning)、深度学习(Deep Learning)、NLP面试中常考到的知识点和代码实现，也是作为一个算法工程师必会的理论基础知识。

    • Gold III

    1,559 Elo −5717.8kJupyter Notebook
35. #4,361
    NVIDIA/DeepLearningExamples

    State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and…

    • Gold IV

    1,553 Elo −1414.8kJupyter Notebook
36. #4,519
    dair-ai/AI-Papers-of-the-Week

    🔥Highlighting the top ML papers every week.

    • Gold IV

    1,544 Elo −2313.3k
37. #4,526
    dair-ai/ML-YouTube-Courses

    📺 Discover the latest machine learning / AI courses on YouTube.

    • Gold IV

    1,544 Elo −2117.4k
38. #4,553
    oxford-cs-deepnlp-2017/lectures

    Oxford Deep NLP 2017 course

    • Gold IV

    1,542 Elo −2315.8k
39. #4,583
    nltk/nltk

    NLTK Source

    • Gold IV

    1,540 Elo −3214.7kPython
40. #4,713
    adbar/trafilatura

    Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON…

    • Gold V

    1,533 Elo +467.1kPython
41. #4,854
    PaddlePaddle/PaddleNLP

    Easy-to-use and powerful LLM and SLM library with awesome model zoo.

    • Gold V

    1,526 Elo −1912.9kPython
42. #5,141
    graykode/nlp-tutorial

    Natural Language Processing Tutorial for Deep Learning Researchers

    • Silver I

    1,512 Elo −5314.9kJupyter Notebook
43. #5,153
    bigscience-workshop/petals

    🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

    • Silver I

    1,512 Elo +110.7kPython
44. #5,170
    virgili0/Virgilio

    Your new Mentor for Data Science E-Learning.

    • Silver I

    1,511 Elo −2415kJupyter Notebook
45. #5,209
    flairNLP/flair

    A very simple framework for state-of-the-art Natural Language Processing (NLP)

    • Silver I

    1,509 Elo −3314.4kPython
46. #5,279
    ymcui/Chinese-LLaMA-Alpaca

    中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

    • Silver I

    1,506 Elo −5718.9kPython
47. #6,053
    chiphuyen/stanford-tensorflow-tutorials

    This repository contains code examples for the Stanford's course: TensorFlow for Deep Learning Research.

    • Silver III

    1,471 Elo −4710.3kPython
48. #6,153
    MaartenGr/BERTopic

    Leveraging BERT and c-TF-IDF to create easily interpretable topics.

    • Silver III

    1,467 Elo +157.9kPython
49. #6,249
    HenryNdubuaku/maths-cs-ai-compendium

    Become a cracked AI/ML researcher/engineer with this unconventional textbook covering maths, computing, and ML with…

    • Silver IV

    1,462 Elo +327.7kTypeScript
50. #6,269
    allenai/allennlp

    An open-source NLP research library, built on PyTorch.

    • Silver IV

    1,462 Elo −4311.8kPython
51. #6,487
    modelscope/modelscope

    ModelScope: bring the notion of Model-as-a-Service to life.

    • Silver IV

    1,453 Elo −29.2kPython
52. #6,733
    stanfordnlp/CoreNLP

    CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment…

    • Silver V

    1,443 Elo −4110.1kJava
53. #6,771
    spencermountain/compromise

    modest natural-language processing

    • Silver V

    1,442 Elo −312.1kJavaScript
54. #6,822
    jadore801120/attention-is-all-you-need-pytorch

    A PyTorch implementation of the Transformer model in "Attention is All You Need".

    • Silver V

    1,440 Elo −509.8kPython
55. #6,868
    argosopentech/argos-translate

    Open-source offline translation library written in Python

    • Silver V

    1,438 Elo +626.6kPython
56. #6,928
    huggingface/text-generation-inference

    Large Language Model Text Generation Inference

    • Silver V

    1,436 Elo −910.8kPython
57. #7,161
    ymcui/Chinese-BERT-wwm

    Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）

    • Bronze I

    1,427 Elo −1610.2kPython
58. #7,170
    stanfordnlp/stanza

    Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages

    • Bronze I

    1,427 Elo +277.9kPython
59. #7,405
    brightmart/nlp_chinese_corpus

    大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP

    • Bronze I

    1,417 Elo −219.9k
60. #7,518
    brightmart/text_classification

    all kinds of text classification models and more with deep learning

    • Bronze II

    1,413 Elo −67.9kPython
61. #7,800
    Morizeyao/GPT2-Chinese

    Chinese version of GPT2 training code, using BERT tokenizer.

    • Bronze III

    1,403 Elo −147.5kPython
62. #7,870
    Mooler0410/LLMsPracticalGuide

    A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)

    • Bronze III

    1,400 Elo −410.2k
63. #7,897
    PaddlePaddle/models

    Officially maintained, supported by PaddlePaddle, including CV, NLP, Speech, Rec, TS, big models and so on.

    • Bronze III

    1,399 Elo −176.9kPython
64. #7,930
    sloria/TextBlob

    Simple, Pythonic, text processing--Sentiment analysis, part-of-speech tagging, noun phrase extraction, translation, and…

    • Bronze III

    1,398 Elo −209.5kPython
65. #8,020
    crownpku/Awesome-Chinese-NLP

    A curated list of resources for Chinese NLP 中文自然语言处理相关资料

    • Bronze III

    1,394 Elo −177.9k
66. #8,226
    jessevig/bertviz

    BertViz: Visualize Attention in Transformer Models

    • Bronze IV

    1,386 Elo −18.2kPython
67. #8,411
    haifengl/smile

    Statistical Machine Intelligence & Learning Engine

    • Bronze IV

    1,379 Elo +106.4kJava
68. #8,422
    dragen1860/TensorFlow-2.x-Tutorials

    TensorFlow 2.x version's Tutorials and Examples, including CNN, RNN, GAN, Auto-Encoders, FasterRCNN, GPT, BERT…

    • Bronze IV

    1,379 Elo −66.3kJupyter Notebook
69. #8,710
    NLPchina/ansj_seg

    ansj分词.ict的真正java实现.分词效果速度都超过开源版的ict. 中文分词,人名识别,词性标注,用户自定义词典

    • Bronze V

    1,365 Elo −206.4kJava
70. #8,914
    deeppavlov/DeepPavlov

    An open source library for deep learning end-to-end dialog systems and chatbots.

    • Copper I

    1,355 Elo −196.9kPython
71. #8,942
    amitness/learning

    A log of things I'm learning

    • Copper I

    1,354 Elo +106.9k
72. #9,181
    axa-group/nlp.js

    An NLP library for building bots, with entity extraction, sentiment analysis, automatic language identify, and so more

    • Copper II

    1,340 Elo +46.5kJavaScript
73. #9,242
    codertimo/BERT-pytorch

    Google AI 2018 BERT pytorch implementation

    • Copper II

    1,337 Elo −126.5kPython
74. #9,264
    WooooDyy/LLM-Agent-Paper-List

    The paper list of the 86-page SCIS cover paper "The Rise and Potential of Large Language Model Based Agents: A Survey"…

    • Copper II

    1,335 Elo −148.2k
75. #9,276
    MycroftAI/mycroft-core

    Mycroft Core, the Mycroft Artificial Intelligence platform.

    • Copper II

    1,334 Elo −156.6kPython
76. #9,412
    thunlp/WantWords

    An open-source online reverse dictionary.

    • Copper II

    1,325 Elo +97kJavaScript
77. #9,472
    aisingapore/TagUI

    Free RPA tool by AI Singapore

    • Copper III

    1,320 Elo +96.3kPHP
78. #9,481
    SkalskiP/courses

    This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)

    • Copper III

    1,320 Elo −86.4kPython
79. #9,510
    clovaai/donut

    Official Implementation of OCR-free Document Understanding Transformer (Donut) and Synthetic Document Generator…

    • Copper III

    1,317 Elo −126.9kPython
80. #9,564
    microsoft/nlp-recipes

    Natural Language Processing Best Practices & Examples

    • Copper III

    1,311 Elo −126.4kPython
81. #9,604
    ymcui/Chinese-LLaMA-Alpaca-2

    中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

    • Copper III

    1,306 Elo −177kPython