Top Data repositories

Repositories with the GitHub topic “data”: 31 repositories with 738k stars between them, mostly written in Python, TypeScript and Go. The highest-rated is D4Vinci/Scrapling, #24 on the bestofgithub Elo ladder.

Biggest movers this week

OpenDCAI/DataFlow

Open on GitHubPython

[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.

  • 1,671+8 Elo, change today
  • 8.5k stars
  • 1.2k forks
git
git clone https://github.com/OpenDCAI/DataFlow.git
  • data
  • data-agent
  • data-cleaning
  • data-pipelines

datajuicer/data-juicer

Open on GitHubPython

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

  • 1,464+5 Elo, change today
  • 7.2k stars
  • 454 forks
git
git clone https://github.com/datajuicer/data-juicer.git
  • data
  • data-analysis
  • data-pipeline
  • data-processing

speedyapply/2027-AI-College-Jobs

Open on GitHub

2027 AI/ML internship & new graduate job list updated daily

  • 1,369+4 Elo, change today
  • 6.6k stars
  • 244 forks
git
git clone https://github.com/speedyapply/2027-AI-College-Jobs.git
  • ai
  • applications
  • artificial-intelligence
  • college

oxnr/awesome-bigdata

Open on GitHub

A curated list of awesome big data frameworks, ressources and other awesomeness.

  • 1,569−4 Elo, change today
  • 14.7k stars
  • 2.5k forks
git
git clone https://github.com/oxnr/awesome-bigdata.git
  • awesome
  • awesome-list
  • bigdata
  • data

cue-lang/cue

Open on GitHubGo

The home of the CUE language! Validate and define text-based and dynamic configuration

  • 1,405−1 Elo, change today
  • 6.3k stars
  • 378 forks
git
git clone https://github.com/cue-lang/cue.git
  • configuration
  • data
  • kubernetes
  • validation

D4Vinci/Scrapling

Open on GitHubPython

🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

  • 2,448+2 Elo, change today
  • +392 stars gained
  • 103k stars
  • 10.7k forks
  • 350 watchers
pip
pipx install scrapling
  • ai
  • ai-scraping
  • automation
  • crawler

Top 31 on the Elo ladder

  1. #24
    D4Vinci/Scrapling

    🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy…

    2,448 Elo +11103kPython
  2. #173
    Asabeneh/30-Days-Of-Python

    The 30 Days of Python programming challenge is a step-by-step guide to learn the Python programming language in 30…

    2,145 Elo −3978.8kPython
  3. #573
    metabase/metabase

    The easy-to-use open source Business Intelligence and Embedded Analytics tool that lets everyone work with data…

    1,948 Elo −4850.3kClojure
  4. #581
    DataExpert-io/data-engineer-handbook

    This is a repo with links to everything you'd ever want to learn about data engineering

    1,945 Elo −1645.1kJupyter Notebook
  5. #691
    run-llama/llama_index

    LlamaIndex is the document processing platform for AI

    1,919 Elo −3352.9kPython
  6. #1,067
    akfamily/akshare

    AKShare is an elegant and simple financial data interface library for Python, built for human beings! 开源财经数据接口库

    1,845 Elo +823.3kPython
  7. #1,381
    TanStack/query

    🤖 Powerful asynchronous state management, server-state utilities and data fetching for the web. TS/JS, React Query…

    1,800 Elo −2450.5kTypeScript
  8. #1,478
    airbytehq/airbyte

    Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI…

    1,787 Elo +222.3kPython
  9. #1,810
    PrefectHQ/prefect

    Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

    1,749 Elo −2324.1kPython
  10. #2,547
    OpenDCAI/DataFlow

    [SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.

    1,671 Elo +658.5kPython
  11. #2,707
    SheetJS/sheetjs

    📗 SheetJS Spreadsheet Data Toolkit -- New home https://git.sheetjs.com/SheetJS/sheetjs

    1,659 Elo −5036.3k
  12. #2,890
    fivethirtyeight/data

    Data and code behind the articles and graphics at FiveThirtyEight

    1,645 Elo −10117.4kJupyter Notebook
  13. #3,431
    sinaptik-ai/pandas-ai

    Chat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs…

    1,609 Elo −4023.9kPython
  14. #3,644
    vercel/swr

    React Hooks for Data Fetching

    1,596 Elo −4032.4kTypeScript
  15. #3,875
    prestodb/presto

    The official home of the Presto distributed SQL query engine for big data

    1,581 Elo −6516.7kJava
  16. #4,074
    oxnr/awesome-bigdata

    A curated list of awesome big data frameworks, ressources and other awesomeness.

    1,569 Elo +3214.7k
  17. #4,104
    pwxcoo/chinese-xinhua

    :orange_book: 中华新华字典数据库。包括歇后语,成语,词语,汉字。

    1,567 Elo −2611.7kPython
  18. #4,490
    faker-js/faker

    Generate massive amounts of fake data in the browser and node.js

    1,546 Elo −2415.5kTypeScript
  19. #6,145
    apple/pkl

    A configuration as code language with rich validation and tooling.

    1,467 Elo −311.5kJava
  20. #6,211
    datajuicer/data-juicer

    Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

    1,464 Elo +427.2kPython
  21. #6,851
    tabulator-tables/tabulator

    Interactive Tables and Data Grids for JavaScript

    1,439 Elo +347.8kJavaScript
  22. #6,987
    rawgraphs/rawgraphs-app

    A web interface to create custom vector-based visualizations on top of RAWGraphs core

    1,434 Elo −169kJavaScript
  23. #7,268
    mage-ai/mage-ai

    🧙 Build, run, and manage data pipelines for integrating and transforming data.

    1,423 Elo −118.8kPython
  24. #7,499
    mrdbourke/machine-learning-roadmap

    A roadmap connecting many of the most important concepts in machine learning, how to learn them and what tools to use…

    1,414 Elo +57.9k
  25. #7,686
    neondatabase/electric

    The agent platform built on sync.

    1,407 Elo +910.4kTypeScript
  26. #7,739
    cue-lang/cue

    The home of the CUE language! Validate and define text-based and dynamic configuration

    1,405 Elo +226.3kGo
  27. #8,056
    PRQL/prql

    PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement

    1,394 Elo −310.9kRust
  28. #8,487
    bchavez/Bogus

    :card_index: A simple fake data generator for C#, F#, and VB.NET. Based on and ported from the famed faker.js.

    1,376 Elo −189.7kC#
  29. #8,635
    snowplow/snowplow

    The leader in Customer Data Infrastructure

    1,369 Elo +37kScala
  30. #8,642
    speedyapply/2027-AI-College-Jobs

    2027 AI/ML internship & new graduate job list updated daily

    1,369 Elo +346.6k
  31. #9,340
    cloudquery/cloudquery

    Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability…

    1,330 Elo −146.5kGo