Top Multimodal repositories

Repositories with the GitHub topic “multimodal”: 24 repositories with 430k stars between them, mostly written in Python, TypeScript and C++. The highest-rated is bojieli/ai-agent-book, #158 on the bestofgithub Elo ladder.

Biggest movers this week

nexu-io/openmotion

Open on GitHubTypeScript

The open-source full-stack studio for Opus 5.5 motion video. Reverse engineering for any video. Code video with HTML: recreate, edit and render. BYOA + BYOK · Motion.md · Images, Video, Music & Voice.

  • 1,801+33 Elo, change today
  • 9.9k stars
  • 968 forks
  • 43 watchers
git
git clone https://github.com/nexu-io/openmotion.git
  • agent-skills
  • agentic-ai
  • ai-agents
  • ai-video

ARahim3/DigUp

Open on GitHubSwift
  • Gold I
  • New & Rising · Oct 2026
  • New & Rising · Nov 2026

Search your computer by what's in your files: photos, PDFs, documents, recordings, videos and code. On-device on Mac, Windows and Linux, built on Google DeepMind's EmbeddingGemma 2.

  • 1,618+13 Elo, change today
  • 6.4k stars
  • 514 forks
git
git clone https://github.com/ARahim3/DigUp.git
  • embeddinggemma
  • embeddings
  • file-search
  • linux

Neywa-Labs/mlx-audio

Open on GitHubPython

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

  • 1,585+7 Elo, change today
  • 8.2k stars
  • 795 forks
git
git clone https://github.com/Neywa-Labs/mlx-audio.git
  • apple-silicon
  • audio-processing
  • mlx
  • multimodal

StarTrail-org/PixelRAG

Open on GitHubPython

https://arxiv.org/abs/2606.28344. The end of web parsing. The beginning of scalable pixel-native search. link: https://pixelrag.ai/

  • 1,665+10 Elo, change today
  • 10.9k stars
  • 987 forks
git
git clone https://github.com/StarTrail-org/PixelRAG.git
  • agent
  • ai
  • memory
  • multimodal

rerun-io/rerun

Open on GitHubRust

Visualize, query, and stream to train on multimodal robotics data.

  • 1,681−2 Elo, change today
  • 11.8k stars
  • 906 forks
  • 73 watchers
git
git clone https://github.com/rerun-io/rerun.git
  • computer-vision
  • cpp
  • multimodal
  • python

Top 24 on the Elo ladder

  1. #158
    bojieli/ai-agent-book

    《深入理解 AI Agent:设计原理与工程实践》(李博杰 著)开源主仓库:全书正文、编译版 PDF 与按章配套代码

    2,158 Elo +1558.1kPython
  2. #348
    Mintplex-Labs/anything-llm

    Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent…

    2,040 Elo −2968.3kJavaScript
  3. #685
    datawhalechina/all-in-rag

    🔍大模型应用开发实战一:RAG 技术全栈指南,在线阅读地址:https://datawhalechina.github.io/all-in-rag/

    1,919 Elo +4013.1kPython
  4. #1,252
    screenpipe/screenpipe

    YC (S26) | Open Computer History | Continuously record your company computer work, map your workflows, help you find…

    1,820 Elo +2022.3kRust
  5. #1,374
    nexu-io/openmotion

    The open-source full-stack studio for Opus 5.5 motion video. Reverse engineering for any video. Code video with HTML…

    1,801 Elo +1679.9kTypeScript
  6. #1,437
    bytedance/UI-TARS-desktop

    The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra

    1,792 Elo −10139.5kTypeScript
  7. #1,442
    vllm-project/vllm-omni

    A framework for efficient model inference with omni-modality models

    1,792 Elo +817.7kPython
  8. #2,180
    modelscope/ms-swift

    Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and…

    1,708 Elo +2016.1kPython
  9. #2,440
    rerun-io/rerun

    Visualize, query, and stream to train on multimodal robotics data.

    1,681 Elo +7111.8kRust
  10. #2,635
    StarTrail-org/PixelRAG

    https://arxiv.org/abs/2606.28344. The end of web parsing. The beginning of scalable pixel-native search. link…

    1,665 Elo +7510.9kPython
  11. #3,291
    ARahim3/DigUp

    Search your computer by what's in your files: photos, PDFs, documents, recordings, videos and code. On-device on Mac…

    1,618 Elo +1386.4kSwift
  12. #3,737
    haotian-liu/LLaVA

    [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

    1,589 Elo −5825kPython
  13. #3,805
    Neywa-Labs/mlx-audio

    A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework…

    1,585 Elo +788.2kPython
  14. #4,092
    jina-ai/serve

    ☁️ Build multimodal AI applications with cloud-native stack

    1,568 Elo −2321.8kPython
  15. #4,219
    microsoft/unilm

    Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

    1,561 Elo −6522.2kPython
  16. #4,257
    apache/seatunnel

    SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

    1,559 Elo −99.8kJava
  17. #4,274
    deepseek-ai/Janus

    Janus-Series: Unified Multimodal Understanding and Generation Models

    1,558 Elo −717.7kPython
  18. #5,701
    X-PLUG/MobileAgent

    Mobile-Agent: The Powerful GUI Agent Family

    1,487 Elo −169.3kPython
  19. #5,738
    yzhao062/pyod

    A Python library for anomaly detection across tabular, time series, graph, text, image, and audio data. 60+ detectors…

    1,486 Elo −2210kPython
  20. #6,393
    genkit-ai/genkit

    Open-source framework for building agentic apps in JavaScript, Go, Dart, and Python, built and used in production by…

    1,457 Elo +516.5kTypeScript
  21. #6,666
    bentoml/BentoML

    The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines…

    1,446 Elo +128.9kPython
  22. #6,798
    RunanywhereAI/runanywhere-sdks

    Production ready toolkit to run AI locally

    1,441 Elo +2310.3kC++
  23. #7,842
    activeloopai/deeplake

    Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable…

    1,402 Elo +149.2kC++
  24. #9,481
    SkalskiP/courses

    This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)

    1,320 Elo −86.4kPython