Top Kafka repositories

Repositories with the GitHub topic “kafka”: 30 repositories with 434k stars between them, mostly written in Java, Go and C++. The highest-rated is DataTalksClub/data-engineering-zoomcamp, #475 on the bestofgithub Elo ladder.

Biggest movers this week

apache/camel

Open on GitHubJava

Apache Camel is an open source integration framework with 350+ connectors. Write routes in Java, YAML, or XML. Run on Spring Boot, Quarkus, or standalone. Apache License 2.0.

  • 1,507+1 Elo, change today
  • 6.4k stars
  • 5.1k forks
git
git clone https://github.com/apache/camel.git
  • camel
  • cloud-native
  • data-transformation
  • enterprise-integration-patterns

MaterializeInc/materialize

Open on GitHubRust

The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL

  • 1,352+2 Elo, change today
  • 6.4k stars
  • 518 forks
git
git clone https://github.com/MaterializeInc/materialize.git
  • cdc
  • data-mesh
  • data-store
  • database

risingwavelabs/risingwave

Open on GitHubRust

Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.

  • 1,460+3 Elo, change today
  • 9.4k stars
  • 866 forks
git
git clone https://github.com/risingwavelabs/risingwave.git
  • apache-iceberg
  • data-engineering
  • database
  • etl-pipeline

ThreeDotsLabs/watermill

Open on GitHubGo

Building event-driven applications the easy way in Go.

  • 1,473+7 Elo, change today
  • 9.9k stars
  • 514 forks
git
git clone https://github.com/ThreeDotsLabs/watermill.git
  • cqrs
  • event-driven
  • event-sourcing
  • events

redpanda-data/connect

Open on GitHubGo

Fancy stream processing made operationally mundane

  • 1,415−5 Elo, change today
  • 8.7k stars
  • 983 forks
git
git clone https://github.com/redpanda-data/connect.git
  • amqp
  • cqrs
  • data-engineering
  • data-ops

CoderLeixiaoshuai/java-eight-part

Open on GitHubJava

『Java八股文』Java面试套路,Java进阶学习,打破内卷拿大厂Offer,升职加薪!

  • 1,387+7 Elo, change today
  • 7.2k stars
  • 1k forks
git
git clone https://github.com/CoderLeixiaoshuai/java-eight-part.git
  • java
  • juc
  • kafka
  • mysql

Top 30 on the Elo ladder

  1. #475
    DataTalksClub/data-engineering-zoomcamp

    Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼

    1,984 Elo −546.9kJupyter Notebook
  2. #1,065
    apache/kafka

    Apache Kafka - A distributed event streaming platform

    1,846 Elo −6334.2kJava
  3. #2,859
    debezium/debezium

    Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.

    1,648 Elo −113.3kJava
  4. #3,036
    pathwaycom/pathway

    Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

    1,634 Elo −3661.9kPython
  5. #3,220
    influxdata/telegraf

    Agent for collecting, processing, aggregating, and writing metrics, logs, and other arbitrary data.

    1,622 Elo −3117.9kGo
  6. #3,455
    heibaiying/BigData-Notes

    大数据入门指南 :star:

    1,608 Elo −1717kJava
  7. #3,791
    yudaocode/SpringBoot-Labs

    一个涵盖六个专栏:Spring Boot 2.X、Spring Cloud、Spring Cloud Alibaba、Dubbo、分布式消息队列、分布式事务的仓库。希望胖友小手一抖,右上角来个 Star,感恩 1024

    1,586 Elo −6320.1kJava
  8. #4,476
    zhisheng17/flink-learning

    flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink…

    1,546 Elo −3015.1kJava
  9. #4,518
    aalansehaiyang/technology-talk

    【大厂面试专栏】一份Java程序员需要的技术指南,这里有面试题、系统架构、职场锦囊、主流中间件等,让你成为更牛的自己!

    1,544 Elo −2714.7k
  10. #4,634
    redpanda-data/redpanda

    Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

    1,538 Elo −2512.6kC++
  11. #4,974
    sogou/workflow

    C++ Parallel Computing and Asynchronous Networking Framework

    1,521 Elo −4414.4kC++
  12. #5,274
    apache/camel

    Apache Camel is an open source integration framework with 350+ connectors. Write routes in Java, YAML, or XML. Run on…

    1,507 Elo +286.4kJava
  13. #5,424
    wangzhiwubigdata/God-Of-BigData

    专注大数据学习面试,大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

    1,500 Elo +110.5k
  14. #5,810
    provectus/kafka-ui

    Open-Source Web UI for Apache Kafka Management

    1,482 Elo −3712.3kJava
  15. #6,006
    ThreeDotsLabs/watermill

    Building event-driven applications the easy way in Go.

    1,473 Elo +119.9kGo
  16. #6,034
    IBM/sarama

    Sarama is a Go library for Apache Kafka.

    1,472 Elo −3012.5kGo
  17. #6,199
    yahoo/CMAK

    CMAK is a tool for managing Apache Kafka clusters

    1,465 Elo −4111.9kScala
  18. #6,306
    risingwavelabs/risingwave

    Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.

    1,460 Elo +139.4kRust
  19. #6,692
    AutoMQ/automq

    Diskless Kafka® on S3. 10x Cost-Effective. No Cross-AZ Traffic Cost. Autoscale in seconds. Single-digit ms latency…

    1,445 Elo 10.9kJava
  20. #6,952
    HariSekhon/DevOps-Bash-tools

    1200+ DevOps Bash Scripts - AWS, GCP, Kubernetes, Docker, CI/CD, APIs, SQL, PostgreSQL, MySQL, Hive, Impala, Kafka…

    1,435 Elo −138.4kShell
  21. #7,474
    redpanda-data/connect

    Fancy stream processing made operationally mundane

    1,415 Elo +98.7kGo
  22. #7,748
    apache/flink-cdc

    Flink CDC is a streaming data integration tool

    1,405 Elo −256.4kJava
  23. #7,750
    Graylog2/graylog2-server

    Free and open log management

    1,405 Elo 8.1kJava
  24. #8,142
    segmentio/kafka-go

    Kafka library in Go

    1,390 Elo −228.6kGo
  25. #8,215
    CoderLeixiaoshuai/java-eight-part

    『Java八股文』Java面试套路,Java进阶学习,打破内卷拿大厂Offer,升职加薪!

    1,387 Elo +37.2kJava
  26. #8,302
    dotnetcore/CAP

    Distributed transaction solution in micro-service base on eventually consistency, also an eventbus with Outbox pattern

    1,383 Elo −77.1kC#
  27. #8,704
    flexprice/flexprice

    Usage-based pricing and billing for developers 🔓 Cloud or self-hosted ⚙️ No-code UI 💰 Realtime usage metering 🎟 Credits…

    1,366 Elo +36.8kGo
  28. #8,813
    didi/KnowStreaming

    一站式云原生实时流数据平台,通过0侵入、插件化构建企业级Kafka服务,极大降低操作、存储和管理实时流数据门槛

    1,360 Elo −107.1kJava
  29. #8,977
    MaterializeInc/materialize

    The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL

    1,352 Elo +246.4kRust
  30. #9,769
    robinhood/faust

    Python Stream Processing

    1,283 Elo −86.8kPython