vespa-engine/vespa
Open on GitHubJavaThe AI search platform
- 1,430−6 Elo, change today
- 7.1k stars
- 752 forks
git clone https://github.com/vespa-engine/vespa.gitTop Big Data repositories
Repositories with the GitHub topic “big-data”: 31 repositories with 515k stars between them, mostly written in Java, Scala and C++. The highest-rated is binhnguyennus/awesome-scalability, #366 on the bestofgithub Elo ladder.
Biggest movers this week
delta-io/delta
Open on GitHubScalaAn open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
- 1,522+13 Elo, change today
- 9k stars
- 2.2k forks
git clone https://github.com/delta-io/delta.gitfeast-dev/feast
Open on GitHubPythonThe Open Source Feature Store for AI/ML
- 1,450+11 Elo, change today
- 7.3k stars
- 1.4k forks
git clone https://github.com/feast-dev/feast.gitapache/datafusion
Open on GitHubRustApache DataFusion SQL Query Engine
- 1,616−5 Elo, change today
- 9.5k stars
- 2.6k forks
git clone https://github.com/apache/datafusion.gith2oai/h2o-3
Open on GitHubJupyter NotebookH2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
- 1,432+9 Elo, change today
- 7.5k stars
- 2k forks
git clone https://github.com/h2oai/h2o-3.gitStarRocks/starrocks
Open on GitHubJavaThe world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.
- 1,576−1 Elo, change today
- 12.2k stars
- 2.6k forks
git clone https://github.com/StarRocks/starrocks.gitTop 31 on the Elo ladder
- #366binhnguyennus/awesome-scalability
The Patterns of Scalable, Reliable, and Performant Large-Scale Systems
- #556ClickHouse/ClickHouse
ClickHouse® is a real-time analytics database management system
- #662apache/spark
Apache Spark - A unified analytics engine for large-scale data processing
- #1,646apache/flink
Apache Flink
- #1,716thingsboard/thingsboard
All-in-one IoT Platform - Device management, data collection, processing and visualization.
- #2,329donnemartin/data-science-ipython-notebooks
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark…
- #2,356trinodb/trino
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL…
- #3,309apache/datafusion
Apache DataFusion SQL Query Engine
- #3,455heibaiying/BigData-Notes
大数据入门指南 :star:
- #3,518andkret/Cookbook
The Data Engineering Cookbook
- #3,875prestodb/presto
The official home of the Presto distributed SQL query engine for big data
- #3,954StarRocks/starrocks
The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility…
- #4,853quickwit-oss/quickwit
Cloud-native OSS search engine for observability
- #4,917apache/beam
Apache Beam is a unified programming model for Batch and Streaming data processing.
- #4,951delta-io/delta
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark…
- #5,810provectus/kafka-ui
Open-Source Web UI for Apache Kafka Management
- #5,881catboost/catboost
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification…
- #6,013amark/gun
An open source cybersecurity protocol for syncing decentralized graph data.
- #6,023apache/predictionio
PredictionIO, a machine learning server for developers and ML engineers.
- #6,199yahoo/CMAK
CMAK is a tool for managing Apache Kafka clusters
- #6,275arkime/arkime
Arkime is an open source, large scale, full packet capturing, indexing, and database system.
- #6,374cython/cython
The most widely used Python to C compiler
- #6,550feast-dev/feast
The Open Source Feature Store for AI/ML
- #7,006vesoft-inc/nebula
A distributed, fast open-source graph database featuring horizontal scalability and high availability
- #7,032h2oai/h2o-3
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) &…
- #7,084vespa-engine/vespa
The AI search platform
- #7,109apache/couchdb
Seamless multi-primary syncing database with an intuitive HTTP/JSON API, designed for reliability
- #7,494hazelcast/hazelcast
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers…
- #7,822apache/zeppelin
Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and…
- #8,014apache/iotdb
Apache IoTDB
- #9,806pachyderm/pachyderm
Data-Centric Pipelines and Data Versioning