apache/datafusion

• Emerald III

Extremely fast Query Engine for DataFrames, written in Rust

• 1,811−9 Elo, change today
• 40.3k stars
• 3.2k forks
• 214 watchers
• 3h ago

git clone https://github.com/pola-rs/polars.git

• arrow
• dataframe
• dataframe-library
• dataframes

• Diamond IV

In-process analytical SQL database: SQLite for analytics, with fast queries over Parquet and CSV.

• 1,952±0 Elo, change today
• 43k stars
• 4.2k forks
• 279 watchers
• 2d ago

pip install duckdb

• sql
• analytics
• olap

• Emerald V

Apache Flink

• 1,767−5 Elo, change today
• 26.4k stars
• 14.1k forks
• 896 watchers
• 7h ago

git clone https://github.com/apache/flink.git

• big-data
• flink
• java
• python

• Platinum III

Apache Doris is a real-time analytics and hybrid search database for AI agents.

• 1,673+9 Elo, change today
• 16.2k stars
• 4k forks
• 10h ago

git clone https://github.com/apache/doris.git

• agent
• ai
• bigquery
• database

• Platinum II

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

• 1,699+12 Elo, change today
• 17.3k stars
• 4.4k forks
• 342 watchers
• 2d ago

git clone https://github.com/apache/arrow && cd arrow && docker compose up -d

• arrow
• parquet

• Diamond IV

ClickHouse® is a real-time analytics database management system

• 1,955−7 Elo, change today
• 50.9k stars
• 9.2k forks
• 684 watchers
• 28m ago

brew install --cask clickhouse

• ai
• analytics
• big-data
• clickhouse