Apache DataFusion SQL Query Engine

the portable Python dataframe library

Create full-fledged APIs for slowly moving datasets without writing a single line of code.

Extensible SQL Lexer and Parser for Rust

LakeSoul is an end-to-end, realtime and cloud native Lakehouse framework with fast data ingestion, concurrent update and incremental data analytics on cloud storages for both BI and AI applications.

Apache DataFusion Ballista Distributed Query Engine

The Auron accelerator for distributed computing framework (e.g., Spark) leverages native vectorized execution to accelerate query processing

Apache Kafka® compatible broker with S3, PostgreSQL, SQLite, Apache Iceberg and Delta Lake

LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive AI workloads.

High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.

Apache DataFusion Comet Spark Accelerator

ClickBench: a Benchmark For Analytical Databases

The open context engine for AI agents support 15+ data sources. Built on Rust and Apache DataFusion.

DataFusion has now been donated to the Apache Arrow project

Apache DataFusion Python Bindings

DuckDB-powered data lake analytics from Postgres

Analytical database for data-driven Web applications 🪶

Pushdown cache for DataFusion

Embeddable stream processing engine based on Apache DataFusion

Next-generation decentralized data lakehouse and a multi-party stream processing network

Unofficial rust implementation of Apache Iceberg with integration for Datafusion

Apache DataFusion Ray

Batteries included CLI, TUI, and server implementations for DataFusion.

DataFusion TableProviders for reading data from other systems

Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.

Blazing-Fast Bioinformatic Operations on Python DataFrames

Query and transform data with PRQL

Postgres protocol frontend for DataFusion

Compaction runtime for Apache Iceberg.

A Rust-native DuckLake engine built on Apache DataFusion