Apache Hudi

Hudi 1.0 is the most powerful release to date for data lakehouses. Read the blog for details:

Secondary Indexing, Expression Indexes, Partial Updates, Non-blocking Concurrency Control, New LSM timeline, +more: hudi.apache.org/blog/2024/12/1…

#datalakehouse #opentableformat

Pick the right Hudi write operation. Each one trades index lookup against file sizing against initial-load speed.

📣 Apache Hudi-rs 0.6.0 is out. You can now write Hudi tables from Python and Rust, with no Spark cluster and no JVM.

Until now, hudi-rs was a fast reader. Now it’s a writer too:

pip install hudi
cargo add hudi

A lot of real pipelines that update tables run in a plain Python process.

Copy-on-Write vs Merge-on-Read — the first design call you make on a Hudi table.

A note for engineers in the Iceberg ecosystem: you can use Hudi tables as Iceberg tables.

The open-table-format world is more interoperable than the vendor positioning suggests.