DuckLake 1.1 Uses a SQL Catalog to Simplify Data Lakehouse Management at AI Scale

Written by

in

DuckLake 1.1, launched alongside DuckDB 2.0.0 LTS, stores table metadata in a standard SQL database, reducing the complexity of managing data lakehouses at AI scale. This release introduces inlining and flushing mechanisms to combine files from multiple snapshots and alleviate the small-file problem in streaming data lakehouses, while also including more than 200 bug fixes.

Source:The New Stack · Read Original

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *