Delta Lake

Catalog-managed Delta 4.3: Spark streaming + CDF + catalog-driven batch CDC 👇 🔹 All standard streaming read options 🔹 Replay via CHANGES FROM VERSION/TIMESTAMP 🔹 Delta Sharing CDF for shared tables 🔗 Learn more: delta.io/blog/2026-06-2… #DeltaLake

File pruning in Delta Lake is usually invisible until the bill shows up. 👇 Join us for our next webinar (Aug 18) where we'll cover: 🔹 delta-explain CLI on delta-kernel-rs (metadata only, no query run) 🔹 Demo: two layouts, one query. CI gate before prod regressions RSVP: luma.com/delta-odhl #DeltaLake

The single canonical stack is giving way to composable, interoperable lakehouses. In this clip, @lisancao and @newfront cover format choice, glue code, and what comes next. 👀 Full video: youtu.be/dEFAkS7vYV0 #DeltaLake #OpenLakehouse

Delta Lake: The Definitive Guide book signing at Data + AI Summit 2026 was a big success! 📚 @dennylee, @newfront, Tristen Wentling, and Tyler Croy were busy signing copies and meeting community members, with a line stretching across the expo floor. Thank you to the 300+ people who waited in line for a physical book and connected with the authors. 🙌 Here's to everyone building with Delta Lake. #opensource #deltalake #oss #dataaisummit

Delta 4.3 extends catalog-managed tables with Unity Catalog REST APIs. 👇 🔌 Intent-based catalog commits 🔄 Atomic incremental UniForm 📡 CDC streaming + Row Tracking Apache Spark, DuckDB, Apache Flink + Delta-Kernel on one catalog. 🔗 Read more: delta.io/blog/2026-06-2… #DeltaLake #ApacheSpark #OpenSource

Open table formats face a scaling challenge: new features and integrations can create exponentially more implementation work across projects. At #DataAISummit, Holly Smith and Robert Pack will share how Kernel rewrites the source of truth so adopted projects get new features that “just appear.” 📍 San Francisco | June 15-18 🔗 Session details: databricks.com/dataaisummit/s… #DeltaLake #OpenSource

From 2017 to now, Delta Lake has grown to 40M+ downloads/month and powers daily processing of hundreds of exabytes. At #DataAISummit, “The Road to Delta 5.0” will cover what’s next: 🔹 catalog-first Delta 🔹 Data Source V2 modernization 🔹 Delta + Iceberg convergence 🔹 Delta Kernel alignment (Java + Rust) Details: databricks.com/dataaisummit/s… #DeltaLake #OpenSource

Back by popular demand! 📘 Delta Lake: The Definitive Guide book signing returns to Data + AI Summit 2026. If you are at Data + AI Summit, come meet the authors, say hi to the Delta Lake community, and pick up a signed copy while supplies last. 🗓️ Tuesday, June 16 🕝 2:00–2:30 PM 📍 Dev Lounge, Data + AI Summit Expo, Moscone Center Books tend to go quickly, so plan to stop by early. Hope to see you there! 👋 #DeltaLake #DataAISummit #OpenSource #DataEngineering @dennylee @newfront @Data_AI_Summit

Delta Lake + Apache Iceberg co-evolved as parallel standards. That era is ending. 👇 🔹 Iceberg v4 adaptive metadata tree + single-file commits 🔹 Delta Lake 5.0 adopts it as native content metadata 🔹 One on-disk format, no translation layers 🔗 Add it to your schedule: databricks.com/dataaisummit/s… #DeltaLake #DataAISummit #ApacheIceberg

At Data + AI Summit (June 15–18), Scott Sandre will show how Catalog-Managed Tables support was designed in Delta Kernel. 👇 🔹 A unified, catalog-agnostic API for connectors to build against 🔹 Deep engine integrations for DuckDB, Delta-Spark, and Delta-Flink 🔹 Catalog complexity kept out of Kernel—the one right Delta abstraction 🔗 Session details: databricks.com/dataaisummit/s… #DeltaLake #DeltaKernel #DataAISummit

Data + AI Summit session: Tyler Croy (delta-rs maintainer) will introduce Virtual Delta Tables and the associated open source code designed for multimodal inference.👇 🗓️ June 15-18 📍 San Francisco 🔗 Session details: databricks.com/dataaisummit/s… #DeltaLake #MultimodalAI #DataAndAISummit #Lakehouse

Headed to Data + AI Summit (June 15–18)? 🗓️ Don't miss Your Guide to Open Table Formats — Delta, Iceberg, Best Practices, and What's Next! Benjamin Mathew & Scott Sandre will cover Delta 5.0, Iceberg v4, Unified Delta Kernel (GA), and best practices across formats. Add it to your agenda. 👇 databricks.com/dataaisummit/s… #DeltaLake #ApacheIceberg #DataAISummit

Delta Lake and Apache Iceberg™ have converged on similar ideas—columnar metadata, manifest trees, deletion vectors—but two separate metadata structures still duplicate work. At DAIS (June 15–18, San Francisco): the next evolution of Delta Lake metadata. 👇 🔹 Delta commits → Iceberg v4’s adaptive metadata tree 🔹 Tree-structured manifests + Iceberg interoperability 🔹 Transactional guarantees Delta users depend on — preserved 🔗 databricks.com/dataaisummit/s… #DeltaLake #ApacheIceberg #DataandAISummit

DuckDB's Delta + @unitycatalog_io extensions are no longer experimental 👇 🔷 INSERT via ATTACH (TYPE delta) 🔷 Time travel: AT (VERSION => n), VERSION, PIN_SNAPSHOT 🔷 Catalog Managed Tables + Catalog Commits for concurrent writes 🔷 Incremental snapshot loading (nightly; v1.5.3 next) Learn more: delta.io/blog/2026-05-0… #DeltaLake @duckdb

Headed to Data + AI Summit? Don't miss New Foundations of Delta Lake with Kernel + Spark's DSv2. Delta on Spark DSv1 set the standard for the past 8 years. Rahul Potharaju & Tathagata Das will highlight the move to DSv2 and new foundations for the next decade. 🗓️June 15-18 📍San Francisco Add it to your agenda 👇 databricks.com/dataaisummit/s… #DeltaLake #DataAISummit

.@ClickHouseDB is data lake ready. 👇 On the Delta Lake blog, the Clickhouse team shares how they integrated delta-kernel-rs: transaction logs, metadata, snapshots, Engine APIs, writes, schema evolution, time travel, and CDF (25.12). 🔗 Read the post: delta.io/blog/2026-05-1… #DeltaLake #ClickHouse

Delta Lake Community Meetup [May 2026] x.com/i/broadcasts/1…

📣 Join us for the next Delta Lake community meetup on May 19! Agenda: 🔹 Issues & PR backlog 🔹 Unified Kernel 🔹Community highlights Register: luma.com/deltalake-0519 #DeltaLake #OpenSource #Rust #OpenLakehouse

[Ep 1] Open Lakehouse + AI: The Catalog Layer, Interoperability & AI-Agent Governance Learn how composable lakehouses center the catalog for metadata, versioning, and commit coordination. 👇 🔸 Interop: Iceberg REST, Unity Catalog (OSS), Spark, Delta Lake, Delta-RS, Iceberg. 🔸 Governance: credential vending, row/col filters, column masks, audits, and why “no governance was the easiest governance.” 🔸 Agents as data customers (Temporal). Fine-grained access beats blanket credentials on 24/7 workloads. 🎥 Full episode: youtube.com/watch?v=dEFAkS… #OpenLakehouse #UnityCatalog @ApacheSpark @ApacheIceberg @DeltaLakeOSS

Delta Lake 4.2 pushes Delta Kernel further (new Flink connector, richer types) and hardens catalog-managed tables (atomic ops, SQL evolution, UniForm). 👇 🔹 Kernel / Flink — New Kernel Flink connector (experimental): catalog-managed, catalog-coordinated writes, exactly-once. Replaces legacy connector deprecated in Delta Lake 4.0. 🔹 Schema (SQL) — INSERT INTO … BY NAME + autoMerge adds columns in-commit. delta.stats.skipping.forceOptimizeStatsCollection → data skipping on new columns without OPTIMIZE. 🔹 Types — Geospatial, Collation, Variant (shredding out of preview); Spark: full Variant schema conversion. 🔹 Catalog — RTAS / dynamic partition overwrite: one atomic commit. UniForm: Iceberg metadata at commit (reads immediate). HMS UniForm deprecated. 🔗 Read more → delta.io/blog/2026-04-1… #DeltaLake #OpenSource