Scott Haines

The Delta and Unity Catalog extensions in the latest DuckDB release come with a fresh set of features and have shed their experimental labels. In today's blog post, Ben Fleis walks you through the key improvements: ✍️ You can now write Delta tables with DuckDB. Multiple inserts within a transaction produce a single atomic version in the Delta table. 🤝 The Unity Catalog unlocks multi-writer access. DuckDB and other clients such as Spark can now perform writes alongside each other with the catalog handling concurrency control. ⏪ You can use the coolest feature of data lake formats: time travel. This lets you query any Delta table at a specific historical version. Thanks to incremental snapshot loading, this is fast even across large Delta logs. Read the full blog post for more – link in the thread 🧵

📣 Join us for the next Delta Lake community meetup on May 19! Agenda: 🔹 Issues & PR backlog 🔹 Unified Kernel 🔹Community highlights Register: luma.com/deltalake-0519 #DeltaLake #OpenSource #Rust #OpenLakehouse

[Ep 1] Open Lakehouse + AI: The Catalog Layer, Interoperability & AI-Agent Governance Learn how composable lakehouses center the catalog for metadata, versioning, and commit coordination. 👇 🔸 Interop: Iceberg REST, Unity Catalog (OSS), Spark, Delta Lake, Delta-RS, Iceberg. 🔸 Governance: credential vending, row/col filters, column masks, audits, and why “no governance was the easiest governance.” 🔸 Agents as data customers (Temporal). Fine-grained access beats blanket credentials on 24/7 workloads. 🎥 Full episode: youtube.com/watch?v=dEFAkS… #OpenLakehouse #UnityCatalog @ApacheSpark @ApacheIceberg @DeltaLakeOSS

You can just Ship 26 ▲ See you there!

#DataAISummit early bird pricing ends tomorrow, April 30! Don’t miss your chance to join the leaders shaping the future of data + AI. Lock in 50% savings today: databricks.com/dataaisummit?u…

@kskrygan yes!

Would you be interested if JetBrains releases a totally local AI agent, working 100% on your laptop, using our code insight engine and deeply integrated into the IDE? Yes, it will be probably 1 month behind the very recent frontier models, but no token blood bath anymore WDYT?

@ppatierno That is a huge milestone.

It has been a long journey but it was worth all the effort the community put into it!

IT'S HAPPENING!!! 💃 People have asked me for an official @FastAPI Conference for years. Here we go, let's meet in Amsterdam. ☕️

Huge congrats to the Netlify team! Branching isn’t just about safety. It’s a simpler, more intuitive way to think about how databases fit into a modern development workflow.

☘️ I had the pleasure of speaking at the Seattle/Bellevue Apache DataFusion meetup last Thursday at @databricks . 🚔 The talk was on governance "Unifying Open Lakehouse Governance via Policy Portability". This might feel like a boring concept, but it is in my opinion one of the most important things for us to get right to actually support "agents" and "autonomous work". 🌲 I covered using the Cedar Policy Language (as a foundation to move beyond simple authorization through the use of "annotations"). Learn more at cedarpolicy.com/en. 🧪 I showed how "row-filters" and "column-masks" can be encoded and then compiled to Google's Common Expression Language (CEL) as a portable means of sharing "expressions" that can then be transformed for a given "engine" - for this talk I covered @ApacheDataFusio (but the same pattern can also work with @ApacheSpark). The litmus test was supporting the two engines. Thanks to @andrewlamb1111 for putting together a great group of speakers (@westoncpace from @lancedb , @lukekim from @spice_ai, @JiaYu_JY from @wherobots , Ruihang Xia from @Greptime, myself @newfront of @databricks) and of course Andrew Lamb himself from @InfluxDB. I'll be releasing the policast environment within the next two weeks so people can take a look at it.

live coding with @andrelandgraf does not disappoint

The Databricks DevRel team is growing! 📈 Tony is one of the most thoughtful devs I know - definitely give him a follow. :)

Delta Lake Community Meetup [April 2026] x.com/i/broadcasts/1…

Delta Lake 4.2.0 is now available! 🚀 Dive into the full release notes here: 👉github.com/delta-io/delta… Huge thanks to everyone in the Delta community who made this release possible! 🎉 #DeltaLake #OpenSource #ApacheSpark #ApacheFlink

Join us for this first Delta Lake Community Meetup of 2026 on Tuesday, April 21 at 9AM PT! 🚀 We’re bringing the community together for a deep dive into the ecosystem, infrastructure enhancements, and the future project roadmap. Come get your technical questions answered live by the maintainers. ​ What we'll cover: 🔹 Latest Delta Lake updates and how the community is evolving 🔹 A technical look at infrastructure enhancements 🔹 The future of Delta Lake: Roadmap insights and a deep dive into Iceberg v4 compatible metadata 🔹 Live Q&A with the community RSVP ➡️ luma.com/deltalake-0426 #opensource #oss #deltalake #community

neon.com/agents btw

@jaceklaskowski What was your experience like? What advice would you give folk looking to migrate from structured streaming?

#ApacheSpark #DeclarativePipelines with #DeltaLake and #UnityCatalog (all OSS and released already! 🔥)

Delta Lake for Rust Hacking x.com/i/broadcasts/1…

@matei_zaharia @YoussefMrini Congrats Matei. You’ve done so much to shape where distributed computing and AI/ML are today. Well deserved.

Definitely a surprise! It wouldn't have been possible without my awesome collaborators and students.