Mike Cornell

🛑 👀 Stop using multiple/different tools for stream processing and batch processing! linkedin.com/posts/datamic_…

@JohannesVink How is this different from OneLake (which you claim is better) where if I have access to the underlying storage I can easily read the files? (see screenshot below of me browsing Delta Lake files/contents in OneLake). Or Snowflake when using Iceberg tables in S3/GCS/ADLS/OneLake?

@TXMikeC Anyone who has access to the storage account can read the data. Normally if I could access SQL Server database files, I could do nothing with it due to encryption at rest (TDE).

Often you need within the lines of what a vendor describes. Databricks describes a lot about encryption, but skips one important matter; data at rest; aka Delta tables are NOT encrypted. By default that means that Databricks is not GDPR compliant. learn.microsoft.com/en-us/azure/da…

👀 I am floored with how fast Databricks Lakebase Autoscaling starts/provisions. Going from the "New Project" button through to ready-to-query Postgres instance in seconds How much time do you spend waiting on databases to provision? 🤔 lnkd.in/gyFfMfEW

@mim_djo Can’t wait for the blog! 🍿

blog coming with more details running #TPCH 1 TB in #MicrosoftFabric using #Datawarehouse ( using managed delta table) #Apachespark #duckdb and SQL endpoint ( aka DWH but with external delta table) the winner is the Data warehouse 🥳🪅🎉🥳 the real winner is table stats 😜

👀

👀 #DataAISummit is a month away! Look forward to connecting with enterprises, partners, and old colleagues and friends! Hope to see you there! sprou.tt/1gCBIkXOzBD

@DataMozart I don’t think Databricks Unity Mirroring actually creates a copy into Fabric/OneLake like the other mirrors. It acts more like a shortcut (🤦🏻). (Docs: “there is no data movement”)

Mirroring or shortcuts in #MicrosoftFabric? That's one of the questions I'm getting most frequently when being asked about accessing the external data. So, I've decided to create a simple infographic that depicts the differences between these two and some common use cases.

👀

🔥 You can now publish and refresh #PowerBI Semantic models directly from Databricks Workflows. This makes it super simple to make Unity Catalog datasets available in Power BI and keep those Power BI models fresh when your data changes! databricks.com/blog/announcin…

🍿 Save the query to load the results to table and schedule it with a Job to easily automate the forecast at whatever interval you need to Learn more here: learn.microsoft.com/en-us/azure/da… /3

🔥 Use "group_col" argument to make it easy to forecast for every grouping you have (product, store, etc.) /2

👀 The ai_forecast() SQL function in Databricks allows you to execute forecasts directly on time series tables with a single line of code! /1

@DataMozart 💪, Why not include DirectQuery also?

#MicrosoftFabric friends, I'm currently working on the decision tree for Import vs Direct Lake mode. I'd kindly ask take a look at the illustration below and provide feedback or input in case I missed something important (and I'm sure I did😉). Thank you very much in advance.

👀 Databricks and SAP are knocking down walls for enterprises by bringing the best data and AI platform straight to the most critical business data linkedin.com/posts/datamic_…

👀 My 13 year old kiddo just got 19. 💪@pulisic @HTXSoccer

👀Awesome write up of a customer’s modernization/optimization journey from a legacy Databricks + Snowflake architecture to a Databricks Lakehouse linkedin.com/posts/datamic_…

👀 Fast, secure, and reliable data pipelines are key to enabling data intelligence for enterprises. Watch Bilal Aslam talk about the motivations, philosophies, and innovations driving the next generation of data engineering in the lakehouse. youtube.com/watch?v=vPLBZe…

@KratosBi @JohannesVink Many are keeping their data in ADLS as it serves Databricks and/or Fabric just fine (ie Fabric create a table in Shortcut'd ADLS and Databricks can pick it up as an external table in Unity). There's still some considerations/heartburn with Databricks interacting with OneLake

@JohannesVink Hmmmm, idk.. I would imagine so. I have not explored that side of it.

This is the ULTIMATE Data Strategy!!! Databricks and Microsoft Fabric tag-team for the Intercontinental Belt is the hands-down winner and champion! Not only is this a huge winner for any company, but it is also SUPER easy to implement and integrate with the new Databricks mirroring capabilities in Fabric. OneLake makes this all a dream come true. #MicrosoftFabric #PowerBI #DataEngineering youtu.be/hzSq-36OrM0

Lots of good stuff here. Databricks is the enterprise standard/core. Enterprises aren't moving away from it to Fabric, but when spoked use-cases/departments/teams are interested in using Fabric, there are a number of 💪 patterns that unlock them without compromising their core

@GBrueckl @mim_djo This. abfs paths are so 2021 😉

@mim_djo Do you know if there is any plan to also integrate the tables from the lakehouse SELECT * FROM Fabric.mylakehouse.mytable

coming soon to your #Microsoftfabric Python notebook, just read Delta directly using abfss path, no needs to upgrade #duckdb and mess with secret