Zach R

One of the first things I like to do with new hires is show them our global asset lineage in Dagster (the master DAG). It looks something like this

Ok proud work moment, we are #1 on the App Store right now! I modelled all the tracking/telemetry data, integrating it with existing web analytics pipelines so we have one stop shop datasets for all our web/app sessions and conversion funnels

Me getting back into the gym

Holy shit, this was > 5 years ago?

DuckLake is cool. Next question, how do we scale the local querying? Let my iPhone 15, laptop and desktop scale out a query on 1TB of data

Just finished my first day as a staff engineering manager at Google under the GCP division. A little overwhelming, but I think the changes we just pushed should really improve performance for everyone. Signing off for the weekend!

@matsonj Waiting for the day when I can test pipelines locally without paying for BigQuery slots on my 70tb Google Analytics 4 data

why does this matter? you can run workloads in the range of 100 TB on a single DuckDB node. while it doesn't work without some tuning, this is a huge milestone for what is possible with DuckDB and MotherDuck.

TPC-H SF 100,000 has been achieved internally.

Everyone else: LLMs are amazing, they are going to automate you out of a job Me to LLM: Return BigQuery SQL that does a thing LLM: Here is Redshift SQL Me: ???

Snowflake releasing semantic views, meaning you can semantic/metric layer directly in your cloud DW: docs.snowflake.com/en/user-guide/… I'm here for it, but I don't see docs yet on how you would consume from the semantic view. Maybe like select conversion_rate() from semantic_view?

good data > no data > bad data

just wait til you get to your 30s

everybody wanna train a ML model but nobody wanna clean no big ass data

@haro_ca_ first impressions matter!

new job starts today, main priority is to aura farm as fast as possible

Tech debt is good actually * Good if your middleware SQL logic enables business to know WTF was going on thru 3 site migrations and web analytics platforms

@haro_ca_ I get it

people keep telling me that quitting without another job offer was a bad idea but they haven’t considered that I’m just too fucking cracked

@tayloramurphy bsky.app/profile/drgonz…

wait until Trump finds out Tesla still calls it Gulf of Mexico

@theRealslimcam Tell me more plz

@zachrenwick Yes

Anyone here used Looker (as a semantic/metrics layer) and Tableau together? How is the native Looker to Tableau connector?

BigQuery just released UNION ALL BY NAME It solves the issue of perfectly aligning each field properly in SQL. As long as the fields have the same name you're good!

@svpino letmegooglethat.com/?q=When+was+th…

When was the last time you Googled something?

There's so much value to add anywhere along the data chain. Honestly, blending business context (analyst focus) with data modeling is an extremely impactful role. Yes there's some shit AE models out there, but I've seen some terrible SQL written by data engineers too

Another analytics engineering (AE) LinkedIn bash post. Hard to not react (my current job) but having an AE title does not assume you will build a spaghetti data architecture. There are tons of data engineers who create perfectly optimized data models that are used by no one.