Fredrik Ljunggren (it / that)

@mim_djo Are you still coming to Stockholm?

@cfmj I am afraid to ask what do you mean :)

my session for FabCon europe was not accepted :( I guess there is worst thing in life 🙃😒

@mim_djo I'll be there.

@cfmj thanks, yes, I hope too 😁

I did too :)

@mim_djo What about Daft? Today was the first time I heard about it. delta.io/blog/daft-delt…

Clash of the CSV #Polars vs #DuckDB The Duck is just too fast, but more seriously, just don't use Pandas 🙃😛 github.com/djouallah/Ligh…

Today I misspelled template for templet (the temple in Swedish) so now we're building the the temple of ingestion, the temple of transformations and the shrine of sharing. All in the church of data. I will die on this hill.

@mim_djo So this means you can have deltatable as source and target in dbt, using duckdb as engine?

I guess it is official now, #DuckDB is adding support to #Deltalake databricks.com/dataaisummit/s…

@matsonj Very much so. We're taking on 2 "tech talents" this summer, through a consultancy firm. They will stay for a year and rotate through our data stack. Hopefully they find their passion and talent somewhere.

idk if this is a hot take but data jobs in particular seem like they would benefit from apprenticeships.

@matsonj @powerbottomdad1 What? Double doubles doubles and animal fries? I've been to Las Vegas twice because of in-n-out.

@powerbottomdad1 the european mind cannot comprehend this

just landed in USA

@mim_djo @JoshCaplan1984 I read that as "blob house" and immediately thought there is a new warehouse concept I've totally missed. Anyway, is anyone developing a blob house?

@JoshCaplan1984 I am still at stage 1, writing from Fabric notebook to the local blobfuse github.com/delta-io/delta…

write to #Fabric #Onelake failed, someone opened a new bug report, @JoshCaplan1984 see I am not the only one github.com/delta-io/delta…

@matsonj @ArynnPost VM? I just buy a new MacBook.

@ArynnPost "so whenever i get an environment conflict, i just delete my VM and start over"

me showing the new guy on my team how to use python for data analysis

@matsonj Written by top voodoo economists

some nice SQL to write

@matsonj Removing the output from analytic_v2_bak34.ipynb

the best PR i will submit this month

@pdrmnvd No, more like chimney cake I guess. But they seem very similar.

@pdrmnvd Funnel cakes, like Hungarian funnel cakes? Kurtös kalacs?

What's a good ratio for data team vs growth/marketing team size? We're an online health provider, 3rd biggest in the country (Sweden). We turn 10 years this spring and leaving the startup phase, focus on turning profit.

@matsonj @ArynnPost So synapse is a wrapper for data factory, data lake, sql pools etc, and fabric is a wrapper for synapse, powerbi, git?

@ArynnPost the big win here is Fabric™️ though, which is sort of hard to wrap my brain around

I didn’t expect this. Wow!

@matsonj @ArynnPost What's even worse, can't ask chatGPT to explain Fabric like I'm 10.

@FaisalMaqbool94 I might need to clarify that the code tests is for an interview for data engineering role. 😁

@cfmj raw/base getting filled by ingested tools or scripts. Then dbt-audit or apply all the tests from base to staging to production. All kinds of tests, missing data, freshness, fields mapping and the list goes on. And, run tests based on requirements, hourly etc. maybe ?

Is it common to perform code tests for data engineering roles? In that case, how? Do you set up a source and ask them to ingest, audit, publish, transform and visualize? Do you limit the tools?