Daniel Bartley

11.9K posts

Daniel Bartley

Daniel Bartley

@dbrtly_

data engineering | recovering pissed off analyst | solver of problems | husband | dad for two girls | Australian

Sydney, New South Wales Katılım Aralık 2013
4.6K Takip Edilen898 Takipçiler
NRLCentral
NRLCentral@centralNRL·
Parramatta have appointed Dragons legend Mark Gasnier as a specialist coach for their outside backs. Gasnier will mentor high-profile recruit Zac Lomax, who joined the Eels seeking a permanent centre role. #nrl #parraeels
NRLCentral tweet media
English
1
0
2
312
Charlie Marsh
Charlie Marsh@charliermarsh·
POV: you just migrated to uv for package publishing
Charlie Marsh tweet media
English
7
6
189
10K
ABC
ABC@Ubunta·
I’m exploring @daft_dataframe to evaluate its performance and complexity in comparison to Apache Spark! At first glance, Daft is optimized for single-node use, but on a single node, I’d prefer @DataPolars for most cases. However, Daft becomes distributed by leveraging @raydistributed, so if you’re already familiar with Ray, there’s no new setup or learning curve for distributed configurations. github.com/Eventual-Inc/D… Daft is ready for Open Data Format and supports @ApacheIceberg writes 🙃, making it a potential go-to for managing Iceberg data! Daft shows impressive speed, though I’m curious if that’s due to Ray’s distribution capabilities or something unique within Daft. It’s too early to say it outperforms Spark, but I’ll continue using it to get a clearer sense!
English
2
2
19
1.4K
Guillermo Rauch
Guillermo Rauch@rauchg·
Some engineering principles I live by: ✓ Make it work, make it right, make it fast ✓ Progressive disclosure of complexity ✓ Minimize the number of concepts & modes ✓ Most 'flukes' aren't… your tech just sucks ✓ Feedback must be given to users instantly ✓ Maximize user exposure hours ✓ Demo your software frequently to fresh eyes ✓ Sweat every word of product copy you render ✓ You're never done working on performance ✓ You're never done. Software ages like milk, not wine ✓ Visualizing traces of time is the best way to optimize it ✓ Ship frequently and strive to build in public ✓ Errors must have globally unique codes & hyperlinks ✓ Red is not enough to signal "error" (8% of men have red-green color blindness)
English
55
299
2.7K
200.6K
Apache Beam
Apache Beam@ApacheBeam·
You can now access the first recordings of the conference on the Apache Beam Youtube Channel. Rewatch your favorite talks and catch any that you missed! A few talks are still pending, so stay tuned for updates once they're published. 📽 🎉 tinyurl.com/bdcthcf5
English
1
0
0
380
Charlie Marsh
Charlie Marsh@charliermarsh·
Open source dark pattern: someone at a company opens an issue, then a bunch of their coworkers upvote it and comment saying they have the same problem 🤡
English
33
35
1K
76.3K
Daniel Bartley
Daniel Bartley@dbrtly_·
@pawjast I agree that pyproject.toml is the starting point for any python configand you can install directly from that file’s specs.
English
0
0
1
18
Pawel Jastrzebski 🇵🇱 🇬🇧
@dbrtly_ You're right in saying there are always cases where you might need to extend or look for a completely different solution. And I'm not saying 'pyproject. toml' is a one-shoe-fit-all kind of solution. But it's a good start.
English
1
0
0
56
Pawel Jastrzebski 🇵🇱 🇬🇧
If you need to package your Python code, there's a tonne of tutorials that tell you to use 'setup .py' and 'requirements .txt'. But unless I'm mistaken, nowadays it's advised you replace these two with 'pyproject .toml'.
English
6
0
9
570
Daniel Bartley
Daniel Bartley@dbrtly_·
@rakyll I still like gcp. I just dont want googlers to get bored with it and go looking for shiny things users dont care about. I want gcloud cli as a single binary like aws cli v2. Column labels & expanded trailing comma support in bigquery. An extra 5 gb in cloud shell.
English
0
0
1
192
Jaana Dogan ヤナ ドガン
It’s possible that Google’s most major problem is self inflicted gate keeping of its own tech. Earlier Google was a inspiring infra builder because it was easier to build publicly. Network effect created major communities around several of our foundational tech initiatives.
English
18
10
239
34.9K
Devon Stewart
Devon Stewart@blast_hardchese·
After a bit of burn-in time, I'm happy to share that we switched the @Replit Agent from Poetry to @astral_sh's uv and are seeing significantly faster installs. Thank you @charliermarsh and team!
English
4
3
41
19.8K