Marius van Niekerk

I'm writing Go again (for what, you'll see later...). `go doc` and `gopls` are like agent superpowers and its shocking how productive agents are out of the box at writing [good] Go code versus other languages I've used (including the JS ecosystem). Also, Go + Zig is a good mix. Go for the higher level and concurrent stuff and then no-libc Zig code plus the Zig compiler for zero dependency cross-compiled cgo with high-performance characteristics (minimize cgo boundary crosses). Chefs kiss. Its funny because a lot of the shitty ergonomics of Go CLIs like `go doc` and `gopls` (prev. stuff like `go oracle` or `guru`) are totally obviated by agents and not just that but in a twist of irony they're excellent for agents. Don't worry, its not Ghostty. Ghostty and libghostty will remain pure Zig; it's a fantastic fit and a perfect pairing. This is for something else. "Wait, I thought you said Go has no place anymore?" I was wrong, mostly because agents are so productive at Go. I won't bring in other languages in this discussion because I don't want to feed the crabs, so to speak. lol.

Its happening -- DataFusion will (finally) get spilling hash joins. The march to completeness begins

Very exciting

hey @ProjectJupyter users, we're trying to assess the removal of qtconsole from the jupyter metapackage: there's a poll on discourse: discourse.jupyter.org/t/poll-and-fee… and there's also a github issue: github.com/jupyter/jupyte…

Need a high-performance data transport and processing stack with a minimized footprint? Get to know nanoarrow. This lightweight version of @ApacheArrow helps you build optimized components in Arrow-based pipelines. Learn more! voltrondata.com/resources/nano…

@Mbussonn @hynek It has been super handy for @condaforge

@hynek will there be a way to send metadata patches ? like future version of dependency incompatible ?

Nice, wheel METADATA files are now (aka 10d ago 🤪) available directly from PyPI! This is a big deal b/c (once it’s backfillled), tools won’t have to download wheels & unpack them to get pkg metadata (including dependencies) for the vast majority of pkgs! discuss.python.org/t/pep-658-is-n…

New book coming out

Are you a developer/data scientist/data engineer w/ a passion 4 contributing to & helping ppl use #opensource #data tools like @ApacheArrow? Know #rstats or #Python or #Cpp? @VoltronData is hiring! jobs.lever.co/VoltronData/eb…

@zahra_mor @condaproject Take a look at conda-lock, it may help you manage "loosely defined" environment.yaml into fixed locked defined envs for all platforms. github.com/conda-incubato…

@casseytoi Wait brakanjan is available? Maybe I should check it out for nostalgia sake

Brakanjan is now playing. The grumps happening though 😑😑

Folks, any suggestions for good for the 8 year old Afrikaans shows to watch? This second language homework is driving me batty. With the occasional isiXhosa reinforcement, at least we're struggling together...not so much with Afrikaans.

Voltron Data grabs $110M to build startup based on Apache Arrow project tcrn.ch/3HYca6d by @ron_miller

The dumbest piece of the modern data stack: 1. Store columnar data in an RDBMS. 2. Pivot that data to a row-oriented format for transport over the wire. 3. Pivot the row-oriented format back to columnar for viz/analysis. We gotta fix this. arrow.apache.org/blog/2022/02/1…

@codecentric @DStalzJohn You should give mamba instead of conda a try. This is much faster than conda and @condaforge has a vast amount of pre-built Python for the M1. Then instead of lengthy conflict messages, you should get a hint which packages are missing.

If you need to update the dependencies of python recipes on @condaforge , in an open PR please call "@conda-grayskull show requirements" and it will add a comment of which deps need to be updated

Come join me @ianmcook and @keithjkraus on the product team at @VoltronData!

Do you have a passion for supporting, building & contributing to open-source tools for data analytics? @VoltronData is hiring! Technical Product Manager + other roles, fully remote & globally friendly🌎🌏voltrondata.com/careers/

I am so excited to have joined the talented @VoltronData team 🚀 to support ppl & teams leverage @ApacheArrow in their data work #allthelanguages #makenocopies #efficientandfast #opensource

Today, and every day, we aim to create a culture at @VoltronData where women are compensated and empowered as equals. If you are a woman software engineer considering a career move, we would love to talk to you. Perry@voltrondata.com #WomensEqualityDay lnkd.in/g3QBnY2E

@casseytoi Just add a case of wine and you're good to go anywhere

Jerall's boot is literally a tell me you're South African without telling my you're South African space - man has 21kg of braai wood in it. He says you never know when you need to braai 🤷🏾

New release of pydantic_cli with improved support for boolean fields and better output from --help. Support for List/Set add (via @__mvn__) as well as enhanced Enum handling. Great way to turn #pydantic defined data models in #Python into CLI tools. github.com/mpkocher/pydan…