Nicholas Gates

Vortex is BOTH 38% smaller and has 10–25x faster scans than Parquet+ZStd for TPC-H SF10 We implemented BtrBlocks-style cascading compression in Vortex that recursively tries codecs like ALP, FSST, and bit-packing, letting the data pick the best encoding spiraldb.com/post/cascading…

@jhorstmann23 @andrewlamb1111 You can use cargo bench to run the in-repo benchmarks: github.com/spiraldb/fastl… Downside as you say is you always need to pad to 1k values

@ngates_ @andrewlamb1111 I'd love to run some benchmarks on this, but the api confuses me. Is there some example how to unpack from &[u8] to &[u16] with a given bit width? Especially if the length is dynamic and not necessarily a multiple of 1024?

It came up on the Parquet sync today if anyone has practical experience with comparing FastLanes encoding vs "classic" bit packing (without the transposed/reshuffled layouts). If you have would love to know your experience

@mitchellh As a visitor to the repository I am really just trying to establish how much I should trust the thing. I actually find the update timestamps one of the strongest indicators, without ever reading the file names

Using GitHub as an example but all forges are similar so not singling them out here This page is mostly useless. It's the repo homepage, it should not be useless. * Red - Literally never use * Blue - Don't use it and duplicated * Orange - I browse w/ `t` (Go to file), not this Note this is for the default layout view for a repository that I create/maintain. The layout makes more sense for a visitor to the repository.

@julianhyde Python’s yield has a corresponding “yield from” that behaves like this

Morel needs a flatMap operation, so I'm adding one. But what should I call it? (Other systems call it flatMap, SelectMany, >>=, concatMap. And remember, Morel's one-in-one-out project operator is called 'yield'.)

🚀

Slightly late to the party here, but could the billion dollar #ErasTour really not figure out how to center a digital clock…

We can't be the only ones who compete with `cargo clean`

I bet there aren't any other file formats that come with a slick terminal explorer 😎

And so it begins… a shame to see Iceberg caving in to DataBricks on technical design decisions whose only benefit is better compatibility with Delta. lists.apache.org/thread/wyon0kv…

They said no one would get my @olivianj reference

Fsst & Furious

@iliaaamiri After a lifetime of GC’d languages, the best way I found to learn Rust was to learn Zig…

After a decade of fighting spell checkers at work, I have chosen this Fourth of July weekend to finally surrender 🇺🇸

It's kind of ridiculous that OIDC authentication is not more widespread. PyPi leading the way. If I have to copy one more god token...

@grinich auth0.com/docs/get-start…

@ngates_ do you need a code generated? what's the full flow?

Does no one except @auth0 support OAuth 2.0 Device Auth Flow? I've checked @stytchauth, @WorkOS, @FronteggForSaaS, @HeyKinde, @supabase Thinking of creating a CloudFlare worker to MITM this...

@grinich Trying to support login from a command line application, so there’s no callback URL for PKCE flow. Same flow is used by Smart TV apps where you enter a code on your phone/laptop.

@ngates_ what's your use case?

@criccomini @databricks Are any @databricks open-source projects real? OSS Unity != DataBricks Unity OSS Delta != DataBricks Delta OSS Spark != DataBricks Spark/Photon

Interesting. I didn’t realize the recently open sourced @databricks unity catalog is a complete rewrite, not the original (proprietary) one.

Check out our inaugural blog post by @ngates_ describing the FastLanes compression layout and how you too can decode >100 billion integers per second! blog.spiraldb.com/life-in-the-fa…