Max Gabrielsson

224 posts

Max Gabrielsson

Max Gabrielsson

@Maxxen_

Software Engineer @ DuckDB Labs Compiler/Database/Web/Distributed/Low-Level/Constraint/Geospatial/Parallel/Game/Systems/All-Around Programming

Katılım Haziran 2012
212 Takip Edilen296 Takipçiler
Max Gabrielsson retweetledi
Hiroaki Yutani
Hiroaki Yutani@yutannihilation·
DuckDB v1.5 で本体に入る GEOMETRY 型のドキュメントができてた。細かいところまで説明してくれて勉強になる duckdb.org/docs/preview/s…
日本語
0
2
6
417
Max Gabrielsson
Max Gabrielsson@Maxxen_·
@penberg How do you deal with cross-database dependencies of types? E.g. what happens if i attach database A and B, and then use a custom type stored in A when creating a table in B? What if I detach A after and persist B? Or drop from A after detaching B?
English
2
0
2
417
Pekka Enberg
Pekka Enberg@penberg·
Turso 0.5.0 is now out! ⚡ Concurrent writes is now beta 🔍 Full-text search with Tantivy 🔒 STRICT mode stable + user-defined types Big thanks to the 50+ people who contributed over 3,000 commits into this release! turso.tech/blog/turso-0.5…
English
7
24
182
58.1K
Max Gabrielsson retweetledi
skooks
skooks@skooookum·
day 30 of unemployment
skooks tweet media
English
6
8
462
11.7K
Max Gabrielsson retweetledi
DuckDB
DuckDB@duckdb·
Today we're launching DuckLake, an integrated data lake and catalog format powered by SQL. DuckLake unlocks next-generation data warehousing where compute is local, consistency central, and storage scales till infinity. ⁠DuckLake is an open standard and we've implemented it in the "ducklake" DuckDB extension. – Read the announcement blog post at duckdb.org/2025/05/27/duc… – Visit the new DuckLake website at ducklake.select
DuckDB tweet media
English
22
196
685
102K
Max Gabrielsson retweetledi
DuckDB
DuckDB@duckdb·
We are brewing something exciting for next week ⏳
DuckDB tweet media
English
15
21
217
27.8K
Max Gabrielsson
Max Gabrielsson@Maxxen_·
Or ducked in general. You're losing so much of the benefits of vectorized execution if you trash the cache with allocator calls - not to mention the contention caused when allocating from different threads.
English
1
0
1
257
Max Gabrielsson
Max Gabrielsson@Maxxen_·
Here are some interesting profiling results. Having DuckDB executing a large join with the new spatial join operator, it spends about 50% of the time just _deserializing_ and constructing GEOS geometries, 15% just calling GEOS destructors, and just 2% evaluating the predicate 🥲
Max Gabrielsson tweet media
English
2
1
39
1.7K
Hiroaki Yutani
Hiroaki Yutani@yutannihilation·
@Maxxen_ Oh, sorry for the spoiler! I'm looking forward to seeing the progress👍
English
1
0
0
19
Max Gabrielsson
Max Gabrielsson@Maxxen_·
@thomasforth @duckdb Yeah at some point we should have a native geojson reader - but its complex since we already have a very advanced general json reader in the json extension, and I don't really know how to provide the same capabilities (eg schema inference) without copying all the code...
English
0
0
1
50
Tom Forth
Tom Forth@thomasforth·
@duckdb Step 1 works great. File is reduced in size from 1.3GB to 60MB with no loss of quality that could materially effect the results of the query. Safely throwing away data early is a data science power move and tends to separate good from quite people.
Tom Forth tweet media
English
2
0
2
1.4K
Tom Forth
Tom Forth@thomasforth·
A while back, before I built my "population within a circle for the whole world" tool, I built a "population and the associated density within concentric for anywhere in Great Britain" tool. It's still online it still works. But,... tomforth.co.uk/ringpopulation…
Tom Forth tweet media
English
3
2
15
12.5K
Juan Pablo
Juan Pablo@jpurrutia4·
@matsonj All I want is for this to be the new DuckDB logo
Juan Pablo tweet media
English
1
0
3
125
Jacob Matson
Jacob Matson@matsonj·
in some ways you could say the future is already here
Jacob Matson tweet media
English
6
0
51
1.8K
Max Gabrielsson
Max Gabrielsson@Maxxen_·
@zack_overflow Reminds me of the rabbit-hole related to printing floats. "Print a double with the least amount of digits to still round-trip without loss of precision", printf("%g") won't do it, and it turns out be surprisingly hard (and performance expensive).
English
1
0
23
4.1K
zack
zack@zack_overflow·
They literally asked the dude who invented the conservative garbage collector to make a calculator app... And even he couldn't do it alone This is the most insane level of programmer nerd sniping I've ever read
Nauseam (in sf!)@ChadNauseam

"A calculator app? Anyone could make that." Not true. A calculator should show you the result of the mathematical expression you entered. That's much, much harder than it sounds. What I'm about to tell you is the greatest calculator app development story ever told.

English
13
100
2K
153.9K
Max Gabrielsson
Max Gabrielsson@Maxxen_·
@paolo_pash It's what PROJ gives as the "name" for the projection. Im still undecided on what to use as the display name, but regardless, the actual projection parameters are stored under-the-hood (and is what is used when comparing two geometry types).
English
1
0
0
45
Pasha P.
Pasha P.@paolo_pash·
@Maxxen_ But 3857 is also based on wgs84. Why did they use such an ambiguous data type description?
English
1
0
0
69
Max Gabrielsson
Max Gabrielsson@Maxxen_·
Experimenting with CRS tracking support in DuckDB Spatial 🗺️👀
Max Gabrielsson tweet media
English
1
5
19
1.3K
Max Gabrielsson retweetledi
DuckDB
DuckDB@duckdb·
New blog post: Query Engines: Gatekeepers of the Parquet File Format In this post, Laurens Kuiper argues that we are wasting a lot of bits by not using the Parquet format to its full extent – a limitation caused by the lack of support for Parquet features in some systems. duckdb.org/2025/01/22/par…
DuckDB tweet media
English
5
39
191
18.2K