Elliana May - @[email protected]

We are proud to release the first major version of DuckDB, v1.0.0, codenamed "Snow Duck". This version is a culmination of almost six years of research and development. Today we are shipping an innovative database system with a backwards-compatible storage format. Check out our announcement blog post: duckdb.org/2024/06/03/ann…

@p_mbanugo @duckdb UHugeInt was only recently added to DuckDB, so support is still in progress

@duckdb Hey @duckdb experts. I'm trying some SQL in the browser shell, is there any reason why I'd be getting this error? {"exception_type":"Not implemented", "exception_message":"Unsupported Arrow type UHUGEINT"}

experimenting with collecting logs for scheduled function on cronatlas.com and decided I could make a log manager for my @flydotio apps as well. The advantage is that I can query faster and store for long period compared to using expensive log services. #buildinpublic

@mlafeldt @duckdb Are you building a DuckDB extension in Rust? I'd be interested in hearing how you go if you do

TIL: You can load @duckdb extensions directly from a local library file that doesn't end with ".duckdb_extension". I always used to copy build artifacts to ~/.duckdb/extensions, which is in fact what INSTALL can do locally as well. Neat!💥

@tschlic @itsjoenaso Then standard python file io should work? I'm not sure I understand your problem

@Mause_me @itsjoenaso No, I'm trying to do this from within python modules! Appreciate the effort though

Building a data pipeline? Take the extra 10 minutes to put your sql in its own file and read it in instead of using an inline Python string. It’s worth it.

@tschlic @itsjoenaso If you're using the cli, the .read command is probably what you want?

@itsjoenaso How do I do this with duckdb I've been trying to figure it out forever

@mlafeldt I'm curious what part of the build system you see as being peculiar?

I wish DuckDB was written in Rust. That huge C++ codebase with its peculiar build system gives me the chills every time I dare to look at it. Kudos to anyone who can be productive in such an environment. I guess tons of tests make it work somehow.

Hey folks, I've decided I need a change and am leaving my day job (not DuckDB, don't worry). If anyone has any leads on interesting remote jobs in Australia or Aotearoa (or in person in Perth), please feel free to hit me up

@ThiagoTDotCom @duckdb @streamlit Did you mean to tag @motherduck? #how-are-duckdb-the-duckdb-foundation-duckdb-labs-and-motherduck-related" target="_blank" rel="nofollow noopener">duckdb.org/faq#how-are-du…

Hey @duckdb, I was reading your article [1] (thanks for the @streamlit shout-out BTW!), and you don't need to call set_index() here:     st.line_chart(df_monthly.set_index('month')) Instead, just do:     st.line_chart(df_monthly, x='month') Nicer! [1] motherduck.com/blog/the-futur…

@nicoritschel @criccomini @duckdb I wouldn't say it's by design exactly, more that it would be difficult to keep up to date with how much the storage format has changed over the last year (though in theory it should be relatively stable going forward). @criccomini did you have a particular question in mind?

@criccomini @duckdb My understanding is the lack of documentation is by design. Maybe that changes with 1.0 though. See duckdblabs.com/news/2023/10/0…

Is there a writeup somewhere on @duckdb's internal storage format? I'm looking at duckdb.org/internals/stor… but it doesn't describe the actual on-disk structure (AFAICT).

@pdeyhim I can't seem to find reproduction information anywhere on your benchmark website. Are you planning on publishing it anywhere?

Revisited DuckDB's performance: Previously fast but struggled with big data. Latest check on new versions shows a dip in speed starting with 0.8.1. #DuckDB @pdeyhim/progression-of-duckdb-performance-649b83e02b17" target="_blank" rel="nofollow noopener">medium.com/@pdeyhim/progr…

Every company needs 2-3 senior+ engineers who have fuck you money or just have 0 fear of getting fired. Then when the architect or tech fellow or whoever unveil their new plan, those engineers unmute to say wtf is this, we're not moving everything into Lambda, are you high???

@0xJMOZ I'd be curious to see if the duckdb results change if you remove the extra CSV read

Reading and filtering a csv in polars is 2.8x faster than duckdb 🧐 #python

@milicevica23 fsspec when using the python interface?

Ways to access a remote #duckdb file, anything i miss? 1. Empty dbt project with dbt power user plugin 2. Buenavista server with PrestoSQL jdbc 3. Native duckdb cli 4. Harlequin duckdb ide for terminal (this one is cool)

@dacort Hey there, this is definitely not an error you should be able to get anymore. If it's reproducible, can you raise an issue?

Yea, don't think this'll happen. Same error, different U-Haul location.

Alright, frens. It's Friday and I've got some spare time at THE OFFICE so I'm going to see if I can use the @duckdb Spark API to whip up a local example of my favorite "extreme_weather.py" script. Let's go.

DuckDB Labs is announcing a new support policy for the DuckDB project, including a flexible commercial support option. duckdblabs.com/news/2023/10/0…

@isecurefi @adityawarmanfw @duckdb Not for this release unfortunately, still work to be done in that space (as we can't just reuse the same http client library)

@adityawarmanfw @duckdb Hopefully the httpfs capabilities gets added too.

Sooo excited for the upcoming extension loading in @duckdb wasm duckdb.org/docs/api/wasm/…

@developerjack Somewhat yes, this is the ui package they built & use: primer.style/react/drafts/M…

@hamiltonulmer I think we've just added support for lambdas with multiple args, so this might be possible now?

I like DuckDB's COLUMNS lambda option, but I wish the argument returned a struct w/ the column info rather than just the column name. One opt would be to expand the args to include the struct. Like this: select median(columns(((col, info) -> info.type like '%INT%')) FROM x

What if I implement Chrome's Topics API in a Firefox extension but make it so that it always just returns ["Cheese"]? 🤔