Chris Comeau

58 posts

Chris Comeau banner
Chris Comeau

Chris Comeau

@ccomeau79

Katılım Ekim 2013
43 Takip Edilen155 Takipçiler
Chris Comeau retweetledi
🕹️ Alexander Gallego ⚡️
SUPER excited to announce REDPANDA CONNECT There simply does not exist a more complete end to end streaming platform from embedded iot to the largest cloud workloads. Same software. Any scale Welcome @Jeffail and team to the #redpanda family. Youtube stream tomorrow! #kafka
🕹️ Alexander Gallego ⚡️ tweet media
Redpanda Data@redpandadata

🎉 Check our our big news as covered in the @TechCrunch interview of Redpanda founder/CEO @emaxerrno -- "What Benthos does for us is that it creates the most complete end-to-end streaming platform for data-intensive applications." Read the full article here 👇 techcrunch.com/2024/05/30/red…

English
4
16
57
9.9K
Chris Comeau
Chris Comeau@ccomeau79·
@RussellSPierce Here's a review from someone with much more experience than me. I think the issues he mentioned with tiered storage were fixed already. So far my experience is the same. Ops simplicity was the main draw for me. (will be using this blog to learn Flink too) streamingdata.substack.com/p/one-year-wit…
English
0
0
1
7
Russell S. Pierce
Russell S. Pierce@RussellSPierce·
@ccomeau79 I hope to catch your posts on RedPanda. It looked tempting, but I've not had a chance to use it yet.
English
1
0
0
22
Russell S. Pierce
Russell S. Pierce@RussellSPierce·
> forcing a hand rolled API layer at least guaranteed some level of thought and blast zone for refactoring See also why (often) event driven architecture with domain driven design is great and why blind change data capture was extra horrible. The extra effort is good actually.
dax@thdxr

ok time’s up here’s the deal with server actions if you’re excited about them you’re wrong if you’re mad about them you’re wrong let’s do this unfortunately @t3dotgg was right - the key thing the haters are misunderstanding is that NextJS is a backend framework in your head think about it like express or any other http server - you wouldn’t be surprised if you could return html and do a database call right next to it except it’s a better express because it lets you build all kinds of complex interactive clients via React fundamentally there’s nothing wrong with this - you’ve been doing it forever in every other language, just never with this kind of focus on the frontend bits but sorry nextjs fans you’re wrong too for dismissing people’s worries about “separation of concerns” the only real job you have as a programmer is encapsulation - figuring out what details to hide and what to expose and because this is your one job, of course you’re all terrible at it forcing a hand rolled API layer at least guaranteed some level of thought and blast zone for refactoring with that gone, doing the wrong thing just got a lot easier it’s why in past generations, the frameworks had some encapsulation ideas built in (to varying degrees of being useful) all the acronyms, MVC, MVVM, DDD yes can be overkill but the root ideas exist for a reason asp.net had these ideas baked in, elixir’s phoenix has a tutorial about bounded contexts right at the beginning, PHP only got lambos once Laravel nudged you into a stricter structure are they perfect? no. but they’re a hell of a lot better than whatever you’re about to come up with given that NextJS has no philosophy on this problem at all so a lot of you are about to repeat all the same mistakes we’ve seen a generation ago if you don’t slow down

English
2
1
5
963
Chris Comeau
Chris Comeau@ccomeau79·
@medriscoll @wesmckinn @duckdb @hfmuehleisen @wesmckinn Does Arrow have something like this already? Say I have 20 small tables in a single DuckDB file, and want to transform to some Arrow-native container of Arrow tables. DuckDB binary files formats aren't meant for this (changing binary format) but maybe Arrow can do it
English
0
0
0
64
Chris Comeau
Chris Comeau@ccomeau79·
@medriscoll @wesmckinn @duckdb @hfmuehleisen I see an opportunity for a creative kind of serialization here - Arrow-ish, but a container of tables - multiple schema in one file. Taking Rich Hickey's "database as a value" literally... what if our snapshot unit is "a duckdb file"? Tried it, layered zstd on top... could work
English
1
0
1
906
Michael E. Driscoll
Michael E. Driscoll@medriscoll·
This morning I was lucky enough to catch up with @duckdb creator @hfmuehleisen. I asked him the most surprising pattern he's observed for DuckDB in the wild. He shared that it's not just interactive use cases that are driving adoption, such as powering faster data applications (what we use it for at @rilldata). What surprised Hannes is that DuckDB is being widely adopted for non-interactive, *infrastructure* use cases. And then I was watching @josh_wills' talk about the dbt adapter for DuckDB and one slide stood out: "Data Modeling without the Data Warehouse." Okay, so most firms have barely just made the transition to cloud data warehouses, and now some of us are advocating a data stack that leap frogs it entirely? Why? * File formats like Parquet can be queried like database tables, thanks to DuckDB magic like "select * from 's3://mybucket/*.parquet'" * Except there's no database server to manage or maintain Imagine all the benefits of SQL, its widespread literacy, its broad interoperability with tools (DBT, IDEs, language APIs, BI tools) without the overhead, cost, and potential lock-in of data warehouse. This is why infrastructure use cases are migrating to DuckDB.
Michael E. Driscoll tweet media
English
10
39
244
69K
Chris Comeau
Chris Comeau@ccomeau79·
@emaxerrno A fine tradition. I liked this one for Postgres. Now we need one for @ClickHouseDB too... although now that I'm looking at it, their logo kind of looks like plates on one side of a loaded bar already
Chris Comeau tweet media
English
1
0
1
176
Chris Comeau retweetledi
Melvyn Peignon 🇪🇺 🇫🇷 🇬🇧
It is good to see more happening around @ApacheIceberg. @ClickHouseDB integration with Apache Iceberg has been released in 23.2, and we are already seeing a lot of adoption! clickhouse.com/docs/en/engine…
Tanya Bragin@tbragin

Yesterday @tabulario got Series B funding (congrats to the team!) Insightful post about why open data architectures are increasingly favored - I agree there is no "one size fits all" tool for every compute task. Great to see investment in this space! linkedin.com/pulse/tabular-…

English
1
2
11
1.3K
Chris Comeau retweetledi
ClickHouse
ClickHouse@ClickHouseDB·
James Morrison shares how @Cloudflare made their first commits to #ClickHouse in 2016, the same year it was open-sourced. Cloudflare’s usage has grown exponentially with 1000+ active replicas & hundreds of millions of rows inserted/sec.
ClickHouse tweet media
English
1
2
9
487
Chris Comeau
Chris Comeau@ccomeau79·
@BartoszMilewski Cool, welcome to Canada. I've been working through your book interleaved with a few others. I think you might like Tai-Danae Bradley's work - some parts remind me of your talk re: potential limits of decomposition and human understanding. math3ma.com/about
English
1
0
0
99
Bartosz Milewski
Bartosz Milewski@BartoszMilewski·
It looks like on Sep 20 I'll be giving a semiar on category theory and programming in Waterloo, Canada.
English
2
2
52
4.2K
Chris Comeau retweetledi
Pedro Holanda
Pedro Holanda@holanda_pe·
My DuckDB - ADBC blog post is out! ADBC is a database-agnostic API developed by @VoltronData, catered for analytical DBMSs. Using ADBC is almost 40x faster than ODBC in DuckDB. I'm really looking forward to seeing more analytical systems implement this!
DuckDB@duckdb

New blog post by @pdet: DuckDB ADBC - Zero-Copy data transfer via Arrow Database Connectivity duckdb.org/2023/08/04/adb…

English
1
14
75
10.9K
🕹️ Alexander Gallego ⚡️
Has anyone done a deep technical dive on vector dbs indexing mechanics. Ie. Interested in on disk format layouts etc.
English
9
1
23
4.6K
Chris Comeau
Chris Comeau@ccomeau79·
@emaxerrno DuckDB is another interesting point for comparison where it fits, but definitely CH for coverage of distributed system concerns.
English
1
0
0
110
Chris Comeau
Chris Comeau@ccomeau79·
@davefarley77 I think category theory gets to the heart of some things you're seeing around composability and managing complexity... but it's quite an uphill battle to get there. Definitely a helpful book
English
0
0
1
52
Dave Farley
Dave Farley@davefarley77·
I am so pleased that my book on software engineering resonates with so many people. Got your's yet? 📙amzn.to/3rjCnXn
Dave Farley tweet media
English
8
5
84
10.9K
Chris Comeau retweetledi
Simon Späti 🏔️
Simon Späti 🏔️@sspaeti·
It takes a lot of work to keep up with the latest data engineering. We (@AirbyteHQ) created a state-of-data.com to keep up with yearly trends. Check out the exciting results from 886 participants, concluding the largest data engineering survey.
Simon Späti 🏔️ tweet media
English
0
5
26
6.5K
Chris Comeau retweetledi
Phil Eaton
Phil Eaton@eatonphil·
@hamiltonulmer I love it when software supports best effort timestamp parsing. I was inspired by this ever since I noticed it in ClickHouse. #parsedatetimebesteffort" target="_blank" rel="nofollow noopener">clickhouse.com/docs/en/sql-re…
English
1
3
19
2.7K