Sabitlenmiş Tweet
I'm re-releasing the generalized consensus series one blog at a time for easier ingestion. Today, it will be the first two parts: Defining the Problem and Setting the Requirements. Links in 🧵
English
Sugu Sougoumarane
960 posts
Sugu Sougoumarane
@ssougou
Head of Multigres @Supabase, Co-creator @vitessio
Katılım Şubat 2012
164 Takip Edilen3.3K Takipçiler
Sugu Sougoumarane retweetledi
Our next South Bay Systems meetup will be on March 31. We've got two awesome deep-dive talks:
- @ssougou will present deconstructing consensus and its application to Multigres
- @stuhood will talk about how modern full-text search is evolving toward columnar systems (and the tricky optimization challenges)
Food and beverages will be provided, courtesy of our hosts, @Snowflake
Come hang out with the systems crowd 👇
English
I'm so happy to be part of this journey.
Paul Copplestone - e/postgres@kiwicopple
There are now 7M developers using @supabase Signups have been accelerating since the start of the year Our growth rate right now is as fast as it was during YC, except that we are doing it from a base of millions of developers instead of thousands
English
Sugu Sougoumarane retweetledi
We are pleased to inform our community that access to Supabase’s website supabase.co has now been fully restored for all users across India. We sincerely thank the Ministry of Electronics and Information Technology (MeitY) for their prompt action and constructive engagement in resolving this matter.
Access to our services has been fully restored, and we deeply appreciate the continued patience and support of builders, developers, and businesses across India. Thank you for your patience while we worked through this incident.
status.supabase.com
English
Sugu Sougoumarane retweetledi
Yesterday we had an outage affecting all services in the us-east-2 (Ohio) region
We have published the post-mortem:
supabase.com/blog/supabase-…
This post is an account of what happened, how it happened, and the concrete steps we are taking to make sure it does not happen again. We know you depend on Supabase to be reliable. We let you down in both reliability and communications.
I am grateful to every customer who reported issues, waited patiently, and provided feedback on how we can improve. We will make major structural changes to earn back your trust.
Paul Copplestone - e/postgres@kiwicopple
Today we had an outage that ran for 3h42m, affecting 4.92% of our customers. All systems in us-east-2 were affected. I'm sorry to everyone affected. There is no good excuse - you trust us with your infra and we need to do better. We already have mitigations in place and we're working on a post-mortem. We will post it in the next 12 hours.
English
.@guptamanan100 reveals how he built the Postgres compatible @multigres parser in go: multigres.com/blog/ai-parser…
English
Sugu Sougoumarane retweetledi
@coreyward Both Multigres & OrioleDB are landing this year and they will be industry-leading for performance
English
Sugu Sougoumarane retweetledi
we are looking for someone to lead CLI development at @supabase
this is becoming one of the most critical interfaces for devs/agents
tag the best Go dev that you know and if we hire them I'll give you $1,000 of Supabase credits
They don't need CLI experience, they just need to have a good product sense. My pitch for Supabase:
◆ we're open source
◆ we don't do geo-adjusted pay
◆ we have an async work culture
◆ most engineers have 1 meeting per week
◆ we're full distributed across 50 countries
◆ we power the world's fasted growing companies
Application link ↓
jobs.ashbyhq.com/supabase/1e7a9…
English
@MarcJBrooker I almost replied yes also, but changed it to no: R+W formula works only for the positive case of discovering completed transactions. But you can also discover those that may later be abandoned due to failover:
x.com/ssougou/status…
Sugu Sougoumarane@ssougou
@kellabyte Simple answer is no: You don't know if what you're reading has reached quorum. Any data that hasn't reached quorum can be rolled back if there's a failure. I've listed a few viable approaches here: multigres.com/blog/generaliz….
English
Does this ensure consistency? Yes, because R+W>N (in this case, 2+2>3). To go back to the 1970s:
Kelly Sommers@kellabyte
If you have consensus writes with agreement across all 3 nodes, a quorum (2 nodes) read would allow a slightly faster read path not waiting for the slowest node to respond while still guaranteeing read your own write semantics. Am I understanding this correctly?
English
@kellabyte Simple answer is no: You don't know if what you're reading has reached quorum. Any data that hasn't reached quorum can be rolled back if there's a failure. I've listed a few viable approaches here: multigres.com/blog/generaliz….
English
If you have consensus writes with agreement across all 3 nodes, a quorum (2 nodes) read would allow a slightly faster read path not waiting for the slowest node to respond while still guaranteeing read your own write semantics.
Am I understanding this correctly?
English
@jorandirkgreef Storage is the hardest to scale horizontally.
English
DistSys Interview Challenge
Many factors may limit a system’s ability to scale.
But which limit dominates a system’s ability to scale?
English
Sugu Sougoumarane retweetledi
@aakashgupta > They’ll recommend Supabase today and something better tomorrow
Ironically the way we got to this point was to make it incredibly easy for our users to migrate away
This Principle has been in our docs for 5 years now:
English
Sugu Sougoumarane retweetledi
@multigres will land on supabase early next year
features:
◆ Sharding
◆ Local NVMe disks
◆ Cross-zone failover
◆ Automated Backups
◆ Built-in Observability
◆ Change Data Capture
◆ Built-in Connection Pooler
◆ Built-in Database Protection
◆ Migrations across PG versions
English
Sugu Sougoumarane retweetledi
Sugu Sougoumarane retweetledi
Sugu Sougoumarane retweetledi
at @supabase we're building:
◆ a new storage engine for Postgres
◆ an open source sharding engine for Postgres
◆ an open source ETL engine for Postgres
◆ an FDW extension to query anything from Postgres
we hire talented people who just want to build. come us ↓
English
@kscooooo You read this in one day? That is an impressive feat 🙇.
English
Sugu Sougoumarane retweetledi
I'll be at the Palo Alto meetup if you wanna chat @multigres
Paul Copplestone - e/postgres@kiwicopple
this month the @supabase community are running meetups in 38 cities around the world:
English
@kiwicopple @ovaistariq Just got here. I'll come find you :).
English
I am here at KubeCon Atlanta booth no. 1762, in case you want to chat about fast storage!
English
I'll be at Kubecon next week. Who else is going? Looking forward to meeting a lot of you.
English
@Eloq_Data Are you talking about a system like Aurora? I thought they avoid the need for checkpointing by directly materializing pages from the logs.
English
The conclusion of the Generalized Consensus series is a recap of everything we covered. As a bonus, we propose a design to change Raft into a generalized solution. multigres.com/blog/generaliz…
English