Distributed Bytes

3.6K posts

Distributed Bytes banner
Distributed Bytes

Distributed Bytes

@DistribSystems

I tweet/retweet interesting stuff about #DistributedSystems and #compsci. Suggest links/papers/conversations via DM! Tag for retweets. Run by @federico_ponzi

शामिल हुए Ocak 2017
229 फ़ॉलोइंग6K फ़ॉलोवर्स
Distributed Bytes रीट्वीट किया
Almog Gavra
Almog Gavra@almoggavra·
@DistribSystems Thanks for sharing this! Happy to answer any questions
English
1
1
1
389
Distributed Bytes
Distributed Bytes@DistribSystems·
the mathematics of compression in database systems bitsxpages.com/p/the-mathemat… I started thinking about compression when implementing prefix compression for SlateDB. When I ran benchmarks, I noticed that performance seemed "worse" despite improved compression ratios.
Distributed Bytes tweet media
English
1
17
172
7.4K
Distributed Bytes रीट्वीट किया
Marc Brooker
Marc Brooker@MarcJBrooker·
I think this is broadly correct. But I'd focus on specification instead - getting good at thinking about and formally writing down the safety, liveness, and performance properties of the system. Verification follows from specification.
gabe@allgarbled

I think the best investment you could make right now if you work on distributed systems would be to get really good at methods for verifying systems correctness and performance

English
3
10
95
11.1K
Distributed Bytes
Distributed Bytes@DistribSystems·
One-off Verified Transpilation with Claude will62794.github.io/verification/l… We can automatically check correctness properties of a TLA+ specification using TLC, a model checker that will exhaustively explore a spec’s reachable states and check that some specified property holds.
Distributed Bytes tweet media
English
0
1
4
841
Distributed Bytes रीट्वीट किया
Marc Brooker
Marc Brooker@MarcJBrooker·
One thing I find interesting about OpenAI's Postgres blog post is how similar their approach is to the one we took in the early days of EC2. Keeping up with rapid early scale is a whole set of technical challenges, and you have to pick your battles.
English
3
3
113
9.2K
Distributed Bytes रीट्वीट किया
Marc Brooker
Marc Brooker@MarcJBrooker·
Aurora DSQL offers strongly consistent reads across multiple AWS regions, faster than the speed of light. How is this possible?
Marc Brooker tweet media
English
7
9
125
18K
Distributed Bytes
Distributed Bytes@DistribSystems·
On Idempotency Keys morling.dev/blog/on-idempo… In distributed systems, there’s a common understanding that it is not possible to guarantee exactly-once delivery of messages. What is possible though is exactly-once processing.
Distributed Bytes tweet media
English
1
4
32
2.6K
Distributed Bytes रीट्वीट किया
Murat Demirbas (Distributolog)
Murat Demirbas (Distributolog)@muratdemirbas·
TLA+ Community Event 2026 - conf.tlapl.us/2026-etaps/ Co-located with ETAPS 2026 in Torino, Italy, on April 12, 2026. Submit talk proposals by Jan 31 on: - industrial or academic case studies, - new tools for TLA+ or add-ons to existing tools, - innovative use of existing tools or reports on their shortcomings, - use of TLA+ in education.
English
0
3
23
2.4K
Distributed Bytes रीट्वीट किया
Andy Pavlo (@andypavlo.bsky.social)
Do you like databases? Do you want to hear two database professors rant about them? Do you need one of those professors to have a Turing Award for databases? If yes, then join Mike Stonebraker and I next Wed Dec 10 @ 1:00pm EST for database hot takes: dbos.dev/webcast-2025-i…
English
9
51
293
25.2K
Distributed Bytes
Distributed Bytes@DistribSystems·
What Does Write Skew Look Like? justinjaffray.com/what-does-writ… This post is about gaining intuition for Write Skew, and, by extension, Snapshot Isolation. Snapshot Isolation is billed as a transaction isolation level that offers a good mix between performance and correctness.
Distributed Bytes tweet media
English
1
3
37
2.7K
Distributed Bytes रीट्वीट किया
Abhishek Singh
Abhishek Singh@0xlelouch_·
Distributed Locking with Redis Redlock When multiple services need mutually exclusive access to a shared resource (files, counters, payments, job execution), you need a distributed lock. I recently came across this redlock algorithm by redis and it's a true distributed systems masterpiece BUT DONT USE IT FOR CONSENSUS --- A single-node Redis lock (SET key value NX PX=TTL) is fast but unsafe: Redis can crash → lock disappears Network partitions → split-brain Clients can pause → act with expired locks So Redis proposed Redlock: Use N = 5 independent Redis nodes. Client tries to acquire the lock on all nodes with a TTL. If it obtains ≥ 3/5 locks within a bounded time window → lock is considered acquired. But here’s the problem — Redlock relies on timing assumptions. To be safe, Redlock implicitly assumes: bounded clock drift bounded process pauses bounded network delays TTLs expiring “on time” In real distributed systems, none of these hold. Your process can GC-pause for seconds. Packets can be delayed for minutes (yes, this has happened at GitHub). NTP can jump the system clock forward/backwards. A Redis node can crash and lose the key before syncing. If any of these happen, Redlock can violate safety: Two clients can both think they hold the lock. This is fatal if the lock protects correctness (e.g., money movement, inventory writes). The deeper issue: Redlock has no fencing tokens. Correct distributed locking requires monotonically increasing fencing tokens: Client A acquires lock → token 33 Client B acquires lock → token 34 Downstream systems (DB, S3, job processor) must reject old tokens. Redlock returns random values — not monotonic. So you can't build correctness guarantees on top of it. TL;DR Redlock ≠ consensus Redlock ≠ safe under arbitrary delays Redlock ≠ safe under clock drift Redlock ≠ safe for correctness-critical locks Redlock is okay only for “prevent duplicate work” use cases If correctness matters → use ZooKeeper/etcd/Consul. They implement real consensus and generate fencing tokens reliably.
Distributed Bytes@DistribSystems

How to do distributed locking martin.kleppmann.com/2016/02/08/how… Redis has been making inroads into areas of data management where there are stronger consistency and durability expectations. Distributed locking is one of those areas. Let’s examine it in some more detail.

English
6
28
281
28.5K
Distributed Bytes
Distributed Bytes@DistribSystems·
How to do distributed locking martin.kleppmann.com/2016/02/08/how… Redis has been making inroads into areas of data management where there are stronger consistency and durability expectations. Distributed locking is one of those areas. Let’s examine it in some more detail.
Distributed Bytes tweet media
English
2
26
206
39K
Distributed Bytes रीट्वीट किया
Marc Brooker
Marc Brooker@MarcJBrooker·
I have no doubt that disaggregation is going to continue to be a good bet in the DB market. The really interesting thing to watch is how the hardware trends of AI (especially tons of network bandwidth, and highly connected low-latency networks) change disaggregated architectures.
Murat Demirbas (Distributolog)@muratdemirbas

[new blog post] Disaggregated Database Management Systems muratbuffalo.blogspot.com/2025/11/disagg…

English
5
13
73
13.6K