Marek Siarkowicz

216 posts

Marek Siarkowicz banner
Marek Siarkowicz

Marek Siarkowicz

@serathius

Senior software engineer @Google, @etcdio tech lead in @kubernetesio. Opinions are my own

Poland Katılım Haziran 2011
299 Takip Edilen344 Takipçiler
Marek Siarkowicz
Marek Siarkowicz@serathius·
@danielepolencic I would appreciate proper research. While it is not always easy to get accurate information, open source maintainers don't bite. At least not all of them. Each community has its own chat and public meetings, where you can ask questions. They would appreciate feedback too.
English
0
0
0
9
Daniele Polencic — @danielepolencic@hachyderm.io
@serathius Marek I replied to you on Reddit, I’m more than welcome to amend my articles and writing. My intent is to help folks. But I’d appreciate a more compassionate tone from you
English
1
0
0
27
Daniele Polencic — @danielepolencic@hachyderm.io
etcd is the database behind every Kubernetes cluster. You can run one for years without thinking about it. Then your cluster gets big enough, and etcd is all you think about. A thread on why. 🧵
Daniele Polencic — @danielepolencic@hachyderm.io tweet media
English
8
30
240
16.9K
Marek Siarkowicz
Marek Siarkowicz@serathius·
@danielepolencic Again, you didn't understand the motivation. It's not project A vs project B. It's the fact that AWS journal and Spanner use Atomic clocks for concensus. That allows for clean horizontal scaling of distributed system, don't expect something like this in open source.
English
0
0
0
9
Daniele Polencic — @danielepolencic@hachyderm.io
K3s ships Kine, a shim that speaks the etcd API but stores data in SQLite or PostgreSQL. AWS replaced Raft with a journal service. Google swapped in Spanner. All kept the etcd API.
Daniele Polencic — @danielepolencic@hachyderm.io tweet media
English
2
0
11
860
Marek Siarkowicz
Marek Siarkowicz@serathius·
@danielepolencic Have you ever run etcd in production? Or are you collecting random complaints from the internet from people trying to use etcd with NFS? Etcd is not perfect, but the fact that some people can struggle with 3 node K8s, while others run 30k without a problem is interesting.
English
0
0
0
8
Daniele Polencic — @danielepolencic@hachyderm.io
What breaks: Quota alarms: database fills up, control plane freezes Compaction lag: revisions grow faster than cleanup Snapshot pressure: multi-GiB transfers choke the leader Slow watches: event fan-out saturates CPU and network
Daniele Polencic — @danielepolencic@hachyderm.io tweet media
English
2
0
4
729
Marek Siarkowicz
Marek Siarkowicz@serathius·
@danielepolencic What have watch events to the leader? Totally unrelated. Watch events are distributed totally outside raft concensus. Also API server demuxes the watch request so that there is just one watch per resource. So number of controllers has no impact on etcd. github.com/etcd-io/etcd/i…
English
0
0
0
8
Daniele Polencic — @danielepolencic@hachyderm.io
Controllers don't poll. They open long-lived watch connections and etcd streams events on every change. At scale the leader spends more time distributing events than processing writes.
Daniele Polencic — @danielepolencic@hachyderm.io tweet media
English
2
0
3
762
Marek Siarkowicz
Marek Siarkowicz@serathius·
@danielepolencic Here we go again... 8GB is an old limit that was never revisited or updated. Most cloud providers run etcd with 20GB-30GB without much problem. Usually it's Kubernetes that breaks when you put a lot of data in a single resource or namespace. Read github.com/kubernetes/kub…
English
1
0
0
21
Daniele Polencic — @danielepolencic@hachyderm.io
The database is a single file on disk, capped at 8 GiB. Every mutation adds a new revision and etcd never overwrites the old one. 10,000 pods updated per minute = 10,000 revisions piling up.
Daniele Polencic — @danielepolencic@hachyderm.io tweet media
English
2
0
5
829
Marek Siarkowicz
Marek Siarkowicz@serathius·
@indygupta Pretty sure this fact was well established over 7 years ago in multiple Reddit posts. Fact that you can doesn't automatically means that you should set limits for all your containers. Maybe we should give the discussion a rest and just put it in official documentation? @thockin
English
0
0
0
20
Indranil Gupta
Indranil Gupta@indygupta·
Stop using CPU Limits! (Yes, it's ok, you can say it aloud now...we have data to back it up...) SoCC 2025 talk by my student Chirag Shetty, with Saurabh Jha and other IBMers. Paper: arxiv.org/abs/2510.10747
Indranil Gupta tweet mediaIndranil Gupta tweet mediaIndranil Gupta tweet mediaIndranil Gupta tweet media
English
2
3
6
617
Marek Siarkowicz retweetledi
Mischa van den Burg
Mischa van den Burg@mischavdburg·
I haven't been to an office in 2 years. I work in my pajamas making multiple six figures. Thank you, Kubernetes.
English
18
15
328
12.3K
Marek Siarkowicz retweetledi
Antonio Ojea
Antonio Ojea@Itsuugo·
The future is really collaborative and community driven
Antonio Ojea tweet media
English
2
1
15
664
Marek Siarkowicz retweetledi
Antithesis
Antithesis@AntithesisHQ·
Today our CEO, Will Wilson, announced a partnership with @CloudNativeFdn to provide free reliability testing for Graduated and Incubating projects. Stop by booth 457 to learn more. @etcdio maintainer @serathius is presenting at 12 today in the Project Pavilion about the work we did together to help advance etcd testing!
Antithesis tweet mediaAntithesis tweet media
English
0
3
6
798
Marek Siarkowicz retweetledi
The New Stack
The New Stack@thenewstack·
How do you make a foundational project like etcd truly robust? 🤔 @ha_joslyn sits down with @serathius (@Google) at #KubeCon to discuss how the etcd maintainer community used the challenge of DST to drive better, more rigorous testing.
The New Stack tweet media
English
0
1
4
459
Marek Siarkowicz retweetledi
Google Cloud Poland
Google Cloud Poland@GoogleCloud_PL·
Świętujemy 10-lecie @CloudNativeFdn 🎉 Spotkajmy się na jubileuszowej edycji Cloud Native Warsaw meetup #cTENcf, gdzie poza🎂czekają na Was porywające sesje, w tym powrót do korzeni Kubernetes, panele dyskusyjne, networking i więcej. Szczegóły: goo.gle/3LsBaJo
Google Cloud Poland tweet media
Polski
0
1
3
259
Marek Siarkowicz retweetledi
Antithesis
Antithesis@AntithesisHQ·
We're incredibly proud that the @CloudNativeFdn relies on Antithesis to ensure that the cloud is built on solid foundations. @serathius and the maintainers of @etcdio wrote about their use of Antithesis on the CNCF blog today, and we look forward to working with CNCF to secure their other open source projects. Code is infrastructure. Link below.
Antithesis tweet media
English
1
3
7
693