Amit

295 posts

Amit

Amit

@amitk_abk

Geek, Punny, Indian. Views are my own! “The greatest religion is to be true to your own nature. Have faith in yourselves.” ― Swami Vivekananda

Katılım Ocak 2016
88 Takip Edilen10 Takipçiler
Amit
Amit@amitk_abk·
@system_monarch Thank you for sharing these concepts in depth and concisely! Much appreciated!!
English
1
0
1
525
Puneet Patwari
Puneet Patwari@system_monarch·
1) Load Balancing: x.com/system_monarch… 2) CDN: x.com/system_monarch… 3) Caching: x.com/system_monarch… 4) Cache Invalidation: x.com/system_monarch… 5) Rate Limiting: x.com/system_monarch… 6) API Gateway: x.com/system_monarch… 7) CAP Theorem: x.com/system_monarch… 8) Sharding: x.com/system_monarch… 9) Replication: x.com/system_monarch… 10) Partitioning: x.com/system_monarch… 11) Queues: x.com/system_monarch… 12) Microservices: x.com/system_monarch… 13) Microservices Vs Monoliths: x.com/system_monarch… 14) Fault Tolerance: x.com/system_monarch… 15) Database Scaling: x.com/system_monarch… 16) Service Discovery: x.com/system_monarch… 17) Consistency models: x.com/system_monarch… 18) Eventual Consistency: x.com/system_monarch… 19) Distributed Transactions: x.com/system_monarch… 20) Leader Election: x.com/system_monarch… 21) Horizontal vs Vertical Scaling: x.com/system_monarch… 22) Back of the Envelope Estimation: x.com/system_monarch… 23) Idempotency, Data Latency & Finale: x.com/system_monarch…
Puneet Patwari@system_monarch

I've started a 25-day series on Scaling and Architecture. One topic per day. Day 1: Load Balancing Day 2: CDN Day 3: Caching (the 5 layers) Day 4: Cache Invalidation Day 5: Rate Limiting Today is Day 6: API Gateway. If load balancing is how you distribute traffic and rate limiting is how you control it, the API gateway is the front door that decides what gets in, how it gets routed, and what happens before your backend ever sees it. Thread below 👇

English
1
32
203
12.8K
Puneet Patwari
Puneet Patwari@system_monarch·
A month ago, I told everyone: "I've been a backend Engineer for 12+ years. Today, I'm a Principal Engineer at Atlassian. I've designed systems that handle millions of requests. Sat on both sides of system design interviews. Reviewed more architecture docs than I can count. Starting today, I'm breaking down the fundamentals of scaling for the next 25 days. If you're learning system design bookmark this thread, you're going to get a lot of learning from this." FYI, the series has concluded. Here are all the concepts, please bookmark, share, learn and the most important build from the learnings you get. Also, if you have any ideas on what you'd like to see from me, please let me know, any other series or concepts to be broken down.
English
35
102
1.3K
101.3K
Amit
Amit@amitk_abk·
@system_monarch Thank you Puneet for such a great series! In Lease based leadership, how typically a leader renews its lease? Would it need another component for it? What if leader and that component are unfortunately partitioned allowing leader to renew lease but still disconnected from rest?
English
0
0
0
1
Puneet Patwari
Puneet Patwari@system_monarch·
Tweet 3/5 The split-brain problem and fencing This is the thing that took GitHub down. And it's the most dangerous failure mode in leader election. How split-brain happens: 1. Leader (Node A) is running fine 2. Network partition isolates Node A from the rest of the cluster 3. Nodes B, C, D, E can't hear Node A's heartbeats 4. They elect a new leader: Node B 5. But Node A is still alive. It doesn't know it's been replaced. It still thinks it's the leader. Now you have two leaders. Both accepting writes. Both making decisions. Clients connected to Node A write one thing. Clients connected to Node B write something different. Data diverges. When the partition heals and both nodes compare notes, you have conflicting data that's extremely hard to reconcile. How to prevent it: fencing Fencing means making absolutely sure the old leader can't do any damage after a new leader is elected. Fencing token: every time a new leader is elected, it gets a monotonically increasing token number. Any operation includes this token. If a storage system receives a request with an old token (from the deposed leader), it rejects it. The old leader's requests simply stop working. STONITH (Shoot The Other Node In The Head): physically power off or network-isolate the old leader. Sounds extreme. It is. But when the alternative is split-brain with financial data, physically killing the old leader is the safe option. Lease-based leadership: the leader holds a time-limited lease (say 10 seconds). It must renew the lease before it expires. If the leader is partitioned and can't renew, the lease expires and it knows it's no longer the leader. It stops accepting writes voluntarily. This is what most cloud-native systems use. It's simpler than fencing tokens and handles most cases. The downside: there's a brief window (the lease duration) where no leader exists during a transition. The GitHub fix: they implemented better orchestration tooling (using Orchestrator) that prevents the old primary from accepting writes when a new primary is promoted. Essentially automated fencing.
Puneet Patwari tweet media
English
2
0
4
417
Puneet Patwari
Puneet Patwari@system_monarch·
GitHub, October 2018. A network partition lasted 43 seconds and caused a 24 hour outage. The MySQL cluster panicked. Elected a new primary. The old primary didn't get the memo. Two leaders. Both accepting writes. Both convinced they were the source of truth. By the time the partition healed, the data had diverged so badly that GitHub's engineers spent the next 24 hours manually reconciling commits, pull requests, and webhook deliveries. Here's why this happened 👇
English
3
4
40
6K
Amit
Amit@amitk_abk·
@surnell sir, how long would this be open? There is name mismatch for me with Aadhar, I have submitted for its correction. But there is address change as well (same constituency). So hopefully, I will be able to address both within time (if there is any time limit for it).
English
1
0
0
93
Suresh
Suresh@surnell·
#Karnataka Fill out your #SIR form right on your mobile! It did not take me more than 4 minutes for submitting revisions online. Visit voters.eci.gov.in. Use approproate Forms and Submit via Aadhaar e-Sign. Let us weed out illegal voters #OurVoteOurRight
English
29
209
788
71.3K
Amit
Amit@amitk_abk·
@JoeyMannarino Very well deserved...congrats Britts! Wishing you many many more..looking at your policies it wont be surprised that you all will be swimming among them like grey ducks very soon...!!
English
0
0
0
5
Joey Mannarino
Joey Mannarino@JoeyMannarino·
Imagine being born in Manchester as a white British person and having to live amongst this shit. Who the hell allowed this to happen?
English
2.7K
10.2K
47.5K
813.9K
Amit
Amit@amitk_abk·
@skm_utd @NewsAlgebraIND wake up dumbo...its not 2006 anymore...or did you loose ability to count properly...
English
0
0
3
55
Utd_SKM
Utd_SKM@skm_utd·
@NewsAlgebraIND Of course he trusts India since they have their puppets ruling us
English
4
0
26
2.2K
News Algebra
News Algebra@NewsAlgebraIND·
US SENATOR : "When I travel to China, I leave my phone in Washington instead of taking it with me. But when I travel to India, I bring this phone with me. That shows how much I trust India. I can't do the same in China"
English
197
1.3K
8.1K
237.2K
Amit
Amit@amitk_abk·
@NewsAlgebraIND .....and he thinks we trust him or US....🤣🤣 seriously, clowntown america at its majestic display..!!
English
0
0
0
261
Amit
Amit@amitk_abk·
@BesuraTaansane Indeed, iyer's PR worked around the clock for this success. They exceeded all expectations to make this happen portraying GG in bad light. But looks like iyer is hell bent on proving them wrong! Sooner the better..!!
English
0
0
0
3
Sameer
Sameer@BesuraTaansane·
So chhapri Shreyas Iyer made an embarrassing debut as captain of Indian T20I team with a humiliating 34 run loss to minnows Ireland - the first ever lossy to Ireland in any format He failed both as a captain and batter scoring just 3 of 7 balls #IndvsIre
English
15
12
149
5.2K
Amit
Amit@amitk_abk·
@CRED_club Really..!!?!! We must be thankful that you haven't enabled retina scan or face recognition...........yet!!
English
0
0
0
202
CRED
CRED@CRED_club·
touching...🥲
English
16
5
68
9.7K
Amit
Amit@amitk_abk·
@namma_vjy No siree, you don't live in desert, we at C V Raman nagar, HAL live..! Only rains are in watery eyes after seeing different VCs.. :(
English
0
0
1
26
Amit
Amit@amitk_abk·
@namma_vjy So Gottigere has officially lost its crown as "Bangalore Desert". That now belongs to HAL - C V Raman Nagar :( Enjoy..!!
English
0
0
0
10
Amit
Amit@amitk_abk·
@BrianMcDonaldIE You are saying as if its for the first time this is said and you are hearing it for very first time! Isn't this a consistent stance by India ever since this issue started? OR has EU taken leaf out of its Orange Buffoon master's playbook to play dumb? Or are both dumb really?
English
0
0
0
31
Brian McDonald
Brian McDonald@BrianMcDonaldIE·
Indian Foreign Minister Subrahmanyam Jaishankar says India bought Russian oil after 2022 partly because Washington secretly asked for it. “At that time, the US specifically asked India to buy Russian oil to stabilise the oil market,” Jaishankar said at an event in Finland, according to Bloomberg. Jaishankar also rejected the moralising around Russian oil purchases. “Let’s not pretend that this is about some great principles,” he said. “I don’t think hypocrisy is appropriate here.” .
Brian McDonald tweet media
English
12
76
390
45K
Amit
Amit@amitk_abk·
@alexstubb @DrSJaishankar Its so brave of you to keep smiling and pretending all is well like your Orange Buffoon master despite being shown mirror time and again to reflect your own dirty faces..bravo..!
English
0
0
0
13
Alexander Stubb
Alexander Stubb@alexstubb·
Thank you for participating in the Kultaranta Talks, @DrSJaishankar. It was good to hear your views on the situation in the Middle East and Russia’s war of aggression in Ukraine. India is an influential player on the world stage. Honoured to have Dr. Jaishankar here!
Alexander Stubb tweet media
English
38
266
2.7K
36.8K
Amit
Amit@amitk_abk·
@finland227 @alexstubb @DrSJaishankar Why? Is Ukraine a damsel in distress and world is bound to save it from....hmmm....Russia, in a game that NATO started...? How does this math work unless you and your Orange master think rest of world as your foot-mat?
English
0
0
0
13
Amit
Amit@amitk_abk·
@HondaCarIndia Have had a few really nice, memorable trips in Elevate! It is fun & I love to drive it. But similar to @Brijesh23382433, due to some "good" experiences I pray that I don't get to visit service center for anything. How can everyone of them be bad while product is so awesome?
English
0
0
0
16
Amit
Amit@amitk_abk·
@surnell When PM felicitated different workers (few times at-least), 'they' called it 'tamasha' & what not...But this is most noble thing only raga can perform & it shouldn't be called as staged performance, should it? Anyway, upgrade from eating at random, poor house in OWN constituency.
English
0
0
0
5
Amit
Amit@amitk_abk·
@alpha_defense 'This' and no one will ask existential questions, they may mock at best..! But with ISRO....
English
0
0
0
12
Alpha Defense™🇮🇳
Alpha Defense™🇮🇳@alpha_defense·
Jeff Bezos' Blue Origin's New Glenn Rocket Explodes During Test
Deutsch
18
66
1.1K
32.4K
Amit
Amit@amitk_abk·
@namma_vjy Its sad that trees fall in much awaited TS but worst that fallen trees aren't replaced, the place stays vacant for a while, becomes dump yard after and eventually gets concretized..
English
0
0
0
13
Amit
Amit@amitk_abk·
@namma_vjy Latest Crown jewel of Bengaluru desert of 2026, #HAL is receiving TS rains now..much relieved..!
English
0
0
1
15
Namma Karnataka Weather
Namma Karnataka Weather@namma_vjy·
🛑 TS CAUTION FOR BENGALURU Friends there is high possibility for TS rains in Bengaluru this evening between [6.00PM to 10.00PM[. Take adequate care and escape Bengaluru Traffic Jam :) Note: Avoid staying under trees during TS rains. Its dangerous. #BengaluruRains
Namma Karnataka Weather tweet media
English
14
6
77
5.4K
Amit
Amit@amitk_abk·
@surnell Isn't she the one having unbeaten track record of screwing up careers of politicians whoever she met or interviewed??
English
0
1
1
2.1K
Suresh
Suresh@surnell·
Saar. Yaake Saar. Karnataka CM issue settled. Best wishes for next time now
Suresh tweet media
English
2
2
44
16K