Yash Singhal ๐Ÿ”ฅ

491 posts

Yash Singhal ๐Ÿ”ฅ banner
Yash Singhal ๐Ÿ”ฅ

Yash Singhal ๐Ÿ”ฅ

@yash_25log

Eng @ IFAI๐Ÿš€ | Ex- InteligenAI, CrossTower๐Ÿ‘จโ€๐Ÿ’ป | Sharing backend, design & dev experiments โš—๏ธ | Hackathons ๐Ÿ† | 22 | โšก Helping devs grow

Delhi, IND Katฤฑlฤฑm Mayฤฑs 2021
1.6K Takip Edilen210 Takipรงiler
SabitlenmiลŸ Tweet
Yash Singhal ๐Ÿ”ฅ
Yash Singhal ๐Ÿ”ฅ@yash_25logยท
1:03 AM. PM texts: โ€œQuick change-can we just add dark mode before release?โ€ I turned off notifications. Because my soul already is in dark mode. The feature is complete.
English
0
0
3
56
Yash Singhal ๐Ÿ”ฅ
Yash Singhal ๐Ÿ”ฅ@yash_25logยท
@kirat_tw Reading it on Twitter hits different than experiencing it at 3AM in production. ๐Ÿ˜ญ๐Ÿ”ฅ
English
0
0
1
12
Harkirat Singh
Harkirat Singh@kirat_twยท
Move fast, break things. Momentum is everything. Failing is probably better than not trying. Unfortunately these things should be experienced in hindsight and not read on twitter.
English
82
233
2.9K
52.3K
Yash Singhal ๐Ÿ”ฅ
Yash Singhal ๐Ÿ”ฅ@yash_25logยท
@mehulmpt Bro didnโ€™t just warn us, he basically posted the spoiler alert for the whole outage arc. ๐Ÿ˜‚
English
0
0
0
21
Arpit Bhayani
Arpit Bhayani@arpit_bhayaniยท
Range-based partitioning is like an amoeba. You split when a partition gets hot, you merge when things cool down, and you move the partition across nodes (and transitively the data, if needed) when you want to grow beyond a single machine. The best part of range-based partitioning is that it sits in the middle between hash and static approaches. It avoids the randomness of hash ownership and the heavy metadata burden of static ownership. That's why, for stateful workloads, so many systems, operating at scale, prefer range-based ownership.
English
6
5
137
10.4K
Archie Sengupta
Archie Sengupta@archiexzzzยท
JSON is a token-hungry parasitic dinosaur. If you look at openai/tiktoken, the pre-trained BPE vocabulary has most JSON structural characters - brackets, commas, quotes - as individual tokens in the vocabulary. This means even a small JSON can emit >1000 tokens, since every {, }, ", :, and , burns a separate token. Now imagine your use case: you're ingesting some massive JSON response from an MCP server tool, and you need to shove it all into your LLM for inference. Your cost just went through the roof. I've been there. We were constantly hitting into context windows longer than 1M tokens, just inferring over these giant JSON strings. We ended up with all these hacky % operations on the token length just to figure out how many LLM calls we needed to digest the whole thing. It's a nightmare. Your options are trash: > either you throw away data, which is a hard no because you don't want data loss, or > you accept that you're just going to burn more VC money because every provider charges you per token. TOON is a decent alternative, but it's not perfectly accurate. The thing is, LLMs were pre-trained on a lot of JSON. You switch everything to TOON, and your accuracy takes a hit. It's a trade-off. If you're ranking formats for accuracy, it's roughly: Markdown-KV > XML > YAML > HTML > JSON > TOON TOON is getting better, but as an AI engineer, the most optimized way to solve this right now is to figure out your personal trade-off between latency <> cost <> model accuracy. If your task is simple and doesn't live or die by accuracy, try TOON -> Run evals on a small dataset -> If the numbers look good, stick with it -> If they're bad, fall back to JSON or XML. But really, the smart move is to think before the LLM call: > Can you filter that JSON down to just the fields the LLM actually needs? > Can you summarize big text blobs with a cheaper model first? > Can you break the task into a conversation instead of one giant context dump? That's where you win. The format is just one part of the puzzle.
Archie Sengupta tweet mediaArchie Sengupta tweet media
English
19
13
370
33.4K
Yash Singhal ๐Ÿ”ฅ
Yash Singhal ๐Ÿ”ฅ@yash_25logยท
@LowLevelTweets Relax ๐Ÿ˜† thatโ€™s just bots knocking on every door on the internet hoping someone left .env outside. Ours is locked.
English
1
0
8
1.8K
Low Level
Low Level@LowLevelTweetsยท
guys how dumb do you think I am? come on. nice IP addresses btw.
Low Level tweet media
English
117
47
2.6K
290.9K
Yash Singhal ๐Ÿ”ฅ
Yash Singhal ๐Ÿ”ฅ@yash_25logยท
The takeaway: For global businesses, depending on a robust CDN isn't optionalโ€”it's survival. ๐Ÿฅท A single point of failure at this scale creates a cascading crisis for whole ecosystem. ๐ŸŒ‹ Are we too centralized? What's solution? #Tech #Cloudflare #CDN #Cybersecurity #DevOps
English
0
0
0
66
Yash Singhal ๐Ÿ”ฅ
Yash Singhal ๐Ÿ”ฅ@yash_25logยท
2/ The 3 Critical Functions, CDN provides: ๐Ÿš€ Speed: Caching + instant TLS = โšกglobal delivery. ๐Ÿ›ก๏ธ Security: Uses Anycast to diffuse massive DDoS attacks across its entire network capacity. ๐ŸŸข Resilience: High fault tolerance. Origin servers struggle-> CDN serves cached copy.
English
1
0
1
37
Yash Singhal ๐Ÿ”ฅ
Yash Singhal ๐Ÿ”ฅ@yash_25logยท
/1 ๐˜Š๐˜ญ๐˜ฐ๐˜ถ๐˜ฅ๐˜ง๐˜ญ๐˜ข๐˜ณ๐˜ฆ is worldโ€™s largest ๐‚๐ƒ๐ . What it does: - ๐‚๐ฅ๐จ๐ฌ๐ž๐ซ ๐œ๐จ๐ง๐ญ๐ž๐ง๐ญ: Uses global PoPs & edge servers to cut latency. - Faster connections: Terminates TLS handshakes instantly at edge. - ๐‚๐š๐œ๐ก๐ข๐ง๐ : Protecting your origin server from massive load.
English
1
0
0
18
Yash Singhal ๐Ÿ”ฅ
Yash Singhal ๐Ÿ”ฅ@yash_25logยท
When ๐—, ๐Ž๐ฉ๐ž๐ง๐€๐ˆ, ๐’๐ฉ๐จ๐ญ๐ข๐Ÿ๐ฒ, & ๐‚๐š๐ง๐ฏ๐š all vanish at once, it's not a simple server crashโ€”it's an INFRASTRUCTURE FAILURE. ๐Ÿšจ The recent ๐‚๐ฅ๐จ๐ฎ๐๐Ÿ๐ฅ๐š๐ซ๐ž outage was a $100๐˜” ๐˜ณ๐˜ฆ๐˜ฎ๐˜ช๐˜ฏ๐˜ฅ๐˜ฆ๐˜ณ of how 1 company powers internet. Why? A deep dive into the tech ๐Ÿ‘‡
English
1
0
2
44
Yash Singhal ๐Ÿ”ฅ
Yash Singhal ๐Ÿ”ฅ@yash_25logยท
6. Thatโ€™s the first half of the story. ๐˜š๐˜ต๐˜ข๐˜ต๐˜ช๐˜ค โ†’ ๐˜”๐˜๐˜Š โ†’ ๐˜š๐˜—๐˜ˆ โ†’ ๐˜‰๐˜๐˜ Next up in ๐๐š๐ซ๐ญ ๐Ÿ: How ๐’๐’๐‘, ๐’๐’๐† & ๐‘๐ž๐š๐œ๐ญ ๐’๐ž๐ซ๐ฏ๐ž๐ซ ๐‚๐จ๐ฆ๐ฉ๐จ๐ง๐ž๐ง๐ญ๐ฌ changed everything โšก๏ธ #frontend #webdev #nextjs #react #softwarearchitecture
English
0
0
0
28
Yash Singhal ๐Ÿ”ฅ
Yash Singhal ๐Ÿ”ฅ@yash_25logยท
5. SPAs solved interactivity but not complexity. So next: the ๐๐š๐œ๐ค๐ž๐ง๐ ๐Ÿ๐จ๐ซ ๐…๐ซ๐จ๐ง๐ญ๐ž๐ง๐ (๐๐…๐…) pattern. Each frontend (web, mobile) gets its own API. โœ… ๐˜Š๐˜ญ๐˜ฆ๐˜ข๐˜ฏ๐˜ฆ๐˜ณ ๐˜ฅ๐˜ข๐˜ต๐˜ข โœ… ๐˜๐˜ข๐˜ด๐˜ต๐˜ฆ๐˜ณ ๐˜ช๐˜ต๐˜ฆ๐˜ณ๐˜ข๐˜ต๐˜ช๐˜ฐ๐˜ฏ โŒ ๐˜”๐˜ฐ๐˜ณ๐˜ฆ ๐˜ช๐˜ฏ๐˜ง๐˜ณ๐˜ข ๐˜ต๐˜ฐ ๐˜ฎ๐˜ข๐˜ฏ๐˜ข๐˜จ๐˜ฆ
English
1
0
0
27
Yash Singhal ๐Ÿ”ฅ
Yash Singhal ๐Ÿ”ฅ@yash_25logยท
๐“๐ก๐ž ๐„๐ฏ๐จ๐ฅ๐ฎ๐ญ๐ข๐จ๐ง ๐จ๐Ÿ ๐…๐ซ๐จ๐ง๐ญ-๐„๐ง๐ ๐€๐ซ๐œ๐ก๐ข๐ญ๐ž๐œ๐ญ๐ฎ๐ซ๐ž (๐๐š๐ซ๐ญ-๐Ÿ)๐Ÿš€ wanna sound ๐˜ด๐˜ฆ๐˜ฏ๐˜ช๐˜ฐ๐˜ณ in your next ๐˜ช๐˜ฏ๐˜ต๐˜ฆ๐˜ณ๐˜ท๐˜ช๐˜ฆ๐˜ธ ... Let's go...๐Ÿ‘‡๐Ÿงต
Yash Singhal ๐Ÿ”ฅ tweet media
English
1
0
2
96
Yash Singhal ๐Ÿ”ฅ
Yash Singhal ๐Ÿ”ฅ@yash_25logยท
Big news ๐Ÿ‡ฎ๐Ÿ‡ณ - OpenAI is giving 1-year free access to ChatGPT Go starting Nov 4! More power โ†’ GPT-5, uploads, memory, faster protos. Big W for devs ๐Ÿš€ #AI #DevTools #ChatGPT
Yash Singhal ๐Ÿ”ฅ tweet media
English
0
0
2
191