DeConditioned

1.1K posts

DeConditioned

DeConditioned

@DConditioned

experimenting with life

Katılım Nisan 2021
121 Takip Edilen58 Takipçiler
Puneet Patwari
Puneet Patwari@system_monarch·
I'm a Principal with 12 years of experience. If I was coaching you to crack system design rounds for Sr to Staff+ AI/ML roles at companies like Meta, Google, Salesforce, Amazon, etc. I would 100% ask you to work on these fundamentals before we would start talking about interviews. Because AI system design is still system design. The only difference is that now your bottlenecks are not just databases, caches, and queues. They are tokens, context windows, retrieval quality, inference cost, hallucinations, model latency, evals, and user trust. Here are the fundamentals I would start with: ➤ LLM Basics ↬ Tokens ↬ Context Window ↬ Prompt Design ↬ System Prompts ↬ Temperature ↬ Top-p Sampling ↬ Structured Outputs ↬ JSON Mode ↬ Function Calling ↬ Tool Calling ↬ Agents ↬ Memory ↬ Guardrails ↬ Hallucinations ↬ Model Latency ↬ Model Routing ↬ Small vs Large Models ↬ Fine-tuning vs Prompting ↬ Open-source vs Closed Models ➤ RAG & Retrieval ↬ Embeddings ↬ Vector Search ↬ Vector Databases ↬ Chunking ↬ Chunk Overlap ↬ Metadata Filtering ↬ Hybrid Search ↬ Keyword Search ↬ Semantic Search ↬ Reranking ↬ Retrieval Recall ↬ Retrieval Precision ↬ Query Rewriting ↬ Document Freshness ↬ Permission-aware Retrieval ↬ Citation Grounding ↬ Evidence Selection ↬ Context Packing ↬ Missing Information Detection ➤ AI System Architecture ↬ API Gateway ↬ Request Routing ↬ Model Gateway ↬ Prompt Service ↬ Inference Service ↬ Retrieval Service ↬ Ranking Service ↬ Feature Store ↬ Offline Pipelines ↬ Online Serving ↬ Async Processing ↬ Queueing ↬ Streaming Responses ↬ Rate Limiting ↬ Fan-out/Fan-in ↬ Batch Inference ↬ Real-time Inference ↬ Human-in-the-loop Systems ↬ Fallback Workflows ➤ Cost & Performance ↬ Token Budgeting ↬ Prompt Compression ↬ Prompt Caching ↬ Semantic Caching ↬ Response Caching ↬ Batch Requests ↬ Model Quantization ↬ Distillation ↬ Latency Budgets ↬ Cold Starts ↬ GPU Utilization ↬ Throughput ↬ Cost per Query ↬ Cost per User ↬ Model Selection ↬ Inference Scaling ↬ Backpressure ↬ Load Shedding ➤ Evaluation & Quality ↬ Offline Evals ↬ Online Evals ↬ Golden Dataset ↬ Human Review ↬ LLM-as-Judge ↬ A/B Testing ↬ Regression Testing ↬ Answer Relevance ↬ Factual Accuracy ↬ Faithfulness ↬ Groundedness ↬ Toxicity Checks ↬ Safety Checks ↬ Drift Detection ↬ Feedback Loops ↬ Confidence Scoring ↬ Escalation Criteria ↬ Quality Monitoring ➤ Reliability & Security ↬ Timeouts ↬ Retries ↬ Circuit Breakers ↬ Failover ↬ Model Fallbacks ↬ Graceful Degradation ↬ Observability ↬ Tracing ↬ Prompt Logs ↬ Token Metrics ↬ Error Budgets ↬ PII Redaction ↬ Data Privacy ↬ Access Control ↬ Prompt Injection ↬ Jailbreak Defense ↬ Audit Logs ↬ Compliance
English
9
46
227
18.7K
The Infinity Within
The Infinity Within@the_within4602·
@dasyu_zoomer Atleast take into account PPP numbers to reflect the purchasing power. Germany is $62k, India is $12k. 5 times - sure. Since 2020, Petrol almost 0% increase in India, 54% increase for Germany.
English
1
0
1
402
D
D@dasyu_zoomer·
Per capita of Germany - 62 lakh Per capita of India - 2.7 Lakh Germany is 23 times richer than India How can you even compare 😭😭
Vishwaguru@_Vishwaguru_

@dasyu_zoomer Here is the Petrol price in Germany & India since 2020. @MehHarshil

English
69
583
4.7K
77.4K
Kalshi Finance
Kalshi Finance@Kalshi_Finance·
Your L7 friend who pulled $380K total comp just texted you from his Tesla in the parking garage "Bro they walked me and 47 other seniors out this morning. Badge deactivated. Escorted by security." "New directive from the C-suite: every team that was 8 engineers is now 2 engineers plus unlimited Claude Enterprise API credits" His replacement? A 26-year-old offshore contractor making $28K who runs everything through Cursor and ships code faster than his entire former team The math that every CFO just did: $380K senior engineer in San Francisco = $28K contractor in Bangalore + $15K annual AI tooling + $8K infrastructure Total savings per head: $329K annually His team was burning $3.1 million in engineering salaries New team burns $410K total with better velocity metrics The offshore contractor doesn't need health insurance, equity, or a $4,000 Herman Miller chair Doesn't need mentorship or career development or performance reviews Just needs Slack access and an OpenAI API key Your friend built the entire authentication system. Led the migration to microservices. Mentored 12 junior engineers over 6 years. His replacement has been coding for 18 months and copy-pastes everything from Claude Same output. 90% cost reduction. Every engineering manager just got that spreadsheet Every CFO just had that realization The offshore arbitrage just went nuclear because AI made experience optional American tech workers are about to learn what Detroit autoworkers learned in the 80s Except this time the factories are moving at the speed of light
English
27
50
204
21.9K
DeConditioned
DeConditioned@DConditioned·
@nk_sampath68 @Mahesh10816 eco system was different, it was congress's system. You will be given your democracy . They stand no chance once out of power
English
1
0
1
33
Sampath N K
Sampath N K@nk_sampath68·
@Mahesh10816 BJP will stare at existential crisis. Which substance are you on? When they got 2 seats they didn't have existential crisis and now even if they lose they won't. They'll work hard. For some reasons they had to do what they did. It's not the end. If Congress, we won't exist.
English
1
0
1
1.8K
Mahesh 🇮🇳
Mahesh 🇮🇳@Mahesh10816·
If BJP loses 2029, Cong will not only destroy the entire BJP ecosystem but will ensure that BJP cannot come to power for the next 25 years. A mere 0. 8 % vote share drop cost 64 MPs in 2024, and imagine even if 25% of GCs vote against BJP? It's done and dusted BJP will be starring at an existential cricis in 2029. At this appeasement spree GCs are not going to spare BJP
English
1.4K
2.1K
10.5K
637.6K
Indian Tech & Infra
Indian Tech & Infra@IndianTechGuide·
🚨 Despite global hesitation, there is one western country that is openly welcoming Indian students now a days. Guess it.
English
155
136
6.4K
839.8K
Route 2 FI
Route 2 FI@Route2FI·
What other interests than crypto have you picked up during this bear market? I've been reading more fiction books than I usually do, started working out more, and gotten back in touch with friends. I miss the bull market, but in a way, it feels good to just live a "semi-normal" life again.
English
34
7
140
13.9K
PG
PG@pg_417w·
@igetredpilled Wait for < $4k to buy gold again. Reasonably below 4k too
English
1
0
1
67
red pill rick
red pill rick@igetredpilled·
Sold my $AMZN into this strength to free up more cash for gold and silver.
English
8
0
57
3.9K
Amy Siskind 🏳️‍🌈🇺🇸
Trump has now lifted sanctions on: * Russia * Iran * Belarus Three of the most villainous autocracies. But we hate all our former allies 🤷🏻‍♀️
English
490
5.1K
21.1K
278.3K
Kabir K. Isakhel
Kabir K. Isakhel@Kabir_Isakhel·
@midascabal Everyone loves declaring Dubai “finished'. Strange how the capital, talent and investors keep arriving anyway and it wont stop in the future
English
16
1
34
34.3K
Midas
Midas@midascabal·
Dubai and the UAE are cooked. It will be nearly impossible for the UAE to sell a rich lifestyle to expats + investors now.
English
466
1.5K
17.7K
1.2M
Jvnior
Jvnior@Jvnior·
Israel is getting ABSOLUTELY F*CKED by Iran.
English
1K
6K
45.4K
2.5M
Robert Raponi
Robert Raponi@travellingvatty·
@Mikeggibbs Gretzky is a hockey hero and Canadian legend. You suffer from TDS. The elbows up crowd is so predictable.
English
1
0
1
18
Michael Gerald Gibbs🏳️‍🌈🍁 🇺🇦 (He/Him)
Dear World: Reasonable thoughtful Canadians are ashamed of Wayne Gretzky today. He does not speak for us. AND he is not our biggest icon nor our biggest, proudest success. 👇 He's lived in the United States the vast majority of his life. He's friends with our enemy, Donald Trump. So please stop calling him things like Canada's greatest or Canadian icon. That title belongs more properly with others. Sincerely, Most Canadians
Ajax, Ontario 🇨🇦 English
2.5K
797
3.9K
193.1K
DeConditioned
DeConditioned@DConditioned·
I am sure he knows better than all the trolls posting AI fear porn all day.
DeConditioned tweet media
English
0
0
0
81
DeConditioned
DeConditioned@DConditioned·
No real post in this app other than AI fear porn by vibe coders . Depressing !!
English
0
0
0
64
Made In Canada
Made In Canada@MadelnCanada·
#BREAKING: The US House has just voted to TERMINATE President Trump’s tariff’s on Canada, 219-211 🇨🇦🇺🇸
Made In Canada tweet mediaMade In Canada tweet media
English
426
1K
11.5K
435.1K
Kyle Griffin
Kyle Griffin@kylegriffin1·
Reuters: U.S. HOUSE BACKS RESOLUTION THAT WOULD END TRUMP'S CANADA TARIFFS BY 219 TO 211
English
91
1K
8.8K
209.2K