Raman Shah

4.4K posts

Raman Shah banner
Raman Shah

Raman Shah

@rs_datascience

I improve operations by measuring them.

Providence, RI, USA Присоединился Mart 2019
890 Подписки510 Подписчики
Закреплённый твит
Raman Shah
Raman Shah@rs_datascience·
If there's anything I can do to protect institutions from bad software initiatives that go 300-600% over budget and schedule and wreck their human capital, I want to do it. To that end, I sat for my first ever podcast interview (links in thread):
Raman Shah tweet media
English
1
0
3
469
Raman Shah
Raman Shah@rs_datascience·
@lauriewired @corewarrior This promtped a very brief literature search. Prompted and "ahh gotcha"/"ugh blech" - lead-210 with its 22.2 year half-life. Wonder if you knew that lead-210 is also responsible for a fair % of the lung-cancer burden of smoking.
English
0
0
2
45
LaurieWired
LaurieWired@lauriewired·
@corewarrior it wasn't accidentally contaminated, in fact, IBM actually used low alpha solder! it wasn't enough though, and subsequent systems used ULA solder (ultra-low-alpha solder)
English
3
3
86
3.9K
LaurieWired
LaurieWired@lauriewired·
How do you kill a Supercomputer? (Accidentally) using radioactive solder is a good way. IBM’s Blue Gene/L frequently crashed when running simulations at LLNL. Turned out that alpha particles from the lead solder in the board carrier were slamming the L1 cache with bit flips. It’s a particularly nasty issue. Unlike DRAM /w ECC, there wasn’t a transparent way to correct it. The fix was brutal. IBM recommended scientists reprogram critical workloads to write-through mode. Basically, every store in L1 would also travel down the cache hierarchy immediately. If L1 got corrupted, the kernel would invalidate the whole cacheline and force a refill from slower pools. It worked…but had a massive performance hit. As much as 20-30%!
LaurieWired tweet mediaLaurieWired tweet media
English
64
236
2.7K
133.8K
Raman Shah
Raman Shah@rs_datascience·
@mayukh_panja @rahulj51 I'd counter, based on the reports of my many friends involved in the rubber-meets-the-road mundane operations of the world, that the world is, indeed, coming to a standstill. It's quite frightening.
English
0
0
1
27
Mayukh
Mayukh@mayukh_panja·
@rahulj51 Everyone is retarded and it is surprising that the world is not coming to a standstill.
English
2
0
12
1.6K
Mayukh
Mayukh@mayukh_panja·
One thing academia does extremely well and startups and companies massively screw up is hiring. Hear me out! A friend of mine, PhD in Astrophysics, solved a tough problem for their PhD: when light from stars travels through the Earth's atmosphere, the turbulence and density fluctuations cause the light rays to become "squiggly" instead of straight and the resulting image you get from a telescope becomes blurry. So he had to model atmospheric turbulence and then write a piece of software in C++ that inverts this problem to get de-blurred images. This involved understanding physics, maths, computation, a bit of ML and writing production-level code in C++. When he tried to look for an industry job he simply couldn't find any. It was also hard to just get interviews. The first problem is that recruiters, who are often deeply non-technical, look for specific keywords in CVs and they just don't know how to parse a non-standard CV. This is a guaranteed way of missing out on outlier candidates. Second, a lot of hiring managers over index on niche knowledge about a specific tool/framework/language and the ability to remember syntax off the top of your head. A solid researcher sees programming languages, machine learning, physics, maths etc as tools that are at their disposal and may not know/remember very specific information or every little detail about arbitrary technical things. The whole process essentially becomes a lottery. This was how we hired at our Max Planck Institute: the candidate would be given a paper a week before the interview and the interviewer and the candidate would discuss it together. A second interview would entail asking the candidate about THEIR past work and checking if they deeply understood what they did. This interview format doesn't require the candidate to memorizes stuff beforehand and is pretty much independent of the whims, fancies and "taste" of the hiring manager. A lot of stuff is wrong with academia but this is an area where they do much much better than startups/companies.
English
29
112
1.2K
75.5K
John Bistline
John Bistline@JEBistline·
This is my favorite climate change chart. Japanese monks, aristocrats, and emperors kept meticulous records of cherry blossom festivals for 1,200 years and accidentally built the world's longest climate dataset.
John Bistline tweet media
English
238
9.4K
50.1K
1.6M
Raman Shah
Raman Shah@rs_datascience·
@McMasterDaily You got me for thirty seconds there. Well played.
English
0
0
0
160
Daily McMaster-Carr
Daily McMaster-Carr@McMasterDaily·
Modern Home Style 115 $725.00 each 6722T16 Wow, catalog homes are back!
Daily McMaster-Carr tweet media
English
17
23
816
35.5K
Raman Shah
Raman Shah@rs_datascience·
@stevesi Oooo this winter we ran into a contraband lightbulb issue when the overhead light went out in our kitchen. Non-contraband substitute did not fit and I ended up having to change out the ceiling fan entirely.
English
0
0
0
10
Steven Sinofsky
Steven Sinofsky@stevesi·
I find it incredible that there are shower heads you can order online but cannot be shipped to certain states and this is hardcore enforced. Contraband shower heads.
English
108
27
3K
120.5K
Raman Shah
Raman Shah@rs_datascience·
@typesfast Ugh Bab al-Mandab is tied up too.
English
0
0
0
131
Ryan Petersen
Ryan Petersen@typesfast·
My decision to name Flexport conference rooms after important straits and maritime chokepoints leading to awkward meeting names lately.
English
55
78
4.5K
195.8K
Raman Shah
Raman Shah@rs_datascience·
@AlexKontorovich @3rdMoment I’ve heard Caltech has also gone this away after generations of bona fide honor code. Irredeemable shark jumpage.
English
0
0
0
25
Alex Kontorovich
Alex Kontorovich@AlexKontorovich·
Very sad indeed. When I moved from Princeton to Columbia for grad school, I was *shocked* when I was told that I actually had to proctor my calc exams, and just not trust their "honor code". At Princeton, the honor code genuinely meant something. In the first week of freshman year, we had to write an essay explaining in detail what the consequences of cheating were, why it didn't serve our long term interests, and how even if we weren't the ones cheating, if we knew that others were and didn't report it, we would be just as guilty. (I remember vividly, because my first attempt at such an essay was rejected as insufficiently detailed! I had to write a much longer version.) As a result, people really didn't cheat (as far as I knew; every year there was ~1 student kicked out of school for cheating). It was something really special, it turned out; that's not how it works elsewhere. Sad to see further deterioration of the culture at Princeton.
Steve McGuire@sfmcguire79

Exams at Princeton have been unproctored under an Honor Code since 1893. “Students pledge both to refrain from infractions of academic dishonesty and to report any breaches of the Constitution they witness.” But AI has led to an increase in academic dishonesty cases, so:

English
39
50
1.4K
507.9K
Raman Shah
Raman Shah@rs_datascience·
@AngelicaOung I often feel this way about how I played violin at 16.
English
1
0
19
16.9K
Angelica 🌐⚛️🇹🇼🇨🇳🇺🇸
In college I had a friend who figure skated competitively until she was 15 or something. It was like she coulda been a contender when she was 14 but knew as soon as she turned 15 that it wasn’t going to be her. All of a sudden the thing that was her life became not a thing. She would watch the fuzzy VHS tapes of herself executing super clean doubles on the ice. And she’ll say to me wistfully, yet with a sense of wonder…I’ll never ever be as good at anything else in life, ever again…
jean’s glucose monitor@mirrenelle

i found out she exists, her name is midori ito and she’s 51

English
40
168
14.2K
1.7M
irα!!
irα!!@solarsystern·
nobody warned me that once you enter a certain tax bracket Everybody Skis and not only that but They Assume You Also Ski
English
205
1.4K
47.2K
1.9M
Raman Shah
Raman Shah@rs_datascience·
@dieworkwear Hahaha for a while I had a little hobby of recommending your “The Springboard Wardrobe” on a looksmaxxing subreddit using an anon account. It was genuinely rewarding to convince youngsters that what they were born with was fine and had opportunities to style themselves better.
English
0
0
0
114
derek guy
derek guy@dieworkwear·
some of the replies in here are so stupid you need to be booksmaxxing
English
16
35
1.7K
55.4K
derek guy
derek guy@dieworkwear·
what is the point of looksmaxxing? is it to impress other men in the looksmaxxing community? i don't get impression that women find this sort of personality or even the aesthetic attractive
English
410
132
7.5K
529.4K
Raman Shah
Raman Shah@rs_datascience·
@jburnmurdoch Yes. See also: public transit development.
English
0
0
0
17
John Burn-Murdoch
John Burn-Murdoch@jburnmurdoch·
Underrated factor in why English-speaking countries have especially bad housing crises is their common law systems (adversarial and litigious) vs judge-led civil law systems elsewhere. Makes Anglo planning/permitting systems especially vulnerable to NIMBYs and other objections.
John Burn-Murdoch tweet media
English
248
1K
6.8K
751.2K
Raman Shah
Raman Shah@rs_datascience·
@llm_bender @fute_nukem This is like the one legitimate application of a LLM agent I can think of 😂
English
0
0
0
42
Jake Carlson
Jake Carlson@llm_bender·
@fute_nukem Ha! But I don't want to engage with him or he'll never stop bothering me
English
3
0
18
6.2K
Raman Shah
Raman Shah@rs_datascience·
@TheCatholicEngr Not a chem eng but a Ph.D. chemist. These fields do not have particularly many jobs in the most developed countries. And even more critically, graduate programs are not sized to train a workforce, they ARE the workforce. That is to say, overproduction of talent is rampant.
English
0
0
6
573
The Catholic Engineer
The Catholic Engineer@TheCatholicEngr·
I've once again met yet another person who graduated with a Chemical Engineering degree who is not doing Chemical Engineering anymore What is up with that major?
English
109
3
434
241.2K
Raman Shah
Raman Shah@rs_datascience·
@McMasterDaily Obviously as a 12 year former Chicagoan I am partial to the city. But Elmhurst is quite nice, with good commuter rail connectivity. Can’t help you re the work visas tho 😭
English
0
0
2
135
Daily McMaster-Carr
Daily McMaster-Carr@McMasterDaily·
This feels like the perfect job for me, except they don't sponsor work visas 😭 (I'm 🇨🇦) Suburban Chicago also seems kinda bland.
Daily McMaster-Carr tweet media
English
10
3
62
3.8K
Raman Shah
Raman Shah@rs_datascience·
@lauriewired 100% agreed. The tape recorder and its modern equivalents are also vastly valuable practice aids for musicians and other performers. I used mine way too little when I was a serious violinist.
English
0
0
1
173
LaurieWired
LaurieWired@lauriewired·
literally talk about anything, just fill up the time. I learned the technique from a professional twitch streamer years ago; it was their way of training themselves to not have dead air. It outshines any other possible practice method I’ve tried. I'm pretty introverted irl.
English
28
13
2K
52.8K
LaurieWired
LaurieWired@lauriewired·
no one’s gonna believe me but becoming a good speaker is really easy just record yourself for 10 minutes every day, first thing in the morning. don’t send it to anyone, just force yourself to watch it later. you’ll notice every possible flaw you can imagine.
English
145
425
9.4K
390.3K
Raman Shah
Raman Shah@rs_datascience·
@reboplim As a scientist by love and former training who was extensively dragged into technology, this resonates. I totally love how SU(2) is a double cover of SO(3); my first paper in my Ph.D. used this fact ❤️
English
0
0
1
17
rebop // ryan
rebop // ryan@reboplim·
When I did low-level programming, I always felt unsatisfied after learning why computers worked the way they do. Many design decisions felt like arbitrary choices made by some guy in the 1980s, and we had to deal with the ramifications. E.g., every modern OS has to enable the A20 address line to access even-numbered MBs in memory. This is because programmers used undefined behavior in the Intel 8086, where any address above 1MB "wrapped around" to zero. On newer processors, instead of letting things break, Intel pandered to the programmers and created a latch that set the A20 line to zero by default. I've never felt this way in physics. Every detail in the theories I've learnt felt intentional, and it always led me down rabbit holes to deeper concepts. I'm drafting a thread on one of these rabbit holes - the Bloch sphere representation of a two-level system and SU(2) being a double cover of SO(3)!
English
150
85
3.4K
261.3K
Raman Shah
Raman Shah@rs_datascience·
@CyborgLavery @_Stocko_ An interesting analog to this problem is what goes into an AVPN-certified Neapolitan style pizza (baked at ~900 F), and the dough formulation mods needed to simulate such a pizza in a cooler domestic oven.
English
0
0
0
24
Raman Shah
Raman Shah@rs_datascience·
@CyborgLavery @_Stocko_ I believe this is the right answer. The moisture transport needed to get the nice crispy browning sets a time scale.
English
1
0
2
43
Stocko 👊🤖
Stocko 👊🤖@_Stocko_·
why can't i toast a piece of bread in less than 1 second? what's the limiting factor?
English
125
2
739
43.8K
Raman Shah
Raman Shah@rs_datascience·
@thoughtlesslabs @ThePrimeagen Sometimes orgs profit by producing even less, manufacturing a shortage - through either brand differentiation (Ferrari) or collusion (beef packers). 100% agree with your first paragraph but the "profit seeking = more quantity, less quality" rule does not seem ironclad.
English
0
0
0
75
thoughtlesslabs
thoughtlesslabs@thoughtlesslabs·
i fundamentally believe it comes down to care and respect for a craft versus a desire to profit off of the craft. there is nothing inherently wrong with wanting to profit of something, but it always leads to a decline in quality while quantity increases. if anyone has a counter example here i'm all ears
English
12
1
157
38.1K
ThePrimeagen
ThePrimeagen@ThePrimeagen·
i am convinced that software devs have a speed problem they think the #1 issues is writing code faster... its not. its fixing the code that is already there to stop being utter garbage (as a garbage code connoisseur) quality is really lacking these days, yet quantity has never been higher
English
319
354
5.4K
511.1K