rain
3.2K posts
@rtroar @opdroid1234 Yeah that's entirely possible. But wouldn't you want a pro grade GPU, or atleast a prosumer GPU for this view to still make sense? 10k for 96GB card and you're still barely running a heavily quantized model. How many do you stack?
English
@SachaSucha @opdroid1234 That’s true today. I think we are about to see api rates going way up.
English
@opdroid1234 @rtroar Yeah ofcourse. I meant even if you paid API rates and use Open weight models at 8 bit quant, there's no comparison that makes sense buying a GPU
English
@LottoLabs Afiak their memory bandwidth is really slow and makes their inference latency pretty bad
English
It might be time
I want a gb10 to test out but don’t want to spend that much and I don’t really need 128gb?
Or should I just put $3500 towards a RTX5000 but then I need a whole build or sell the 3090s
Canadian dollars
amzn.to/4tIcCga
English
I think this is a really great point. People seem to be shipping faster and being more okay with failure.
This is crazy to me, because the best part about LLMs is they make it easier to design rigorous testing and perf gates.. to reduce failure risk.
I guess a lot of companies are going to learn the hard way.
Mitchell Hashimoto@mitchellh
I strongly believe there are entire companies right now under heavy AI psychosis and its impossible to have rational conversations about it with them. I can't name any specific people because they include personal friends I deeply respect, but I worry about how this plays out. I lived through the great MTBF vs MTTR (mean-time-between-failure vs. mean-time-to-recovery) reckoning of infrastructure during the transition to cloud and cloud automation. All those arguments are rearing their ugly heads again but now its... the whole software development industry (maybe the whole world, really). It's frightening, because the psychosis folks operate under an almost absolute "MTTR is all you need" mentality: "its fine to ship bugs because the agents will fix them so quickly and at a scale humans can't do!" We learned in infrastructure that MTTR is great but you can't yeet resilient systems entirely. The main issue is I don't even know how to bring this up to people I know personally, because bringing this topic up leads to immediately dismissals like "no no, it has full test coverage" or "bug reports are going down" or something, which just don't paint the whole picture. We already learned this lesson once in infrastructure: you can automate yourself into a very resilient catastrophe machine. Systems can appear healthy by local metrics while globally becoming incomprehensible. Bug reports can go down while latent risk explodes. Test coverage can rise while semantic understanding falls. Changes happens so fast that nobody notices the underlying architecture decaying. I worry.
English
@rtroar @kritikakodes my man is recreating roblox from first principles
English
@crypt0lake @halogen1048576 I’ve been shouting this from the rooftops since 2007.
idgaf what you wanna use to make your project, you’ll benefit from deeply knowing C
English
unironically, learn c++ and c, deeply, if you are junior or not
English
@linderps ive always maintained that being hot is a state of mind
English
if you want to meet sexy people, you need to be a sexy person. to be a sexy person, you need to do sexy things, such as:
- learn how to play guitar (you only need 4 chords to play 90% of music)
- take a dance class (sexy styles include hip hop, salsa, bachata)
- do an actually difficult sport: tennis, volleyball, surfing. “run club” does not count
- learn how to cook 1-2 dishes really fking well
practice. get better. develop a passion.
if you fall in love with a sexy hobby, someone will fall in love with you.
English
@usr_bin_roygbiv I did the tour d’faang and got bored with no one having ambition to do anyrhing
English
Another big mistake I see people making career wise is assuming management is how you progress your career. Dated ford motor company view of the world. The middle managers are often paid less and have far less leverage than the engineers or salespeople. Plus you sit in meetings
Roy@usr_bin_roygbiv
I've met an insane amount of washed up 40-50 year old guys having to start their career over because they spent their 20s partying and not saving any money before they took things seriously don't do it guys. Prob half the people I work with/juniors and middle managers.
English
@usr_bin_roygbiv Incidentally.. I have zero clue how you get those jobs.
I’ve never seen people promoted into them, just hired in. Where do they come from?
English
@usr_bin_roygbiv At big companies an m2 or director (like 5-6 layers below c suite) can easily clear $2-$4m TC
English
People are extremely bad at gauging other peoples intelligence
They can usually tell a mega-genius from a total retard. Beyond this it’s mostly just “they agree with me so they must be smart” or “they’re hot so they must be smart”
“I like them for their intelligence” is just way more socially acceptable to say than whatever the actual reason is
Werner Zagrebbi🇦🇿@zagrebbi
When you actually test women's preferences experimentally, IQ doesn't measurably increase attractiveness at all — physical attractiveness totally dominates across the speed-dates literature. Stated preferences ≠ revealed preferences.
English
i cannot speak more highly of Lumen
it is the best terminal diff viewer i've tried and it has become an irreplaceable part of my daily workflow
English
@usr_bin_roygbiv I have been the paranoid weirdo that is just rebuilding all of the pieces omp myself… But maybe I should just use it lol
English