lowvram

when u share the chatgpt account with ur spouse

saw the zoomer intern’s life flash before his eyes after he used the term “glazing” and my manager (whose first lang isn’t English) starts googling “glazing meaning” while screen sharing to our team

no no no bro, you’re using vllm’s version of rocm (vllm-rocm). u should really be using rocm’s version of vllm (rocm-vllm). Duh.

@reed The day they are available in Seattle / King County I will spend however much it costs to just ride around in them back and forth across town all day long

the future is here. we’re working hard to distribute it

@tszzl @tenobrus rare roon L

@tenobrus friends don’t let friends use the TUI download the app rn

wow that must have taken a lot of courage for codex to admit

I have a 3090, and an amd AI Pro R9700. The 3090 was announced just as GPT-3 came out. The world was in covid lockdown. 8nm process node. Its box featured an anime waifu and it had a code for the deluxe edition of the game Control. The R9700 came out less than a year ago. It’s a Pro(tm) card for Professionals and has AI in the name. 3 generations newer silicon. Designed for the AI era. I am unable to get even half the token throughput in vllm on the R9700 as the 3090. What has amd been doing???

“Upgraded” from 2x 3090 to 2x amd R9700, for 64gb vram and multiple gens newer silicon (and yeah slightly less mem bandwidth). Foolishly, I thought using the latest vllm-rocm container was all it would take for speedy inference… boy was I wrong…

@codetaur have I got news for you

I'm tired of having to think of every part of every project

In the meantime, guess I’ll place an identical order from Amazon. At least if *Amazon* destroys your order, they don’t make you wait 3 to 5 business days to figure out if you get a refund for the order that never even made it past the shipping hub.

If you’re wondering how @newegg handles it when their selected carrier destroys $3k of gpus: they make the customer wait for a carrier claims process, even though the item didn’t even survive to your zip code. I’m out $3k while Newegg and UPS figure out who destroyed my gpus

oh cool my package containing two R9700 gpus was so badly damaged by @UPS that it had to be “discarded”.

@teortaxesTex banger

Dumb ass sparse MoE the moment it gets a task it was RL-ed for:

Someone’s out there literally stealing gpus off trucks

I am INCENSED at the proposal to put a data center in my neighborhood. This is a FAMILY neighborhood. I DEMAND at least 730hrs/month of H200 time as compensation for this injustice. And another 730hrs/month A100 for children under 18.

@codetaur 7

GIVE ME SOME DATA TO VIS NOW!

Completing the Zoox waitlist survey with answers I hope will make me such a statistical outlier they simply must invite me

It’s well-tread territory, of course. But it still gets me. The artifice is dropped, the band has gone home, the captivating (but artificial) stories of Lucy and Rita and Mr Kite and the girl leaving home are over. And what’s left is real life, the banal (“woke up, fell out of bed”) but all-important reality. A man dead in a car from a careless mistake, but just another day in the life for another man trying to get to work on time.

I know sgt pepper is falling out of favor relative to Revolver/Rubber Soul, but is there a more heart wrenching moment in any album than when Sgt Peppers band says farewell, the curtain comes down, then John enters with “I read the news today, oh boy” and recontextualizes the entire album?

@frankidacre maybe if i reply to this, the twitter algo will start showing me more awesome stuff like this, instead of the usual slop

Cleaned up my room!! I’m going to miss it when I go to college 🫡