AMD

@sudoingX AMD FTW. First proper pc was, and still is RDNA1 and zen2 architecture. Canno't wait for rumored UDNA.

@sudoingX Their rocm software have lots of potential, i got the strix halo max too, if run linux then can more optimization, i run wsl and lm studio on windows.

@sudoingX Better than Mac Mini for running a local models ?

Earn 4.00% Annual Percentage Yield for 6 months with a Premium Saving Account.

@sudoingX I got 7900 XTX , it’s a beast. 24GB vram, bandwidth almost same as RTX4090 for third of the price and everything is working in Linux. You don’t get CUDA but you don’t really need it to run QWEN models

@sudoingX ARM

@sudoingX looking forward to reading benchmarks on the Framework's Ryzen MAX 395

@sudoingX Ended up getting 7900 XT(used RTX 3090 is just too expensive in my area). Got Hermes running on it with Qwen 27b (Unsloth's Q4_K_M GGUF) with 64k context. Works fine, VRAM stays at 95%. Responses do take longer when Hermes compresses. Wondering what else I can tune up to fix that

@sudoingX We have AMD 192 Core CPU coming online early this week. AMD indeed ❤️🙌

@sudoingX Give the Max 395 a good test!

@sudoingX 😱

@sudoingX All millennials dreaming.