am.will@LLMJunky
This is what 30 hours of work, a handful of AI bux, and and a sore back looks like:
2x RTX 6000 Pro
320GB RAM (192V+128GB)
48,128 CUDA Cores
1.8TB/s Memory Bandwidth
9950X (16c/32t)
Corsair DDR5 6400
ASUS ProArt X870E
4TB Crucial T705 5x4 SSD
4TB Crucial P3 4x4 SSD
4TB Crucial T500 4x4 SSD
Asrock Platinum 1600W
Corsair XD5 Reservoir
EKWB Waterblock
2x 360mm EKWB Radiators
Way too much debt
I'm so stupid
But it's glorious
I bought everything used or repurposed old equipment except for the water block, 1 GPU, and 3 fans.
Even though I'm not thrilled about spending the cash, I only have about $10.5K into it (not counting parts I paid for years ago).
Safe to say I did pretty damn good all things considered.
I'd like to thank @centralcomputer for helping me get this project off the ground.
Now that I have this together, my aim is to support the OSS community.
If you're interested in running local models, consider following me on this journey.
Next chapter loading....