Max Zanoga

1.1K posts

Max Zanoga banner
Max Zanoga

Max Zanoga

@zanoga

🚀 AI Enthusiast | 🔍 Exploring the frontiers of LLMs & ML | 📚 Lifelong learner & tech optimist

LAB32 Beigetreten Ekim 2009
1.8K Folgt4.8K Follower
Max Zanoga
Max Zanoga@zanoga·
Thank you all for the interest in my setup! 🙏 I'll read and reply to every message. As promised: Tech specs of my AI cluster 👇 - Board: ROMED8-2T - CPU: EPYC 7302 - RAM: 256GB DDR4-3200 - Storage: 2TB NVMe - Risers: ADT-Link MCIO - PSU: 2xSuper Flower Leadex 2000W Network: - ConnectX-6 - SB7800 InfiniBand Cooling: - 8x12mm fans exhausting GPU heat - 9733 for the ConnectX-6
Max Zanoga@zanoga

Finally finished building my AI datacenter! 🚀 32x3090s across 4 servers (8 GPUs each), all connected over InfiniBand. The whole setup is solar-powered with a massive battery bank and generator backup. More technical details and benchmarks coming soon.

English
1
2
3
86
Max Zanoga
Max Zanoga@zanoga·
@gospaceport Thank you for your work! You really make interesting content that helps people!
English
0
0
3
46
Jen Zhu
Jen Zhu@jenzhuscott·
If we built 4 server unit comes with immersion cooling (also eliminating the noise & fire risk), batteries (also immersion cooled), solar sets, all electronics needed in one residential local micro data center - would anyone be interested?
Max Zanoga@zanoga

Finally finished building my AI datacenter! 🚀 32x3090s across 4 servers (8 GPUs each), all connected over InfiniBand. The whole setup is solar-powered with a massive battery bank and generator backup. More technical details and benchmarks coming soon.

English
4
4
30
3.4K
0xSero
0xSero@0xSero·
@zanoga @royjossfolk Holy moly what the hedge Do you have a garage for this? The heat! You beat me to 784gb vram
English
1
0
162
14.3K
Max Zanoga
Max Zanoga@zanoga·
Finally finished building my AI datacenter! 🚀 32x3090s across 4 servers (8 GPUs each), all connected over InfiniBand. The whole setup is solar-powered with a massive battery bank and generator backup. More technical details and benchmarks coming soon.
Max Zanoga tweet media
English
399
221
3.9K
428.1K
Ni
Ni@00cosm00·
@zanoga Motherboards?
English
1
0
0
5.6K
Mr man
Mr man@mrman589·
@zanoga Do you have dedicated ACs to tackle the heat?
English
1
0
4
9.2K
Andreas
Andreas@AndJakobsson·
@zanoga This looks so cool! What will be the first model you will run on it?
English
1
0
0
7.6K
Elbow
Elbow@ArpinGarre66002·
@zanoga I like the solar power
English
1
0
11
4.1K
Max Zanoga
Max Zanoga@zanoga·
@kirillkovalenko For now, just AC, but I'm working on a proper HVAC system. Here are the idle temps
Max Zanoga tweet media
English
0
0
45
6.7K
Max Zanoga
Max Zanoga@zanoga·
@frankb737459085 No, I'm building it for my own projects. Still testing things, but GLM 5.2 is next on my list.
English
5
0
37
5.3K
frank b
frank b@frankb737459085·
@zanoga Are you renting it out? Got GLM 5.2?
English
1
0
4
5.8K
Max Zanoga
Max Zanoga@zanoga·
@oblx_dev Thank you. I'm glad that you like the result.
English
1
0
14
9.1K
Max Zanoga
Max Zanoga@zanoga·
@ktusing34 Need to calculate, but I bought all before the memory crisis. I bought GPUs in the $550 - 650 range.
English
7
0
146
11.3K
Kyle Tusing
Kyle Tusing@ktusing34·
@zanoga Do you have a rough estimate on how much this cost?
English
2
0
18
12.4K
Max Zanoga
Max Zanoga@zanoga·
@Teknium Thank you for all your hard work! You are amazing!!!
English
0
0
0
34
Teknium 🪽
Teknium 🪽@Teknium·
We just passed 1500 Contributors to Hermes Agent's repo! Thank you to all the contributors and developers!
Teknium 🪽 tweet media
English
90
47
1.1K
128.6K