Max Zanoga

11

Lotto@LottoLabs·28m

@zanoga You’re doing the real work, I’m just shilling my own stuff 😂 But if you do post to localmaxxing it is greatly appreciated

English

0

19

Lotto@LottoLabs·13h

Instant follow It’s not even a question This is almost meme tier amounts of 3090s Amazing work

Finally finished building my AI datacenter! 🚀 32x3090s across 4 servers (8 GPUs each), all connected over InfiniBand. The whole setup is solar-powered with a massive battery bank and generator backup. More technical details and benchmarks coming soon.

English

31

30

2.6K

367.4K

Max Zanoga@zanoga·31m

@LottoLabs Thank you for your work! I'll definitely check it out and contribute if possible.

English

0

1

19

Lotto@LottoLabs·9h

If you’re getting started you can check out localmaxxing.com for what GPUs run which models all from user submission from real setups!

English

0

13

1.9K

Max Zanoga@zanoga·39m

@neuralSWE Thanks! And yes — in the process of installing the chillers right now 😄

English

0

1

17

Peacock@neuralSWE·43m

one day, i aspire to have a lab like dis also are those 2 industrial chillers like the LTT video?

Finally finished building my AI datacenter! 🚀 32x3090s across 4 servers (8 GPUs each), all connected over InfiniBand. The whole setup is solar-powered with a massive battery bank and generator backup. More technical details and benchmarks coming soon.

English

0

26

Max Zanoga@zanoga·3h

@billhfoos My wife just found out, and now I'm having a serious conversation 😅

English

5

29

TPS Reports@billhfoos·4h

My wife said no!

Finally finished building my AI datacenter! 🚀 32x3090s across 4 servers (8 GPUs each), all connected over InfiniBand. The whole setup is solar-powered with a massive battery bank and generator backup. More technical details and benchmarks coming soon.

English

0

1

43

Max Zanoga@zanoga·3h

@JoeGuglielmucci Wow, I really appreciate that!

English

0

3

72

Joe Guglielmucci@JoeGuglielmucci·3h

This is probably the worlds best working example of what local ai really means

Finally finished building my AI datacenter! 🚀 32x3090s across 4 servers (8 GPUs each), all connected over InfiniBand. The whole setup is solar-powered with a massive battery bank and generator backup. More technical details and benchmarks coming soon.

English

0

2

146

Max Zanoga@zanoga·4h

@Deriglasow @AndJakobsson Privacy and just try processing 10M documents through a paid API - the bill will give you your answer.

English

3

125

MellonFriend@Deriglasow·8h

@zanoga @AndJakobsson what for? I have all the money to build something like that, but whats the purpose?

English

0

274

Max Zanoga@zanoga·1d

Finally finished building my AI datacenter! 🚀 32x3090s across 4 servers (8 GPUs each), all connected over InfiniBand. The whole setup is solar-powered with a massive battery bank and generator backup. More technical details and benchmarks coming soon.

English

462

289

4.7K

565.5K

Max Zanoga@zanoga·4h

@Web3Twon @ktusing34 About a year ago, and I bought in bulk

English

0

2

80

Twon.@Web3Twon·13h

@zanoga @ktusing34 I suppose awhile back or did you buy in bulk?

English

0

393

Max Zanoga@zanoga·4h

@ktusing34 Around $30k, and that's just GPUs + CPU + RAM + Motherboard + NVMe + PSU. Network: $4k Solar station + generator + other stuff: up to $10k more. (All very rough estimates)

English

0

3

110

Max Zanoga@zanoga·13h

@ktusing34 Need to calculate, but I bought all before the memory crisis. I bought GPUs in the $550 - 650 range.

English

8

0

169

14.4K

Max Zanoga@zanoga·4h

@LottoLabs It's just addiction 😄

English

17

1.9K

Lotto@LottoLabs·13h

@zanoga What made you get all these 3090s 😭

English

0

38

3.1K

Max Zanoga@zanoga·4h

@TheZachMueller Ok, I promise to make an additional post about solar + batteries and how I chose and configured all this.

English

11

1.1K

Zach Mueller@TheZachMueller·11h

@zanoga Would love to poke your thoughts on solar power more. Choices? How did you calculate what you need? Etc

English

0

6

1.6K

Max Zanoga@zanoga·4h

@rosmine For all kinds of stuff - from dataset creation to coding assistance on private projects, and a lot more. I'll share all my experience and use cases in the future.

English

0

9

1.4K

Rosmine@rosmine·9h

@zanoga This is amazing! What are you using it for?

English

0

3

1.7K

Max Zanoga@zanoga·4h

@mr_r0b0t SB7800 + Mellanox ConnectX-6

Suomi

0

8

1.1K

mr-r0b0t@mr_r0b0t·11h

@zanoga the InfiniBand is the star of the show imho! would love to see your network topo 😍

English

0

4

1.4K

Max Zanoga@zanoga·4h

@NVIDIAAI Any chance of getting a discount on the DGX Spark?

English

3

0

118

4.1K

Max Zanoga@zanoga·4h

@micheltamanda It all starts innocently with "I just bought 2x3090s" 😅

English

0

12

2.1K

Michel Laclé@micheltamanda·5h

@zanoga At what point do say: I have gone too far 😀

English

0

2

2.4K

Max Zanoga@zanoga·4h

@TheAhmadOsman Thank you! You inspire me to buy more GPUs :)

English

11

828

Ahmad@TheAhmadOsman·6h

@zanoga NICEEEE

English

0

19

1.3K

Max Zanoga@zanoga·4h

@mattstaton Around $30k, and that's just GPUs + CPU + RAM + Motherboard + NVMe + PSU. Network: $4k Solar station + generator + other stuff: up to $10k more. (All very rough estimates.)

English

0

15

395

Matt Staton@mattstaton·5h

@zanoga Cost?

English

0

2

398

Max Zanoga@zanoga·5h

Thank you all for the interest in my setup! 🙏 I'll read and reply to every message. As promised: Tech specs of my AI cluster 👇 - Board: ROMED8-2T - CPU: EPYC 7302 - RAM: 256GB DDR4-3200 - Storage: 2TB NVMe - Risers: ADT-Link MCIO - PSU: 2xSuper Flower Leadex 2000W Network: - ConnectX-6 - SB7800 InfiniBand Cooling: - 8x12mm fans exhausting GPU heat - 9733 for the ConnectX-6

Finally finished building my AI datacenter! 🚀 32x3090s across 4 servers (8 GPUs each), all connected over InfiniBand. The whole setup is solar-powered with a massive battery bank and generator backup. More technical details and benchmarks coming soon.

English

28

22

246

12.4K

Max Zanoga@zanoga·8h

@1337hero Sorry 🤣

English

3

44

Mike Key@1337hero·8h

You can blame this guy for 3090's being expensive. 🤣

Finally finished building my AI datacenter! 🚀 32x3090s across 4 servers (8 GPUs each), all connected over InfiniBand. The whole setup is solar-powered with a massive battery bank and generator backup. More technical details and benchmarks coming soon.

English

0

12

767

Max Zanoga@zanoga·8h

@gospaceport Thank you for your work! You really make interesting content that helps people!

English

4

52

Max Zanoga@zanoga·9h

@hofman_eth Sorry @sama, not today

English

3

49

hofman@hofman_eth·9h

Finally finished building my AI datacenter! 🚀 32x3090s across 4 servers (8 GPUs each), all connected over InfiniBand. The whole setup is solar-powered with a massive battery bank and generator backup. More technical details and benchmarks coming soon.

ZXX