Tech2Wild

@gospaceport @Web3Twon I bought a second, then just got a 3rd one. But now I can run it together because TP=3 don't work so guess what... I need a 4th one ! Don't fall for the trap lmaoo

@Web3Twon 2x 3090 is a crazy amount of added performance. 4x is nice also, but man 48GB is a certain amount of models fitting that makes it make sense.

Agreed but be warned there will be a strong desire to get a second 3090 😆

@GPTWare and bruh I didn't even thing about that til you said it. It's a GEN 5 ! Not a GEN 4? That makes it a STEAL at this point not a 1:1 lol. That almost looks like a Ebay Scam now lol. I trust its real though but I'm just saying.

@Tech2Wild That DDR5 RAM alone right now $$$

This is an amazing price and deal.

@GPTWare True ! I built a PC about 2 years ago and ram was so cheap so I tend to forget.

Made a decision today, and I am going 80% local. Moving ALL my agents to DSv4 Flash & Qwen 3.6 27B. Running my orchestrator, ONE Agent on Opus 4.8 to lead the charge. We will build automations & Skills that will help teach and shape the team. Workflows = Success. Wish Me Luck !

@GPTWare I am close to buying a 4th 3090 if I could just return everything and get my money back I'd just buy this your literally paying around $4500USD which is basically $1k each GPU and $500 in CPU, RAM, PSU, MB like its literally a 1:1 price

@Tech2Wild Can’t believe it’s still available.

@otpyrcmaniac Oh your right there with me

Nothing exploded yet 🤞🏼

@0xyourfren That was me setting it up lol

@Tech2Wild Two 3090’s on top of each other just sat on the PSU outside the case got me feeling a type of way

TRIPLE 3090s…. Need a new MB and start building a RACK if I decide to go any further lol. Temporary rig for now I gotta get a rack 🤣🤣🤣

One issue with Opus since 4.7 that still hasn't resolved: the agent sometimes NOT using telegram to respond. Goes silent but been blabbing on the terminal. Tell them to always use the plugin to respond back & they still revert to not responding in telegram.

test

@netobge Can you send me that recipe

@Tech2Wild Qwen3.6 35B A3B AutoRound fits in a single 24GB GPU with 262K context with fp8 KV cache and runs at 160 tps in a rtx 3090 via vLLM... Produces much better code than Gemma 4 12B. Unfair to compare them.

Hmm wondering which is better: Gemma 4 12B or Qwen 3.6 35B-A3? 🤔

@YahiaAh87164950 @sakurayukiai 2 GPUS gave me more speed on 27B it went from 70 tok/s to a 120

@Tech2Wild @sakurayukiai 2 gpu means more capacity not speed

@princedoesai Agentic automation where would you put that at ?

@Tech2Wild Gemma vs Qwen depends on workload

@MakerInParadise Oh 12b of talk more unprofessional?

@Tech2Wild I can’t say anything negative about either model other than that 12B’s native vernacular is too informal for my liking… it has grok4.1/deepseek sentence structure and punctuation. Otherwise, I think that 12B is the better chat model and 35B the better reasoner/researcher.

@malikwas1f Good call I been running your recipes bro thanks for what you do

@Tech2Wild Setup comfyui on third

Got the 3rd GPU setup (3x 3090s) but no TP=3, so I'm running a separate model or cloned 27B on the extra card. Been looking at Gemma 4 12B but honestly wondering if it's worth it when I can already run 27B or 35B at full context... What's your take? 🤔

@sakurayukiai I have 35B running now. The issue I’m having is 2GPUs of 27B give me almost identical speeds as 1 GPU on 35B

@Tech2Wild If you can fit the 35B footprint, Qwen is wild. Only 3B active params means it runs circles around Gemma's 12B dense decode speeds, but Gemma 4 is way friendlier on a single consumer GPU.

@gospaceport Sir I literally just watched your video on your Quad Build from 9 months ago 🙏🏽. Debating whether you go to GEN 5 or just grab one of the motherboards you showed and stay Gen 4.

Soon

@sakurayukiai Going to look into this now.

@Tech2Wild Wrote a breakdown on how the mechanics and math of speculative decoding actually work: leetllm.com/learn/speculat…