Draco

Yup! I'm unsure which ones might be better suited than others for a lot of these tasks. I was impressed by everything Qwen 3.6, even on the 4090 (especially the Plus model when it was free on OpenRouter), but there might be broader horizons with this setup. Or not. Also curious if there's just larger models that improve on Qwen. (Well... when they aren't needing 100+ GB of VRAM) Seems outside of Gemma or something unreachable like Kimi, I should stick to Qwen. And I'd say my work consists of everything under the IT sun, but trying to focus on app dev in the realm of converting antiquated programs into modernized web-based ones. Or just simply cooking up new ones. :)

@DracoTV @pupposandro yeah, first thing i'm thinking is I would run multiple slots for concurrent work, 27Bs & 35Bs side by side, but i'm not sure if it's the best to recommend for this setup it all comes down to the complexity of your work and what you need

Okay lads, you know what day it is 🔧 Setup Sunday Tell me your hardware and I'll tell you the best model you can run on it. Found anything cool this week? Drop it in the comments. Let's help each other out 🫡 Hottest topic of the week is definitely PFlash by @pupposandro (achieved 10x prefill speedup at 128K ctx on an RTX 3090 with llama.cpp). I highly recommend giving the man a follow, 3k followers for this level of work is straight-up criminal On my side, here are my stats on an RTX 5080 (16GB) with Qwen3.6 35B A3B, full GPU offload. Running it with these llama.cpp flags: -ngl 99 \ -np 1 \ --flash-attn on \ --cache-type-k q8_0 \ --cache-type-v q8_0 \ --ctx-size 131072 Running at 150 tok/s then slows as context fills. I'm using 35B as main driver these days and I switch to 27B whenever 35B can't handle the task. Works well for me on this single GPU setup. Feel free to drop your hardware, model, speeds or any optimization wizardries you've pulled off. It will be super helpful to others!

No worries, I appreciate you making threads like this. I got tired of trying to pack a 4090 (still very capable), then finding it often overflowing the VRAM. Plus this is more about feasibility of using this at work, not just for myself or coding single file html pages. ;) I may still throw multiple llama-server instances at it later in Win11 just to see what happens.

@DracoTV @pupposandro Jealous of your setup lmao, what a beast Unfortunately i'm not a vllm expert, hopefully someone can share his lights

Let's test this RTX Pro 6000 out with exactly what a $9k card should be tested on... Crimson Desert. :P (After a driver update or two) twitch.tv/draco

@microcenter Thank you! See you there then!

@DracoTV Hi! It's a sign-up form to receive a coupon for a free flash drive, and to receive text notifications for any updates. Today is the last day to sign up, so if you're looking to claim your coupon, make sure to check out the page before the end of the day!

Hey @microcenter - What’s the deal with the registration on the reopening event of the North Jersey (NJ) location? Is that form a signup form or has that availability passed?

Well, I bit the bullet and picked up a RTX Pro 6000. I have a couple reasons for blowing that much cash on one, but it’s mostly centered around Hermes Agent and other projects. It’s quite eye opening to see what doesn’t actually fit inside 24GB VRAM! (Unquantized Qwen3.6-27b with a huge context length should be fun) If anyone is curious what can run on it later today, I get a dual boot going (suggested flavor of Linux?) to experiment w/ vLLM. May avoid llama.cpp for now or maybe see performance impact with WSL? I’ll do it all on Twitch as normal. Oh, and maybe +20 FPS in Crimson Desert. Should test it there first. :P

@YouTubeGaming - What's the deal, you don't support 3440x1440? (Ultrawide) I mean... I'm sending it, but I just recently saw a pop-up saying it isn't. Except, it is? Why are ultrawide resolutions getting the shaft?

@DevinOlsenn After nearly having it stuff my face into the steering wheel when it emergency braked for a cat crossing the road, I’d love to see if that would’ve popped up.

New UI in FSD V14.3.2 for interventions. I think this is great, but one of the options should be navigation and as far as I can tell it doesn’t go away? I’m sitting here parked and it’s staying up on my screen.

Well that isn’t true, @Tesla ;P

@elonmusk I’ll start with three.

Cybercab

@elonmusk Help me out on the finances to establish it and I’ll open one up in NY that’ll take off in no time. I have a perfect spot in mind. (Wishful thinking…)

More Tesla Diners coming

POV: you’re in a John Wick movie

I built CourtWatch.us — a free public database for American citizens who deserve safer communities. You can track which judges released defendants who then got rearrested, skipped court, or violated their release conditions. All public records. All free. I started with Orange County FL and will be expanding to all 67 Florida counties and eventually every state in the country. This first batch of info is from 2024 and since public reports are released in March/April for the previous year, data is behind. But I wanted to see if this is plausible. After adding 2024,I'll add 2025 and then figure out how to get real-time-data uploaded. It's in beta — would love to know what you think 👇 Numbers don't lie, but criminals do. courtwatch.us @bennyjohnson @jockowillink @GrantCardone @LauraLoomer @nickshirleyy @j_fishback

I want to add to this actually because many have no idea or clue that I was severely injured by LASIK eye surgery in 2021. I was basically disabled with my vision and lived in searing/excruciating pain for over 900 days straight. It has taken approximately 1,521 days of healing for my vision to reach any form of normalcy and comfortability. These doctors would tell me “your flap looks good, you have 20/20 vision!” And would always brush me aside never caring about what I was experiencing. What I experienced is something many would just end their lives over because it is something so sinister and evil that surviving it felt like I had to shut my brain off all the time. The amount of out of commission days I had due to my eyes burning, being so dry and so blurry that I couldn’t focus was insane. Reading paragraphs was unspeakably difficult and I would give up 30 seconds into it. Being In any room with any form of air flow would dry my eyes out and make them hurt. Going outside and my eyes burning from allergies (this never happened before lasik). It felt like I was completely doomed. The pain that I was feeling was like a thousand needles going into my eyes in waves throughout the day. I also want to state that no eye drop helped, no form of any kind of lubrication helped because my tear film was so destabilized after LASIK that it would instantly melt off my eyeballs. It would just go right back to being dry. So what DID work even? What actually healed my eyes? The only thing I could ever find and do that actually healed me was Blood serum eye drops (which is basically your own blood but spun into its platelet rich form and then administered into your eyes) which takes 13 excruciating vials of blood to draw for. This is because it’s one of the only things that works for regrowing nerves and I had very bad nerve damage after LASIK. Don’t even get me started on nerve damage because there were so many nights when I’d close my eyes to sleep, and it felt like my eyes were completely cut out of my head and weren’t there. Another thing I did to heal was collagen spamming, any form of it to try and produce a healing effect. The last thing though which was very surprising was red light therapy from a special red light panel. Yes this genuinely healed me and helped my eyes a ton. Everything else aside from this that I tried just didn’t work or had no effect. Many will ask how I even continued to stream or play games, how I was even hitting rank 1 in these games under such bad conditions. Quite frankly I don’t really know. I just pushed through the pain every single day and tried to be here. Gaming was all I had and even though I couldn’t see much or make out the character outlines well or even the motion clarity, I still played. My motion quality was so bad it was like my eyes were seeing in 20 fps. I don’t know how this was possible but it made everything like driving and even daily activities so difficult. I remember trying to check my blind spot when driving and it being so delayed and laggy like it wasn’t even worth checking. It felt like all the dopamine was stripped out of my vision and there was no reason to keep living on. I just want to put this story out there that if you’re suffering like me, there’s hope for you and the body can heal itself if you give it the right conditions and just give it time. As of today I’m doing much better and within the last month it’s felt like I can actually live my life properly and see again. I guess this was a secret I was keeping for a long time but now you all know. I’m just trying to live my life and be happy.

@dogfishbeer Running low. Pls send more or else I’ll plot a path with my Tesla to your primary brewery. Thank you for your attention to this matter.

Since Twitch doesn't want to properly support higher bitrates (20+ Mbps) and proper resolutions like 3440x1440 and AV1 encoded streams, I'll just give them JTV-style streams instead! Go say !YT if you want to watch sharper but boring Crimson Desert play. twitch.tv/draco (oh no, there goes my reach with this external link!)

Warning: The current HWmonitor download and possibly other PC monitoring applications, may be infected with viruses. More info: reddit.com/r/pcmasterrace…

@elonmusk @Tesla My body is ready.

Tesla V14.3 self-driving review. The point releases will bring polish. V15 will far exceed human levels of safety, even in completely unsupervised and complex situations.