rah
114 posts
i think framework desktops are so underrated for what they cost and what they can do. this strix halo flagship, 128gb unified, was sent to me by framework and i've been waiting for the failure point ever since. still waiting. it's zero.
it runs huge moe models at genuinely good speed, quiet enough that i forget it's on, compact enough that it disappears on the desk, and it's now the main driver between my two monitors. dgx spark stays the ultimate box for training and clustering, connectx and scale is nvidia's world, but for personal starter inference this thing feels unbeatable at the price.
and the part i did not expect, it games. proper steam games running on vulkan, i plugged in two controllers and lost an evening to it.
one quiet box that serves a 397b moe at 18 tok/s, holds a 4 million token context on a 35b, and runs your steam library. the local ai box i keep telling people to wait for kind of already exists.
Sudo su@sudoingX
one month with the framework desktop 128gb as my amd inference box and i keep waiting for the catch. there isn't one. 128gb of unified memory in a 4.5 liter box. strix halo, ryzen ai max plus 395. framework sent it, amd seeded the program, and my only job was honest numbers wherever they land. so here are the numbers. a 397b moe runs at around 18 tok/s on this thing. a 35b holds a four million token context window. and the open community vulkan drivers beat amd's own rocm stack on my bench, which is the most linux thing imaginable. three and a half weeks of daily serving now, model swapping, long agent sessions, zero crashes, zero driver tantrums, fans i genuinely cannot hear. it sits next to the nvidia box and eats whatever gguf i throw at it. my 24gb card is still the daily driver, but a big memory tier at this price did not exist a year ago. amd showed up, and this quiet little box is the proof.
English
@declarative_ you're the one who decides who you are
the people who matter will respect you for that
you should too :)
English
@ash_x86 @AnthropicAI fair enough, i understand your perspective a bit more now
we'll see how it turns out in the long run
English
@4xdotrip @AnthropicAI rust isn't the issue :(
rewriting a code base with AI leads to extremely confusing code most of the time, and can be harder to manage
sure, humans take forever
but they can write it consistently, reproducibly, and often times more accurately.. especially for low-level stuff
English
@Hameed__Kareem @Cyberhijabitech chinese VPS hosting generally needs kyc, there is no north korean hosting
they just rent VPS and bruteforce off them until they get banned then get a new one
not really an option in those countries
English
@Cyberhijabitech Noticed the country flags you are seeing there.
Did you see North Korea? Or even China as the top attacker. They are all Europeans.
But these same Europeans keep pointing fingers at these countries. 😂
English
Someone deployed a honeypot on Azure, and the results were eye-opening.
In less than 24 hours, it recorded:
• 90,000+ attack attempts
• 8,000+ attacks per hour
• 600+ attacks per minute
The attackers tried everything:
• Exploiting known CVEs
• Brute-forcing weak passwords like "123456"
• Privilege escalation
• DDoS attempts
• Database targeting
This is a reminder that the internet is constantly being scanned by automated bots and threat actors looking for vulnerable systems.
If your server is exposed to the internet, don't assume no one will find it they will.
Security isn't optional.
Patch vulnerabilities, use strong authentication, and monitor your systems.
Kudos to the creator of this honeypot experiment for highlighting the reality of today's threat landscape.
English
ro sleep ro sleep beep beep beep gloob night chat :D gloob night :D
ro has headache so ro sleep early make sure u all remain watered and cared for
gloob night ^°^
English
"nothing ever comes home" guys are in shock rn. SOMETHING MIGHT COME HOME??
English
@rogesterone there's definitely apps that'd help with this but i feel it's something apple should improve
i'm gonna do a bit of research though i've never really used a tiling wm so i'll give one a try either way
English
@4xdotrip I don't mind a separate wm on top if the wm feels native, glazewm certainly does not feel native it feels like a hack
English
having been forced to use windows at my new job,
yes it really is That Bad, it's not just a meme that we tell ourselves to justify our ridiculous niri/hyprland/noctalia/bemenu setup, holy fucking shit this operating system won't let me catch a break at all
English
@rogesterone i like the macos desktop experience but i wish the window snapping was better without needing a separate wm on top
English
@4xdotrip hmm im honestly unsure, ive only ever had a mac as basically a media watching machine and I've barely ever tried to do work on it so idk how native amethyst/yabai/whatever feels
English