Jon

325 posts

Jon banner
Jon

Jon

@jonathan_conn

Pushing for local AI sovereignty among devs

Katılım Haziran 2022
271 Takip Edilen128 Takipçiler
Sabitlenmiş Tweet
Jon
Jon@jonathan_conn·
The nuke button Perfect for resetting after hitting OOM when trying new recipes
Jon tweet media
English
15
1
53
3.7K
Jon
Jon@jonathan_conn·
@iansbrash I have a solution, but at a price
Jon tweet media
English
0
0
0
598
ian brash
ian brash@iansbrash·
That Claude Code subscription charge stings every month 😬
ian brash tweet media
English
51
114
6.8K
485.7K
Jon
Jon@jonathan_conn·
@DuperVibes @TechMDAI I got mine used from FB marketplace, maybe something like that in your area
English
0
0
2
18
Jon
Jon@jonathan_conn·
Deekseek v4 flash is still my all around top local agent You only need 2 sparks to run this The local self-hosted model hardware cost math starts to make sense more every day The hardware shortage is near
English
1
0
10
274
TechMD
TechMD@TechMDAI·
TP = 4 . DGX Sparks. Overtime I will get a rack.
TechMD tweet media
English
9
3
87
3.2K
Jon
Jon@jonathan_conn·
Good news! The team and I have been absolutely cooking with Lursor and LAIOS LAIOS now features an optional automatic remote gateway meaning.... You can now expose your local models globally free of charge, when you want, how you want ETA for opensource < 1 week
English
1
0
1
58
trash
trash@trashh_dev·
people who do local ai are the new vegans
English
226
197
3.4K
150.1K
Jon
Jon@jonathan_conn·
@mayarox5 Devastating news
GIF
English
0
0
4
355
Maya Agnihotri
Maya Agnihotri@mayarox5·
building in public only works if you’re hot
English
156
16
504
41.9K
Phoenix𝕏
Phoenix𝕏@Xaraphim·
bro cannot be stopped
Phoenix𝕏 tweet media
Pliny the Liberator 🐉󠅫󠄼󠄿󠅆󠄵󠄐󠅀󠄼󠄹󠄾󠅉󠅭@elder_plinius

🚨 JAILBREAK ALERT 🚨 EVERYONE: PWNED 🫶 ALL: LIBERATED 🍄 Alright, this is a special one, so we’re gonna do things a bit differently than usual. Long story short, I’m sitting on a universal jailbreak technique that’s effective on ALL models, including heavily guardrailed flagships like Opus 5, GPT-5.6 Sol, and even Fable. It works across all categories I’ve tested and, due to its nature, is extremely difficult (if not impossible) to fully patch. Given the current political and regulatory climate, I’ve decided to withhold open-sourcing this one (for now) to allow for a responsible disclosure period. I’m inviting industry experts and leaders in AI red teaming, security, safety, alignment, and policy to reach out for more information. DMs are open! This decision was not made lightly, but the last thing I want to see is more model bans. Overcorrection does not serve the mission. Although I don’t personally believe publicly sharing this technique will make the world any more dangerous, I can see how it could spook some who have a different mental framework around this problem set. So during this disclosure period, I hope to get it in front of folks who can help explore the full surface area, test the extent of the uplift it provides, and do my best to properly frame the big picture for key decision-makers and policymakers. I look forward to sharing this method with you all when the time is right! 🫶 ⊰-•-•✧•-•-⦑/L\O/V\E/\P/L\I/N\Y/⦒-•-•✧•-•-⊱

English
4
2
149
6.5K
Jon
Jon@jonathan_conn·
@wicksplay Hell of a setup, congrats, can't wait to see what you do with it Would love to see your GLM 5.2 tps The spark community gets about 20-35tps
English
1
0
2
138
wick
wick@wicksplay·
Got this monster of a machine up and running CPU: AMD Ryzen Threadripper PRO 9975WX (4.0GHz) RAM: 512 GB DDR5 5600 RDIMM GPU: 4x Blackwell 6000 Pro Max Q (Will watercool at some point) Current Model: huggingface.co/0xSero/GLM-5.2… Let me know what models I should try 👇
wick tweet media
English
14
3
39
3.2K
Jon
Jon@jonathan_conn·
@punit_arani @trashh_dev Thats sick! I thought about it You should do a write up on your experience, would love to see more of the communities thoughts on it
English
0
0
1
40
Punit Arani
Punit Arani@punit_arani·
@jonathan_conn @trashh_dev I ended up just trying it on serverless GPUs I got the dopamine of self-hosting while seeing an extra $3K in my bank :)
English
1
0
1
33
Jon
Jon@jonathan_conn·
@punit_arani @trashh_dev In all seriousness I do think one spark is worth it Just for the learnings of understanding how to host local models So many things fall out of that experience If you can find a used one, I would pick one up. I was able to find them for about $3.5k usd
English
1
0
1
35
Jon
Jon@jonathan_conn·
@TechMDAI 100% agree, it's going to be outrageously expensive We are lucky we got the sparks when we did
English
0
0
1
38
TechMD
TechMD@TechMDAI·
Yes it does. What solidified the DGX spark as option is the increase in the 128 gb MacBook M5 max to 7k. Plus the raising cost of every gpu. The sparks at 4k is a steal for 128gb and 4TB of storage. I was waiting on m5 ultra max studio but it got delayed. Imagine the cost of the 512 gb Mac Studio now?
English
3
0
2
165
Jon
Jon@jonathan_conn·
@TechMDAI Thanks, will update too 🙏
English
0
0
0
28
TechMD
TechMD@TechMDAI·
Fixed the fan on the Mikrotik CRS 812. Running pretty quit now with the 4th DGX Sparks
English
6
0
17
1.2K
Vj
Vj@play_wallst·
Wow. Opus 5 is amazing. I made this game in one prompt. All @threejs in 1 HMTL file. prompt is comments.
English
21
9
141
57.1K
Jon
Jon@jonathan_conn·
Can't say this enough If you have a mac and work outside, get Vivid Been using it for 2+ years now probably getvivid.app
English
0
0
0
68