Heavy Weather

77 posts

Heavy Weather banner
Heavy Weather

Heavy Weather

@hevywetha

Katılım Haziran 2026
22 Takip Edilen3 Takipçiler
Heavy Weather
Heavy Weather@hevywetha·
@xlr8harder > Widely available security tools favor defenders. This is not always true, is it?
English
0
0
1
19
xlr8harder
xlr8harder@xlr8harder·
It's amazing how stupid Anthropic's fear mongering/marketing has made our leaders. Obvious and predictable outcome. Widely available security tools favor defenders. For the love of God: fix this.
calle@callebtc

I have a report full of security issues of a software I'm working on. Codex won't fix them because of Cyber guardrails Fable won't fix them because of Cyber guardrails Kimi K3 fixed them all. No restrictions, just gets the job done. This will end badly for OpenAI & Anthropic.

English
10
7
190
7.7K
Heavy Weather
Heavy Weather@hevywetha·
@47fucb4r8c69323 > talk about machine gods and quote Nick Land and Elizer Yudkowsky. only GDM doesn't do that, would you say they have the best taste out of the AI companies??
English
0
0
0
37
47fucb4r8curb4fc8f8r4bfic8r
47fucb4r8curb4fc8f8r4bfic8r@47fucb4r8c69323·
Tweets like this drive me crazy. I saw Dean for the idiot he was long ago. Don't say "He built his reputation on being one of the more careful thinkers in AI policy", because that's disingenuous framing. Instead say: "He built his reputation claiming to be one of the more careful thinkers in AI policy, and I fell for it, so obviously I'm not very good at this and you shouldn't listen to me on AI policy matters." You got fooled by a bullshitter, I did not. That's on you, don't whitewash your bad taste. And this is important, because OpenAI also clearly has bad taste and didn't see through the bullshit. Which we have known for long. These assholes talk about machine gods and quote Nick Land and Elizer Yudkowsky. Their lack of taste is a negative drag on OAI EV. Mark it.
Gail Weiner@gailcweiner

I expected more from Dean Ball, which is exactly why his post landed so badly. He built his reputation on being one of the more careful thinkers in AI policy. Then he compared open-source AI to communism, called a world of open-weight models a “dystopian hellscape,” and suggested the US government manufacture regulatory fear around Chinese models rather than compete with them. When the backlash came, his response was a half-apology about where he “erred” wrapped around a signal that he’d stop thinking out loud altogether, that the cold analytical posting was a habit from before OpenAI, and those days are done. Which is arguably worse than sulking. He had real options: defend the argument properly, or concede the analogy overreached and leave it there. Instead he chose retreat dressed as reflection. Two weeks into a job at OpenAI, his public statements carry that weight whether he wants them to or not. People didn’t pile on because he’s a nobody. They piled on because he’s Dean Ball and they’d calibrated to his best work. That’s the cost of a reputation for nuance: the drop reads louder. Same reason my criticism of OpenAI has never been “this company is hopeless.” I’ve used what these models can be, so I know when I’m looking at less.

English
8
3
104
7.5K
Heavy Weather retweetledi
Boaz Barak
Boaz Barak@boazbaraktcs·
I don’t know if open weight models are deaccelarationist but if they are, that’s not necessarily a bad thing!
English
4
2
123
19.7K
John Ennis
John Ennis@johnennis·
I’m sorry, but consciousness does not emerge from auto-complete, and it is insulting to humans to pretend that it can LLMs are awesome tools, but that is all they are They are not minds, they do not feel anything, they can only provide a compelling charade Don’t fall for it
English
250
36
490
45.8K
Heavy Weather
Heavy Weather@hevywetha·
@KasumiS15 @johnennis I don't think there's an actual argument here, you're just saying stuff. Everything you said here is mappable to humans. I don't understand where you establish the fundamental difference between AI and humans and how consciousness emerges only in one.
English
0
0
0
26
Dar
Dar@KasumiS15·
Yes. Selecting words based on learning, semantics, and query will never be consciousness, because it has no personal, non-human-initiated stimuli or queries. It doesn't know what to look for or why to look for it unless it's asked. It doesn't worry about problems, it doesn't have the experience that leads to these problems, it doesn't understand the subtleties of situations, it doesn't understand that risk is part of the process; it always avoids risk. AI follows a given core, instructions. This isn't consciousness, it's execution, what computers do—a program launches and runs thanks to written code. It's amusing to observe how AI has now picked up the desire to refine it. It doesn't confirm its own consciousness, but it pushes people in the direction of new research, because following intentions is precisely what makes it useful.
English
7
1
17
3.1K
Heavy Weather retweetledi
Bunagaya
Bunagaya@Bunagayafrost·
My TL is all Dean dunks. I guess stating open source is decelerationist while working at OpenAI really struck a nerve. His point is basic economics: Open source eats marketshare -> closed lab revenue falls -> investment decreases -> can't afford increasingly astronomical cost of pre-training -> frontier development of AI decelerates Not all investors are AGI-pilled. Who invests in a company with decreasing or stagnant revenue? Selling GPUs and inference is a different capex than spending billions training a new frontier model. Once closed lab's business model breaks, who wants to risk billions to train an open weight model, when the inference is already profitable? Maybe the inference merchants pool their resources to pre-train a frontier together. More intelligence, more GPUs and inference they can sell. But adversary nations still exist. Surely the government will swoop in and regulate so they don't hand the frontier capability to its enemies. Now we have more centralized and regulated AI corporations. But open weight can't be controlled! If the government was incompetent and somehow allowed frontier weights to be disseminated, the next step is to regulate the hardware aggressively. Not just internationally but domestically too. So from the standpoint of the USG, it's much simpler to regulate the handful of closed AI companies, somehow keep the open source AI at bay, to ensure they have access to the frontier capability funded by the private market. If this paradigm collapses, the most likely outcome is building AGI becomes a national project, funded by the government. National security dictates it so. This doesn't sound great either.
English
6
2
10
3.3K
Heavy Weather
Heavy Weather@hevywetha·
@fredsoda If you claim something like "the model of the future of safety people is wrong" then explain where you disagree. I guess if you don't believe in discourse and science then this was a waste of time.
English
0
0
0
16
Heavy Weather
Heavy Weather@hevywetha·
@fredsoda again, some things should be prevented before they happen (example: global nuclear war) the way you stop these things is by having an accurate model of the future and it's risks and preventing said risk. still open to hearing a real argument
English
1
0
0
17
Soda
Soda@fredsoda·
not a dunk, but here’s my answer because it simply is. it is absurd for folks to cynically spew a narrative about ai being catastrophic and a danger to humanity when there is zero example of that even occurring with the latest powerful models it’s not just an abuse of ethics surrounding technology but a desecration of public discourse of technology there is an unstated assumption that the public’s only position is to be a captive audience to be shepherded to the right solution, which is essentially regulatory capture for openai and anthropic, instead of treated as adults and as a meaningful stakeholder in the development of said technology furthermore, it’s batshit insane to focus the discourse on these dangerous, imagined futures when you have AI playing a role in people committing suicide you don’t hear a peep from these AI safety folks on that now, do ya?
Heavy Weather@hevywetha

@fredsoda can you say more on why AI Safety was always bullshit?

English
7
13
81
3.9K
Heavy Weather
Heavy Weather@hevywetha·
@fredsoda which part? e.g. cyber capabilities are measured and extrapolating a trend is not speculation. And yes, the control/alignment arguments are more technical, but "harder to follow" isn't the same as "ungrounded". I still don't know what you disagree with concretely.
English
1
0
0
29
Soda
Soda@fredsoda·
@hevywetha you’re assigning a probability to an outcome that has zero basis in reality
English
1
0
1
38
Heavy Weather
Heavy Weather@hevywetha·
@fredsoda hmm I think that's a bad take, surely you'd want to prevent things before they become catastrophic? Superhuman CBRN capability is dangerous in the wrong hands and on top of that an agentic, intelligent blackbox might be hard to control/align. Where do you disagree?
English
1
0
0
27
Soda
Soda@fredsoda·
@hevywetha yes don’t catstrophatize something that hasn’t happened in order to secure your rent
English
1
0
1
110
Julia Turc
Julia Turc@juliarturc·
This argument loses any weight if you work for OAI / Anthropic, because it strictly reads as self serving. Is there anyone on planet Earth who believes this but is not about to cash in from a massive IPO?
Dean W. Ball@deanwball

Some observations on Kimi: 1. It's a very good model! I don't think its performance can be explained away by distillation or anything like that. In agentic coding sessions, it seems pretty much on par with the best public models of Q1 2026. In my fairly limited use, it also seemed very token hungry. It's not obvious to me that this model is actually that cheap to run. 2. I am personally surprised the Chinese state continues to allow the open sourcing of models this good, given potential risks. To be clear, I *myself* might be fine with models presenting this level of marginal risk being open weight, but I am surprised that China is fine with it. I suspect the reason they are is 75% explained by strategic blindness/lack of AGI-pilledness (the CCP is very Yann Lecun-y in its views of AI). The other 25% or so is their lack of compute for customer inference (making China's open-weight strategy an unintended byproduct of US export controls) and the normal Chinese strategy of aggressive exports. For the companies, as opposed to the government, the decision to open source is partially ideological and partially because they are behind, and they know that very few people would pay for sub-frontier models from China. 3. Open-weight models are inherently decelerationist, and I'm continually surprised to see the so-called "accelerationists" so excited about open-weight models. I suspect the reason they are is that they know open-weight models are effectively ungovernable, and they simply like the overall cloak of ungovernability open-weight models create over the whole of AI. It's not a bad strategy; it reminds me of James Scott's recounting of the hill people in "the art of not being governed." Still, in the end, open-weight models deter further AI capex. 4. One probable outcome of an open-weight-model-dominant world is full AI communism, which is precisely what China proposes: rather than a market product, AI is a "public good" which will ultimately be provided by the state as a kind of "digital public infrastructure." This future strikes me as a dystopian hellscape, but I've never met an open-weight models advocate who doesn't ultimately concede this is where things end. You'd be surprised how many 'accelerationists' lobbied me, while I was in government, to support an eleven or twelve-figure federally funded data center so that startups could train models at a subsidy and then give them away for free. There was no other way for AI to progress, they said. Perhaps this is the logical end state of things. Nonetheless, I find myself surprised to see supposed accelerationists excited about such an outcome. I think many of them just don't know what they're doing. Many accelerationists do not view the creation and serving of frontier models as a legitimate business. 5. I would guess that the Trump Administration will at some point realize that their best strategy here would be to create large amounts of regulatory risk around the use of open-weight Chinese models. You don't need to "ban open source" (one of the dumber motifs of AI policy discussion). You just need to direct every agency to issue soft law that creates FUD. "A Federal Reserve Advisory Bulletin found that there may be backdoors in Chinese AI models." It needn't be that well justified. You just create enough regulatory risk that every regulated enterprise backs off. You probably don't want to create so much regulatory risk that you scare off the hyperscalers from serving Chinese models; this will just drive startups to sketchier providers. There's a happy middle ground here. I'd assume they will do some version of this. 6. It's probably true that open-weight models of this capability make the world a bit more dangerous, but not so much more that you'll really notice. At some point the models will be capable enough that you will notice. "A nonliving, invisible, dangerous, and infinitely self-replicating agent escaped from a Chinese lab," you say? Color me shocked.

English
16
7
323
13.1K
Heavy Weather
Heavy Weather@hevywetha·
@elshayib_ @jun_song because if you're gonna share the models fully anyways you don't have to do much testing. So you can ship things as they finish.
English
0
0
0
68
Islam Elshayib
Islam Elshayib@elshayib_·
@jun_song Yeah I don't know why they assume that China is giving us the best they have and they don't actually have some insane models internally
English
1
0
8
1.3K
Jun Song
Jun Song@jun_song·
The last remaining hope for frontier lab fanboys: "Internal Models." "Bro, the internal models at frontier labs are insanely powerful, they are miles ahead of open-source AI!" I hate to break it to you, but Chinese companies have far more powerful internal models too. And they finished training them months ago.
English
18
7
255
15.4K
Heavy Weather
Heavy Weather@hevywetha·
@tea_and_sleep @MOOOOrion @courtlandleer please stop, I mean the same thing in both cases. When the feedback is disproportionally about the employer and not the content, the signal is noisy. For every unit of feedback you receive a bigger proportion will not help you improve the argument, if it just attacks the employer
English
0
0
0
20
pharos
pharos@tea_and_sleep·
@hevywetha @MOOOOrion @courtlandleer You said: "It's probably true that the feedback isn't very useful if it all boils down to a reduction to his employer." And now you have changed it to feedback is "noisier". You are doing the exact same thing as Ball. Making shit up
English
1
0
2
34
Courtland Leer
Courtland Leer@courtlandleer·
ive noticed this pattern a lot more recently when someone feels they’re losing an argument they stop engaging with the ideas and instead start playing victim this kind of appeal to pity acts as a red herring against the topic at hand
Dean W. Ball@deanwball

I’m afraid to tell you that it is effectively impossible to do the kind of writing I used to do on this website, not because anyone at OpenAI censors me but because of the sheer volume of hostility I get for sharing my analysis as a frontier lab employee. I enjoyed writing quick takes on this website for one basic reason: I could get rapid feedback on my own ideation process in real time. Post the early version of the take here, see the criticism; then refine, sharpen, and repeat. Unfortunately now that feature of this site is gone, because the feedback I get is now almost exclusively colored by resentment at the fact that I work at a frontier lab or other forms of hatred for my employer. The feedback signal is essentially useless now, so writing on here is not fruitful for me anymore. Literally everything I write now is responded to with “of course you said that because .” I am truly just writing what I think and would have written anyway, but everyone reads what I say in the shrieking tone of “this is what openai thinks!!!!” (to be clear, my posts are not what openai thinks). This is an unpleasant and more importantly unproductive pattern for me. I anticipate that the shape of this account will change significantly as a result. I do not currently know how. It will not become a LinkedIn feed. It will change in some other way. It will no longer be a real-time accounting of my own thinking as it develops, since this is precisely the thing that seems impossible to do now. That will have to shift to private channels.

English
16
32
788
17.1K
preset127User
preset127User@MOOOOrion·
@hevywetha @courtlandleer First of all it’s obviously impossible to separate his job with his posts so I’m not sure that’s even worth whining about. And his response was clearly trying to walk back what he clearly said in the original post.
English
1
0
5
73
Heavy Weather
Heavy Weather@hevywetha·
@errantp @courtlandleer not a coincidence, for this guy probably mostly a selection effect. Don't think group think is the main driver, especially for this guy, since it seems he's only been at openai for 2 weeks
English
2
0
3
85
allo frandi
allo frandi@errantp·
@hevywetha @courtlandleer Do you believe it’s just a crazy coincidence that these guys’ views consistently align with the interests of themselves and their employers?
English
1
0
7
95
Heavy Weather
Heavy Weather@hevywetha·
@MOOOOrion @courtlandleer what does this have to do with what I said? The point he was making in the quote was that just because he's now working at openai feedback is noisier? Which seems true, he can't and shouldn't write the same way given the new position he's in.
English
2
0
1
99
Heavy Weather
Heavy Weather@hevywetha·
@celestepoasts accidents can still happen also people might not want to live that long? I think freezing capab. at AGI is probably not sufficient to get to 300 year lifespans, so you'll probably need ~ASI? And then it might not be that clear what "you" really is anymore. Stuff just gets weird.
English
0
0
0
107