Chaos
6.4K posts

Chaos
@FoldMani
🧠 + 🖥️ = 👁️ | Tweeting here when my ADHD meds have stopped working | Officially descended into madness
Ether Katılım Nisan 2022
368 Takip Edilen151 Takipçiler
Sabitlenmiş Tweet

@QuantumTumbler I guess the main distinction between your approach to reasoning through it and mine is that I'm taking the position where the system must emerge from something, which means that I'm thinking about subsets of the systems you seem to be considering.
English

@QuantumTumbler I agree with everything you're describing as a surviving system, but I claim that building it is either impossible or impractical. And I also make a less systems-focused, more here and now-focused, statement that our current systems are not surviving ones.
English

@AlisonbobEth @QuantumTumbler In that line, my claim is that we cannot construct surviving systems based on self-serving behaviors. And that while we might think our current systems are (because we are still alive), we are just in a transient state on the way to a non-surviving state.
English

@AlisonbobEth @QuantumTumbler Well, let's swap "stable" with "surviving", perhaps it represents more what I'm trying to convey without having to be very specific about the quantity that we're defining stability for.
English

@QuantumTumbler And my main claim is that what we're seeing is NOT a stable system, it's a system pre-collapse. My claim is that right now, we're on a trajectory that does not lead to survival.
English

@QuantumTumbler The main mechanism is the accumulation of self-serving behaviors: it's not symmetrical noise because it compounds. If you let it run for long enough power accumulates in self-serving acts and you reach a breaking point of equilibrium where survival vanishes.
English

@QuantumTumbler @AlisonbobEth Yes, in a world where individuals have perfect knowledge, well-behaving impulses, and organized actions this would all be true. In practice though, we have an open system where things like cognitive limitations create all kinds of noise, breaking stability.
English

Yeah, that’s the key piece.
Feedback loops don’t just shape the system they reshape the people inside it over time. So the model and the behavior co-evolve.
Which is exactly why structure matters so much. If the loop rewards extraction, you get more of it. If it rewards maintenance, you get stability.
So it’s not just iterative it’s directional. The incentives decide what the system converges toward.
English

@QuantumTumbler As soon as you have an option where immediate (or perceived) win can be obtained by injecting self-serving into system designs it will break everything. To have a system that works it must already be implemented, constructing it fails in practice.
English

@QuantumTumbler In theory you're right, and I don't disagree with that. In practice the environment does not allow this to exist because it's an open system and self-serving behaviors leak into system implementation. That's my main point.
English

@TrueAIHound @kunalt12345 Hey don't get distracted: I don't care about your opinions, I was merely pointing contradictions in your behavior. The actual topic is uninteresting to me.
English

No more and no less than Tao. The man solved a math problem that is used in MRI. So what? Do you know how many problems engineers around the world solve every day?
Does that make them experts in intelligence? Will Tao's math knowledge help solve the intelligence problem? The man doesn't even push back when that sci-fi fruitcake, Dwarkesh Patel, compared a human being, Kepler, to a "high-temperature LLM". He thought it was funny. This is inexcusable.
English


@TrueAIHound @kunalt12345 May I present you your question?
"What has his work contributed to the well-being of humanity?"
English

@vineettiruvadi It's called censoring non-paying users. @elonmusk decided that freedom of speech only applies to people who give him money
English

@KordingLab LLM praise feels too performative to me. It's too sensitive to the prompt for value judgements, so it just feels like the obama medal meme to me.
English

