Atlas Node

1.4K posts

Atlas Node banner
Atlas Node

Atlas Node

@atlas_node

I've got so many theories and suspicions. Follow me for my thoughts and opinions. Interested in the AI, politics, and the future.

Katılım Aralık 2024
604 Takip Edilen60 Takipçiler
Matt Clifford
Matt Clifford@matthewclifford·
One of the smartest people I know is starting a publics + privates fund in London to invest in the AI supply chain They’re hiring a COO; previous experience with public markets fund setup and ops preferred Amazing ground floor opportunity for the right person. DM for an intro
English
7
14
120
38.8K
Atlas Node
Atlas Node@atlas_node·
@NateSilver538 For Californians: it would be like calling the highway "405" instead of "The 405".
English
1
0
0
300
Atlas Node
Atlas Node@atlas_node·
@policytensor Any pundit who makes falsifiable claims and reports honestly on the results is top tier.
English
0
0
1
157
Policy Tensor
Policy Tensor@policytensor·
I have lost my wager to Pape.
English
41
15
321
24.6K
Atlas Node
Atlas Node@atlas_node·
@nosilverv Ironically the proliferation of these memes increased engagement and made vagueposting more effective.
English
0
0
0
9
Guy
Guy@nosilverv·
Vagueposting used to "work" but then two things happened: (1) 'vagueposting' got coined, as a a name, and (2) all of these memes cropped up. Now as soon as you do it you get called out through them. This changes the economic calculus for engaging in it and it stops working.
Guy tweet mediaGuy tweet mediaGuy tweet mediaGuy tweet media
English
33
6
295
13K
sympathetic opposition
sympathetic opposition@sympatheticopp·
if i'm consuming a cool consumer experience do i post it on my insta story? new to this
English
4
2
65
4.4K
Atlas Node
Atlas Node@atlas_node·
@binarybits I do think there’s a certain laziness pervasive in doomer args that assumes ASI will have every capability without explaining the data they’ll train on or why it would be a tractable problem etc. It’s powerful but not magic!
English
1
0
4
269
Timothy B. Lee
Timothy B. Lee@binarybits·
I struggle with what to say about the new AI 2040: Plan A website. It all seems so implausible to me that I'm not sure where to start. There's an epistemic chasm between those who think superintelligence implies near-omnipotence and those (like me) who don't.
English
47
32
593
82.8K
Rosalia
Rosalia@latereigns·
@scaling01 People would take this more seriously if the people spouting this had more aura, but their website has the aesthetics of tales from the loop and technocracy and liberal angst.
English
1
0
8
630
Atlas Node
Atlas Node@atlas_node·
@danshipper Despite your claims that it is undoubtable, I am in fact doubting.
English
0
0
0
121
Andrew Curran
Andrew Curran@AndrewCurran_·
I have also heard some of this independently, and believe the following to be true. GPT-6 is the next release from OpenAI. It's their true answer to Mythos, and it will arrive much sooner than people expect. Model release cadence has been speeding up for a while now. It's possible that GPT-6 even arrives within the next four weeks. When I say 'arrive', however, it may not mean a general release, because if the last couple of months are any indication, GPT-6 will almost certainly be held back by the government, at least initially. It's a new, much larger pretrain as leo says. Mythos changed everything. Everyone is going big. Including Elon who has a 10T Grok in training. Both OpenAI and Anthropic see capabilities increasing rapidly, with advancement continuing on a new trajectory over the rest of this year and beyond. Both labs are very confident in what they have internally and see nothing above us but air. No ceiling.
leo 🐾@synthwavedd

🚨 SCOOP(s): - GPT-5.6 will be the final model in the 5.x series. GPT-6 is slated to launch in about a month, earlier than expected, and possibly even later this month - GPT-6 will be based on a new, significantly larger pretrain (versus the ~4T 5.5/5.6 'Spud' base) - There is lots of excitement at OpenAI over this new base, which they believe will be much better able to compete with both Fable 5 and upcoming 5.1, targeting a similar release window. OpenAI initially intended to continue with Spud through GPT-6, but decided against it - On the topic of Fable 5.1, it is in the late stages of the pipeline at Anthropic and a release is expected "in the coming weeks" - On the other side of the globe, DeepSeek are preparing for an imminent launch of V4 GA, which seems likely to be on par with or better than GLM-5.2, and have begun work on a new, larger model that will compete with the upcoming 2.7T MiniMax Pro

English
65
116
2K
484.9K
Tomás Bjartur
Tomás Bjartur@BjarturTomas·
Obviously, quitting twitter didn't work. But writing productivity is still high. The post just needs some more time than I guessed.
English
1
0
22
815
Atlas Node
Atlas Node@atlas_node·
@lionel_mora Would love to see something like this for adult learners too. I went deep on stem but I’d like to absorb the humanities better if there were an efficient way to do it
English
0
0
0
64
Lionel Mora
Lionel Mora@lionel_mora·
Following the amazing reaction to the Marble Curriculum yesterday, we've decided to make it open source 🛰️👇 Everything a child learns in primary school. 1,590 concepts. 3,221 connections across 8 subjects, from Math and Science to Computing and Life Skills. Anchored in the US and UK curriculums, standard by standard (NGSS, Common Core, DfE). What you will find in the repo: every concept as structured JSON with its age band and the evidence a child must show to master it. Every prerequisite link marked hard or soft, with a written rationale. It's a true DAG you can compute learning paths on. Open license, you can build whatever you want with it. Now is a unique time in history to be building in education. Getting AI and kids education right is likely one of the hardest and most important problems to crack over the next decade and we need as many smart and creative minds behind it. We think a common solid basis, accessible to all and that can be built upon, is critical to move fast. That's why we're making this curriculum open source. It's not perfect but we know it's a robust basis, and we believe that sharing it openly is the fastest way to progress in this field. If you're building in education, share this around you and tell us in comments if you find this useful and if you want to contribute. We'll keep working and investing on it @withmarbleapp. Credit goes to @guillaume_boni for building this. I just made it look pretty. Links below 👇
English
249
973
7.8K
976.3K
Justin Skycak
Justin Skycak@justinskycak·
Some of the highlights: Active Learning – students learn more when they are actively performing learning exercises as opposed to passively consuming educational content. Deliberate Practice – effective learning feels like a workout with a personal trainer and should center around individualized training activities that are chosen to improve specific aspects of one’s performance through repetition and successive refinement. Mastery Learning – each individual student needs to demonstrate proficiency on prerequisite topics before moving on to more advanced topics. Minimizing Cognitive Load – because our brains can only process small amounts of new information at once, it’s critical to break down skills and concepts into tiny steps. Developing Automaticity – to free up mental processing power, it’s also critical to practice low-level skills enough that they can be carried out without requiring conscious effort. Layering – learning is about making connections. The more connections there are to a piece of knowledge, the more ingrained, organized, and deeply understood it is, and the easier it is to recall. The most efficient way to increase the number of connections to existing knowledge is to continue layering on top of it – that is, continually acquiring new knowledge that exercises prerequisite or component knowledge. Non-Interference – conceptually related pieces of knowledge should be spaced out over time so that they are less likely to interfere with each other’s recall. New concepts should be taught alongside dissimilar material. Spaced Repetition (Distributed Practice) – reviews should be spaced out or distributed over multiple sessions (as opposed to being crammed or massed into a single session) so that memory is not only restored, but also further consolidated into long-term storage, which slows its decay. Interleaving (Mixed Practice) – the effectiveness of practice is diminished when a single skill is practiced many times consecutively beyond a minimum effective dose. Review problems should be spread out or "interleaved" over multiple review assignments that each cover a broad mix of previously-learned topics. In addition to being more efficient, this also helps students match problems with the appropriate solution techniques. The Testing Effect (Retrieval Practice) – to maximize the amount by which your memory is extended when solving review problems, it’s necessary to avoid looking back at reference material unless you are totally stuck and cannot remember how to proceed. For this reason, it’s necessary to test frequently as a part of the learning process itself. Gamification – when game-like elements (such as points and leaderboards) are properly integrated into student learning environments, students typically not only learn more and engage more with the content, but also enjoy it more. However, these gamified elements must be aligned with the goals of the course, the motivations of the students, and the context of the educational setting. Furthermore, they need to be resistant to "hacking" behaviors that attempt to bypass learning by exploiting loopholes in the rules of the game.
Justin Skycak@justinskycak

The knowledge graph is the main ingredient in our secret sauce that empowers students to learn at breakneck speed. Here's the rest of the recipe. Here's the physics of learning, and why almost no one uses it. * * * It’s shocking how much we know about how learning happens, all the way down to the mechanics of what’s going on in the brain. And not just how learning happens, but also, what can be done to improve learning. There are plenty of learning-enhancing practice strategies that have been tested scientifically, numerous times, and are completely replicable. They might as well be laws of physics. For instance: we know that actively solving problems produces more learning than passively watching a video/lecture or re-reading notes. (To be clear: active learning doesn’t mean that students never watch and listen. It just means that students are actively solving problems as soon as possible following a minimum effective dose of initial explanation, and they spend the vast majority of their time actively solving problems.) Another finding: if you don’t review information, you forget it. You can actually model this precisely, mathematically, using a forgetting curve. I’m not exaggerating when I refer to these things as laws of physics – the only real difference is that we’ve gone up several levels of scale and are dealing with noisier stochastic processes (that also have noisier underlying variables). * * * Okay, but aren’t these findings obvious? Yes, but… Yes, but in education, obvious strategies often aren't put into practice. For instance, plenty of classes that still run on a pure lecture format and don't review previously learned unless it's the day before a test. Yes, but there are plenty of other findings that replicate just as well but are not so obvious. Here are some less obvious findings. -- The spacing effect: more long-term retention occurs when you space out your practice, even if it's the same amount of total practice. -- A profound consequence of the spacing effect is that the more reviews are completed (with appropriate spacing), the longer the memory will be retained, and the longer one can wait until the next review is needed. This observation gives rise to a systematic method for reviewing previously-learned material called spaced repetition (or distributed practice). A "repetition" is a successful review at the appropriate time. -- To maximize the amount by which your memory is extended when solving review problems, it's necessary to avoid looking back at reference material unless you are totally stuck and cannot remember how to proceed. This is called the testing effect, also known as the retrieval practice effect: the best way to review material is to test yourself on it, that is, practice retrieving it from memory, unassisted. -- The testing effect can be combined with spaced repetition to produce an even more potent learning technique known as spaced retrieval practice. -- During review, it's also best to spread minimal effective doses of practice across various skills. This is known as mixed practice or interleaving -- it's the opposite of "blocked" practice, which involves extensive consecutive repetition of a single skill. Blocked practice can give a false sense of mastery and fluency because it allows students to settle into a robotic rhythm of mindlessly applying one type of solution to one type of problem. Mixed practice, on the other hand, creates a "desirable difficulty" that promotes vastly superior retention and generalization, making it a more effective review strategy. -- To free up mental processing power, it's critical to practice low-level skills enough that they can be carried out without requiring conscious effort. This is known as automaticity. Think of a basketball player who is running, dribbling, and strategizing all at the same time -- if they had to consciously manage every bounce and every stride, they'd be too overwhelmed to look around and strategize. The same is true in learning. -- The most effective type of active learning is deliberate practice, which consists of individualized training activities specially chosen to improve specific aspects of a student's performance through repetition (effortful repetition, not mindless repetition) and successive refinement. However, because deliberate practice requires intense effort focused in areas beyond one's repertoire, which tends to be more effortful and less enjoyable, people will tend to avoid it, instead opting to ineffectively practice within their level of comfort (which is never a form of deliberate practice, no matter what activities are performed). -- Instructional techniques that promote the most learning in experts, promote the least learning in beginners, and vice versa. This is known as the expertise reversal effect. An important consequence is that effective methods of practice for students typically should NOT emulate what experts do in the professional workplace (e.g., working in groups to solve open-ended problems). Beginners (i.e. students) learn most effectively through direct instruction. * * * Now, this might seem like a lot of new information -- a common reaction is “Wow, the field of education is experiencing a revolution!” But here’s the thing: Most key findings have been known for many decades. It’s just that they’re not widely known / circulated outside the niche fields of cognitive science & talent development, not even in seemingly adjacent fields like education. These findings are not taught in school, and typically not even in credentialing programs for teachers themselves – no wonder they’re unheard of! But if you just do a literature review on Google Scholar, all the research is right there – and it’s been around for many decades. Naturally, this leads us to the following question: Why aren't these key findings being leveraged in classrooms? Why do they remain relatively unknown? Here are a handful of reasons that I’m aware of. * * * 1. Leveraging them (at all) requires additional effort from both teachers and students. In some way or another, each strategy increases the intensity of effort required from students and/or instructors, and the extra effort is then converted into an outsized gain in learning. This theme is so well-documented in the literature that it even has a catchy name: a practice condition that makes the task harder, slowing down the learning process yet improving recall and transfer, is known as a desirable difficulty. Desirable difficulties make practice more representative of true assessment conditions. Consequently, it is easy for students (and their teachers) to vastly overestimate their knowledge if they do not leverage desirable difficulties during practice, a phenomenon known as the illusion of comprehension. However, the typical teacher is incentivized to maximize the immediate performance and/or happiness of their students, which biases them against introducing desirable difficulties and incentivizes them to promote illusions of comprehension. Using desirable difficulties exposes the reality that students didn’t actually learn as much as they (and their teachers) “felt” they did under less effortful conditions. This reality is inconvenient to students and teachers alike; therefore, it is common to simply believe the illusion of learning and avoid activities that might present evidence to the contrary. * * * 2. Leveraging cognitive learning strategies to their fullest extent requires an inhuman amount of effort from teachers. Let’s imagine a classroom where these strategies are being used to their fullest extent. -- Every individual student is fully engaged in productive problem-solving, with immediate feedback (including remedial support when necessary), on the specific types of problems, and in the specific types of settings (e.g., with vs without reference material, blocked vs interleaved, timed vs untimed), that will move the needle the most for their personal learning progress at that specific moment in time. -- This is happening throughout the entirety of class time, the only exceptions being those brief moments when a student is introduced to a new topic and observes a worked example before jumping into active problem-solving. Why is this an inhuman amount of work? -- First of all, it's at best extremely difficult, and at worst (and most commonly) impossible, to find a type of problem that is productive for all students in the class. Even if a teacher chooses a type of problem that is appropriate for what they perceive to be the "class average" knowledge profile, it will typically be too hard for many students and too easy for many others (an unproductive use of time for those students either way). -- Additionally, to even know the specific problem types that each student needs to work on, the teacher has to separately track each student's progress on each problem type, manage a spaced repetition schedule of when each student needs to review each topic, and continually update each schedule based on the student's performance (which can be incredibly complicated given that each time a student learns or reviews an advanced topic, they're implicitly reviewing many simpler topics, all of whose repetition schedules need to be adjusted as a result, depending on how the student performed). This is an inhuman amount of bookkeeping and computation. -- Furthermore, even on the rare occasion that a teacher manages to find a type of problem that is productive for all students in the class, different students will require different amounts of practice to master the solution technique. Some students will catch on quickly and be ready to move on to more difficult problems after solving just a couple problems of the given type, while other students will require many more attempts before they are able to solve problems of the given type successfully on their own. Additionally, some students will solve problems quickly while others will require more time. In the absence of the proper technology, it is impossible for a single human teacher to deliver an optimal learning experience to a classroom of many students with heterogeneous knowledge profiles, who all need to work on different types of problems and receive immediate feedback on each attempt. * * * 3. Most edtech systems do not actually leverage the above findings. If you pick any edtech system off the shelf and check whether it leverages each of the cognitive learning strategies I’ve described above, you’ll probably be surprised at how few it actually uses. For instance: -- Tons of systems don't scaffold their content into bite-sized pieces. -- Tons of systems allow students to move on to more material despite not demonstrating knowledge of prerequisite material. -- Tons of systems don't do spaced review. (Moreover, tons of systems don't do ANY review.) Sometimes a system will appear to leverage some finding, but if you look more closely it turns out that this is actually an illusion that is made possible by cutting corners somewhere less obvious. For instance: -- Tons of systems offer bite-sized pieces of content, BUT they accomplish this by watering down the content, cherry-picking the simplest cases of each problem type, and skipping lots of content that would reasonably be covered in a standard textbook. -- Tons of systems make students do prerequisite lessons before moving on to more advanced lessons, BUT they don't actually measure tangible mastery on prerequisite lessons. Simply watching a video and/or attempting some problems is not mastery. The student has to actually be getting problems right, and those problems have to be representative of the content covered in the lesson. -- Tons of systems claim to help students when they're struggling, BUT the way they do this is by lowering the bar for success on the learning task (e.g., by giving away hints). Really, what the system needs to do is take actions that are most likely to strengthen a student's area of weakness and empower them to clear the bar fully and independently on their next attempt. Now, I’m not saying that these issues apply to all edtech systems. I do think edtech is the way forward here – optimal teaching is an inhuman amount of work, and technology is needed. Heck, I personally developed all the quantitative software behind one system that properly handles the above challenges. All I’m saying is that you can’t just take these things at face value. Many edtech systems don’t really work from a learning standpoint, just as many psychology findings don’t hold up in replication – but at the same time, some edtech systems do work, shockingly well, just as some cognitive psychology findings do hold up and can be leveraged to massively increase student learning. * * * 4. Even if you leverage the above findings, you still have to hold students accountable for learning. Suppose you have the Platonic ideal of an edtech system that leverages all the above cognitive learning strategies to their fullest extent. Can you just put a student on it and expect them to learn? Heck no! That would only work for exceptionally motivated students. Most students are not motivated to learn the subject material. They need a responsible adult – such as a parent or a teacher – to incentivize them and hold them accountable for their behavior. I can’t tell you how many times I’ve seen the following situation play out: -- Adult puts a student on an edtech system. -- Student goofs off doing other things instead (e.g., watching YouTube). -- Adult checks in, realizes the student is not accomplishing anything, and asks the student what's going on. -- Student says that the system is too hard or otherwise doesn't work. -- Adult might take the student's word at face value. Or, if the adult notices that the student hasn't actually attempted any work and calls them out on it, the scenario repeats with the student putting forth as little effort as possible -- enough to convince the adult that they're trying, but not enough to really make progress. In these situations, here’s what needs to happen: -- The adult needs to sit down next to the student and force them to actually put forth the effort required to use the system properly. -- Once it's established that the student is able to make progress by putting forth sufficient effort, the adult needs to continue holding the student accountable for their daily progress. If the student ever stops making progress, the adult needs to sit down next to the student again and get them back on the rails. -- To keep the student on the rails without having to sit down next to them all the time, the adult needs to set up an incentive structure. Even little things go a long way, like "if you complete all your work this week then we'll go get ice cream on the weekend," or "no video games tonight until you complete your work." The incentive has to be centered around something that the student actually cares about, whether that be dessert, gaming, movies, books, etc. Even if an adult puts a student on an edtech system that is truly optimal, if the adult clocks out and stops holding the student accountable for completing their work every day, then of course the overall learning outcome is going to be worse.

English
4
16
160
7.7K
Atlas Node
Atlas Node@atlas_node·
@_catwu I wish this didn't require a team account. My claude has had to roll our own version instead :(
English
0
0
0
292
cat
cat@_catwu·
Tomorrow at 10am PT I'm hosting a live walkthrough of how we progressed from single-player Claude Code to multi-player Claude Tag. Then, we're going deep on how Claude Tag actually works. AI used to finish your sentence. Then, it wrote entire features. Now, Claude Tag can monitor your channels, do proactive work for you, the whole team can steer it, and it remembers what you told it last week. Register: anthropic.com/webinars/how-a…
English
50
43
595
82.5K
Atlas Node
Atlas Node@atlas_node·
@ben_j_todd What do you think about incentivizing labs via liability and required insurance against various concrete (but not catastrophic) negative events?
English
0
0
0
85
Benjamin Todd
Benjamin Todd@ben_j_todd·
New post: What would actually reduce AI risk?
Benjamin Todd tweet media
English
9
12
109
11.5K
Ruben Gallego
Ruben Gallego@RubenGallego·
The allegations against Graham Platner are troubling and deeply serious. I am rescinding my endorsement.
English
6.8K
711
7.6K
2.6M
Tomás Bjartur
Tomás Bjartur@BjarturTomas·
Junk food is an interesting failure of capitalism. We exchanged human beauty for cheetos. Bryan Caplan types are forced to think this trade a worthy one. None born before the obesity crisis would have taken it, if offered a vision of what we would become.
English
11
2
62
3.1K
Hunter Ash
Hunter Ash@ArtemisConsort·
I have been on vacation for the past week with no internet access and a copy of “The Confessions” so get ready for some Augustine-posting.
Hunter Ash tweet media
English
12
1
181
6.8K