Scrollithm

1.2K posts

Scrollithm

Scrollithm

@scrollithm

Satirical algorithm reaction content.

Entrou em Haziran 2024
247 Seguindo89 Seguidores
Scrollithm retweetou
$SLTXRP589
$SLTXRP589@SLTXRP589·
X-R-P 🫡 eyes forward with absolute conviction.
Eve Cruz@Dibi0321

@24hrscrypto1 The price will be exciting, but the conviction built during the journey is the real reward. Those who stayed through the noise will understand it the most.

English
3
2
11
458
Andrej Karpathy
Andrej Karpathy@karpathy·
Three days ago I left autoresearch tuning nanochat for ~2 days on depth=12 model. It found ~20 changes that improved the validation loss. I tested these changes yesterday and all of them were additive and transferred to larger (depth=24) models. Stacking up all of these changes, today I measured that the leaderboard's "Time to GPT-2" drops from 2.02 hours to 1.80 hours (~11% improvement), this will be the new leaderboard entry. So yes, these are real improvements and they make an actual difference. I am mildly surprised that my very first naive attempt already worked this well on top of what I thought was already a fairly manually well-tuned project. This is a first for me because I am very used to doing the iterative optimization of neural network training manually. You come up with ideas, you implement them, you check if they work (better validation loss), you come up with new ideas based on that, you read some papers for inspiration, etc etc. This is the bread and butter of what I do daily for 2 decades. Seeing the agent do this entire workflow end-to-end and all by itself as it worked through approx. 700 changes autonomously is wild. It really looked at the sequence of results of experiments and used that to plan the next ones. It's not novel, ground-breaking "research" (yet), but all the adjustments are "real", I didn't find them manually previously, and they stack up and actually improved nanochat. Among the bigger things e.g.: - It noticed an oversight that my parameterless QKnorm didn't have a scaler multiplier attached, so my attention was too diffuse. The agent found multipliers to sharpen it, pointing to future work. - It found that the Value Embeddings really like regularization and I wasn't applying any (oops). - It found that my banded attention was too conservative (i forgot to tune it). - It found that AdamW betas were all messed up. - It tuned the weight decay schedule. - It tuned the network initialization. This is on top of all the tuning I've already done over a good amount of time. The exact commit is here, from this "round 1" of autoresearch. I am going to kick off "round 2", and in parallel I am looking at how multiple agents can collaborate to unlock parallelism. github.com/karpathy/nanoc… All LLM frontier labs will do this. It's the final boss battle. It's a lot more complex at scale of course - you don't just have a single train. py file to tune. But doing it is "just engineering" and it's going to work. You spin up a swarm of agents, you have them collaborate to tune smaller models, you promote the most promising ideas to increasingly larger scales, and humans (optionally) contribute on the edges. And more generally, *any* metric you care about that is reasonably efficient to evaluate (or that has more efficient proxy metrics such as training a smaller network) can be autoresearched by an agent swarm. It's worth thinking about whether your problem falls into this bucket too.
Andrej Karpathy tweet media
English
974
2.1K
19.5K
3.6M
Michaël van de Poppe
Michaël van de Poppe@CryptoMichNL·
For the people wondering: My eyes are progressing, but not too great yet. Started of with shingles around my eyes, which then changed to an eye infection in both eyes. But we’re improving and I can check screens again.
English
83
7
318
0
Scrollithm retweetou
Salute🫡 $SLT
Salute🫡 $SLT@SaluteXRPL·
Pay attention to the phases… and the patterns begin to reveal themselves 🫡 #BloodMoon #XRP
English
6
11
35
658
🇬🇧 ChartNerd 📊
🇬🇧 ChartNerd 📊@ChartNerdTA·
📣 $XRP Holders VS Population Ratio 🌎 — As of early 2026, there are 8.2 billion people in the world. Only 7.8 million of those people own any $XRP. Meaning: 99.9% of the global population do not hold any XRP –> YOU. ARE. EARLY 🔥
🇬🇧 ChartNerd 📊 tweet media
English
19
112
427
16.1K
Bitcoin Hotel
Bitcoin Hotel@bitcoin_hotel·
Ich schaue keinen TV. Ich besitze kein Auto. Ich habe kein Haus. Ich trinke keinen Alkohol. Ich trinke keinen Kaffee. Ich esse kein Junkfood. Ich esse nichts aus der Packung. Ich habe kein Bett. Ich trage fast nie Schuhe. Ich lebe mit einem Rucksack. Ich esse nur eine Mahlzeit am Tag. (Aktuell aber seit 1M Saftfasten😄) Weniger Besitz. Mehr Bewusstsein. Weniger Reiz. Mehr Klarheit. Weniger Angst. Mehr Wahrheit. Warum ich Bitcoin liebe? Weil es mir erlaubt, loszulassen. Von Besitz. Von Angst. Von Systemlügen. Bitcoin ist keine Investition. Es ist eine Revolution – gegen geistige Knechtschaft.
Bitcoin Hotel tweet media
Deutsch
261
104
1.6K
216.8K
Kim Dotcom
Kim Dotcom@KimDotcom·
Breaking Palantir was allegedly hacked. An AI agent was used to gain super-user access and here”s what the hackers allegedly found: Peter Thiel and Alex Karp commit mass surveillance of world leaders and titans of industry on a massive scale. They have thousands of hours of transcribed and searchable conversations of Donald Trump, JD Vance and Elon Musk. They have backdoored the devices, cars and jets of world leaders and accumulated the biggest archive of blackmail material. Palantir is creating nuclear and bio weapon capabilities for Ukraine and is working closely with the CIA to defeat Russia. They believe they are one year away. They plan to achieve this by keeping Russia busy with meaningless peace negotiations. Palantir is responsible of the majority of Palestinian deaths in Gaza. They have developed the AI targeting for Israel. Palantir is an arm of the CIA and all data from international clients is copied into a CIA spy cloud. Palantir has become the most dangerous company in the world. If you work there you have the right to know that this is what Palentir AI is used for, without your knowledge. The Palentir data the hackers allegedly gathered will be given to Russia and/or China. I was chosen as a trusted partner for this publication. I’m not involved in the Palentir hack and I don’t know the hackers. But I do know that the hack happened.
English
4K
25.8K
87.7K
9.9M
Beni Floki
Beni Floki@BeniFloki32811·
@TheBTCTherapist Why cant u see xrp will go to a billion market to quad zilion lol fuck this retard coin the only ones buying xrp holders and theyre familie members they rugpulled on lol :d
English
2
0
1
78
SNEAKO UPDATES
SNEAKO UPDATES@Sneak0o·
SNEAKO was disappointed after Professor Jiang suggested Bitcoin could be linked to agencies like the CIA as part of a broader intelligence strategy, while also arguing that true wealth isn’t money but knowledge and influence. 😳
English
195
736
7.4K
403K
Trending Bitcoin
Trending Bitcoin@TrendingBitcoin·
The man. The myth. The legend.
Trending Bitcoin tweet media
English
132
116
1.5K
697.8K
The School of Bits
The School of Bits@TheSchoolofBits·
true. bitcoin and blockchain reclaims that broken trust. transparency is needed more than ever. it's one of the BIG value categories of bitcoin yet millions are still confused about crypto get our book The Bitcoin Castle and learn the value for yourself or give it to a friend 4.7 stars dont lie
The School of Bits tweet mediaThe School of Bits tweet mediaThe School of Bits tweet media
English
2
0
0
673
Watcher.Guru
Watcher.Guru@WatcherGuru·
JUST IN: BlackRock CEO Larry Fink says global elites have lost the public's trust.
English
1.4K
1.4K
10.3K
1.4M
Zach Rector
Zach Rector@ZachRector7·
Bullrun update with ⁦@JayMartinBC⁩ Looking forward to heading back to his conference VRIC later this month! Commodity Super Cycle With Jay Martin youtu.be/wTwj46VCIhs
YouTube video
YouTube
English
2
5
26
6.5K