Scrollithm
1.2K posts

Scrollithm
@scrollithm
Satirical algorithm reaction content.
Beigetreten Haziran 2024
247 Folgt89 Follower
Scrollithm retweetet

Feeling 589 times bullish after calling the @Ripple office 😂
#XRP #XRPL @evernorthxrp @ashgoblue @bgarlinghouse @JoelKatz
English

No need to mess with A.I. when the sheep are still falling for the swimming pool studio 🏊♂️🎬
Concerned Citizen@BGatesIsaPyscho
🚨🚀 New Official NASA footage shows Artemis II Orion Craft separating from the last part of the Space Launch System. Do people seriously believe this?
English
Scrollithm retweetet

Three days ago I left autoresearch tuning nanochat for ~2 days on depth=12 model. It found ~20 changes that improved the validation loss. I tested these changes yesterday and all of them were additive and transferred to larger (depth=24) models. Stacking up all of these changes, today I measured that the leaderboard's "Time to GPT-2" drops from 2.02 hours to 1.80 hours (~11% improvement), this will be the new leaderboard entry. So yes, these are real improvements and they make an actual difference. I am mildly surprised that my very first naive attempt already worked this well on top of what I thought was already a fairly manually well-tuned project.
This is a first for me because I am very used to doing the iterative optimization of neural network training manually. You come up with ideas, you implement them, you check if they work (better validation loss), you come up with new ideas based on that, you read some papers for inspiration, etc etc. This is the bread and butter of what I do daily for 2 decades. Seeing the agent do this entire workflow end-to-end and all by itself as it worked through approx. 700 changes autonomously is wild. It really looked at the sequence of results of experiments and used that to plan the next ones. It's not novel, ground-breaking "research" (yet), but all the adjustments are "real", I didn't find them manually previously, and they stack up and actually improved nanochat. Among the bigger things e.g.:
- It noticed an oversight that my parameterless QKnorm didn't have a scaler multiplier attached, so my attention was too diffuse. The agent found multipliers to sharpen it, pointing to future work.
- It found that the Value Embeddings really like regularization and I wasn't applying any (oops).
- It found that my banded attention was too conservative (i forgot to tune it).
- It found that AdamW betas were all messed up.
- It tuned the weight decay schedule.
- It tuned the network initialization.
This is on top of all the tuning I've already done over a good amount of time. The exact commit is here, from this "round 1" of autoresearch. I am going to kick off "round 2", and in parallel I am looking at how multiple agents can collaborate to unlock parallelism.
github.com/karpathy/nanoc…
All LLM frontier labs will do this. It's the final boss battle. It's a lot more complex at scale of course - you don't just have a single train. py file to tune. But doing it is "just engineering" and it's going to work. You spin up a swarm of agents, you have them collaborate to tune smaller models, you promote the most promising ideas to increasingly larger scales, and humans (optionally) contribute on the edges.
And more generally, *any* metric you care about that is reasonably efficient to evaluate (or that has more efficient proxy metrics such as training a smaller network) can be autoresearched by an agent swarm. It's worth thinking about whether your problem falls into this bucket too.

English
Scrollithm retweetet
Scrollithm retweetet


Ich schaue keinen TV.
Ich besitze kein Auto.
Ich habe kein Haus.
Ich trinke keinen Alkohol.
Ich trinke keinen Kaffee.
Ich esse kein Junkfood.
Ich esse nichts aus der Packung.
Ich habe kein Bett.
Ich trage fast nie Schuhe.
Ich lebe mit einem Rucksack.
Ich esse nur eine Mahlzeit am Tag.
(Aktuell aber seit 1M Saftfasten😄)
Weniger Besitz. Mehr Bewusstsein.
Weniger Reiz. Mehr Klarheit.
Weniger Angst. Mehr Wahrheit.
Warum ich Bitcoin liebe?
Weil es mir erlaubt, loszulassen.
Von Besitz. Von Angst. Von Systemlügen.
Bitcoin ist keine Investition.
Es ist eine Revolution – gegen geistige Knechtschaft.

Deutsch

Breaking
Palantir was allegedly hacked. An AI agent was used to gain super-user access and here”s what the hackers allegedly found:
Peter Thiel and Alex Karp commit mass surveillance of world leaders and titans of industry on a massive scale.
They have thousands of hours of transcribed and searchable conversations of Donald Trump, JD Vance and Elon Musk.
They have backdoored the devices, cars and jets of world leaders and accumulated the biggest archive of blackmail material.
Palantir is creating nuclear and bio weapon capabilities for Ukraine and is working closely with the CIA to defeat Russia. They believe they are one year away. They plan to achieve this by keeping Russia busy with meaningless peace negotiations.
Palantir is responsible of the majority of Palestinian deaths in Gaza. They have developed the AI targeting for Israel.
Palantir is an arm of the CIA and all data from international clients is copied into a CIA spy cloud.
Palantir has become the most dangerous company in the world. If you work there you have the right to know that this is what Palentir AI is used for, without your knowledge.
The Palentir data the hackers allegedly gathered will be given to Russia and/or China. I was chosen as a trusted partner for this publication. I’m not involved in the Palentir hack and I don’t know the hackers. But I do know that the hack happened.
English

@TheBTCTherapist Why cant u see xrp will go to a billion market to quad zilion lol fuck this retard coin the only ones buying xrp holders and theyre familie members they rugpulled on lol :d
English
Scrollithm retweetet

@Dogeh8er @bgarlinghouse @JoelKatz @NFAdotcrypto @SaluteXRPL History in the making! Looking back at these in 2030 will be very emotional. Get on board ladies and gentlemen… trust the XRP community, we’re wired different.
Nothing can stop whats coming.
🫡
English
Scrollithm retweetet

2026 has its rockstar - @bgarlinghouse 🤘
And this goes far beyond crypto or #XRP
On drums: @JoelKatz • Piano: @NFAdotcrypto • Guitar: @SaluteXRPL
English

true. bitcoin and blockchain reclaims that broken trust.
transparency is needed more than ever.
it's one of the BIG value categories of bitcoin
yet millions are still confused about crypto
get our book The Bitcoin Castle
and learn the value for yourself or give it to a friend
4.7 stars dont lie



English

@ZachRector7 @JayMartinBC zach my bro, Jake mentioned his case against you here in his stream last night, timestamped: youtu.be/NbKZ7iwgXQo?t=…

YouTube
English

Bullrun update with @JayMartinBC
Looking forward to heading back to his conference VRIC later this month!
Commodity Super Cycle With Jay Martin
youtu.be/wTwj46VCIhs

YouTube
English













