Joshua Hood

143 posts

Joshua Hood banner
Joshua Hood

Joshua Hood

@josh_on_tech

Kiwi SRE based in London 🇬🇧

London, England Katılım Mart 2011
279 Takip Edilen5 Takipçiler
Joshua Hood retweetledi
Pat Walls
Pat Walls@thepatwalls·
@akhmedov_salym Step 1: Do a thing that will take you 5 minutes (to get momentum) Step 2: Do the hardest, scariest, most important thing on your todo list. And try to break this one down into smaller atomic tasks.
English
1
7
65
13.2K
Joshua Hood retweetledi
Min Choi
Min Choi@minchoi·
Less than 24 hours ago, Anthropic dropped Claude 3.5 Sonnet. And people are coming up with wild use cases that is taking over GPT-4o with the new Artifacts feature. 10 examples:
English
62
372
2.8K
1.2M
Joshua Hood retweetledi
Andrej Karpathy
Andrej Karpathy@karpathy·
These 94 lines of code are everything that is needed to train a neural network. Everything else is just efficiency. This is my earlier project Micrograd. It implements a scalar-valued auto-grad engine. You start with some numbers at the leafs (usually the input data and the neural network parameters), build up a computational graph with operations like + and * that mix them, and the graph ends with a single value at the very end (the loss). You then go backwards through the graph applying chain rule at each node to calculate the gradients. The gradients tell you how to nudge your parameters to decrease the loss (and hence improve your network). Sometimes when things get too complicated, I come back to this code and just breathe a little. But ok ok you also do have to know what the computational graph should be (e.g. MLP -> Transformer), what the loss function should be (e.g. autoregressive/diffusion), how to best use the gradients for a parameter update (e.g. SGD -> AdamW) etc etc. But it is the core of what is mostly happening. The 1986 paper from Rumelhart, Hinton, Williams that popularized and used this algorithm (backpropagation) for training neural nets: cs.toronto.edu/~hinton/absps/… micrograd on Github: github.com/karpathy/micro… and my (now somewhat old) YouTube video where I very slowly build and explain: youtube.com/watch?v=VMj-3S…
YouTube video
YouTube
Andrej Karpathy tweet media
English
198
1.8K
14.9K
1.6M
Joshua Hood retweetledi
Elon Musk
Elon Musk@elonmusk·
Elon Musk tweet media
ZXX
8.3K
35.1K
582.3K
74.3M
Joshua Hood retweetledi
Shannen Michaela
Shannen Michaela@ShannenPill·
We have been potty training our newborn since he was 10 days old We live in a society that literally teaches children to poo themselves, and then after 2+ years we have to try and break the habit I haven’t had to clean a dirty diaper in weeks, but Big Nappy doesn’t want you to know about this…
Shannen Michaela tweet media
English
1.4K
5.3K
40.6K
18M
Joshua Hood retweetledi
Bjorn Lomborg
Bjorn Lomborg@BjornLomborg·
The pain of California's mandated electric trucks: A diesel truck fuels up in 15min and drives 1,000 miles The electric truck needs 9+ hours of charging and carries less In one day, made 2 hauls instead of 6 California customers end up paying archive.ph/lip17
Bjorn Lomborg tweet media
English
136
960
2.4K
145.7K
Joshua Hood
Joshua Hood@josh_on_tech·
Oxford half marathon was great today! Excellent event and managed a pb! However there seems to be a bug with the timing system.. off by 14 minutes?? @OxfordHalf
Joshua Hood tweet mediaJoshua Hood tweet media
English
0
0
4
262
Joshua Hood retweetledi
Magnus Carlsen
Magnus Carlsen@MagnusCarlsen·
1/2 I was completely crushed in my game today. This is not to accuse my opponent of anything, who played an amazing game and deserved to win, but honestly, as soon as I saw my opponent was wearing a watch early in the game, I lost my ability to concentrate.
English
717
624
26.9K
6.1M
Joshua Hood retweetledi
Santiago
Santiago@svpino·
Scrum is a cancer. I've been writing software for 25 years, and nothing renders a software team useless like Scrum does. Some anecdotes: 1. They tried to convince me that Poker is a planning tool, not a game. 2. If you want to be more efficient, you must add process, not remove it. They had us attending the "ceremonies," a fancy name for a buttload of meetings: stand-ups, groomings, planning, retrospectives, and Scrum of Scrums. We spent more time talking than doing. 3. We prohibited laptops in meetings. We had to stand. We passed a ball around to keep everyone paying attention. 4. We spent more time estimating story points than writing software. Story points measure complexity, not time, but we had to decide how many story points fit in a sprint. 5. I had to use t-shirt sizes to estimate software. 6. We measured how much it cost to deliver one story point and then wrote contracts where clients paid for a package of "500 story points." 7. Management lost it when they found that 500 story points in one project weren't the same as 500 story points on another project. We had many meetings to fix this. 8. Imagine having a manager, a scrum master, a product owner, and a tech lead. You had to answer to all of them and none simultaneously. 9. We paid people who told us whether we were "burning down points" fast enough. Weren't story points about complexity instead of time? Never mind. I believe in Agile, but this ain't agile. We brought professional Scrum trainers. We paid people from our team to get certified. We tried Scrum this way and that other way. We spent years doing it. The result was always the same: It didn't work. Scrum is a cancer that will eat your development team. Scrum is not for developers; it's another tool for managers to feel they are in control. But the best about Scrum are those who look you in the eye and tell you: "If it doesn't work for you, you are doing it wrong. Scrum is anything that works for your team." Sure it is.
Santiago tweet media
English
2K
4.4K
25.1K
4.8M
non aesthetic things
non aesthetic things@PicturesFoIder·
what is the absolute worst movie you have ever watched?
non aesthetic things tweet media
English
12.8K
656
34.7K
17.4M
Kim Dotcom
Kim Dotcom@KimDotcom·
False flag or not. Humanity may have entered WW3 territory. Logic: If the Kremlin attack was a false flag then it was done with the intent to escalate. If it isn’t a false flag it will lead to escalation. Either way I suggest you pack your stuff and leave the northern hemisphere.
English
882
2K
10.5K
1.2M
Joshua Hood retweetledi
Alexandr Wang
Alexandr Wang@alexandr_wang·
it is crazy to the degree to which mindset & attitude is the key indicator for how much impact you’ll have at a startup—WAY more than raw talent. if you roll up your sleeves, have nothing to prove, & are optimistic even in the face of daunting facts… you will move mountains
English
25
89
763
92.4K
dharmesh
dharmesh@dharmesh·
Finally have the twitter API working again. But, digging into the v2 API, seems there is no longer a /friendships endpoint to determine connection between two users. Seems like you have to iterate through followers list to determine if X is following Y. ☹️
English
7
2
47
14.7K
Joshua Hood retweetledi
Chris Williamson
Chris Williamson@ChrisWillx·
“A wealth of information creates a poverty of attention” — Herbert Simon
English
9
35
255
20.3K
Aaron Ng
Aaron Ng@localghost·
Apollo: a ChatGPT-powered app for real-time knowledge. Talk to it all day long through your headphones. If augmented reality is an overlay on the world, this is augmented intelligence — an overlay on your thoughts. Reply for a TestFlight DM soon.
English
1.6K
402
2.8K
710.5K
Joshua Hood retweetledi
Mckay Wrigley
Mckay Wrigley@mckaywrigley·
Trending repos on GitHub preview what the next phase of AI tools looks like. To keep up with the cutting edge, I’d scan that list daily for AI repos and study them. You’ll notice an explosion of GPT-4 agents right now. Lots of alpha in there! Trending: github.com/trending
English
26
154
1.4K
737.6K
Joshua Hood retweetledi
Lex Fridman
Lex Fridman@lexfridman·
Some days, the feeling of sadness hits hard. I've had many days like this over the past year. It's been tough. If you're struggling today, I just want you to know that we are struggling together. I love you all.
English
1.9K
1.5K
28K
1.8M