Mark Handley

1.2K posts

Mark Handley

Mark Handley

@MarkJHandley

Professor of Networked Systems at UCL and Networks at OpenAI

Katılım Mayıs 2012
114 Takip Edilen11.1K Takipçiler
Mark Handley retweetledi
Uday Ruddarraju
Uday Ruddarraju@udayruddarraju·
There is a lot of news about compute being the bottleneck for AI. There is less visibility into the engineering it takes to make large-scale compute actually work reliably. In my view, this is one of the most interesting computer science problems in the industry right now. It is not just about getting more GPUs. It is about making every layer of the system work: networking, scheduling, hardware health, storage, orchestration, reliability, observability, security, and the developer experience for researchers. This blog gives a rare preview into the depth of engineering happening across the stack at OpenAI, starting with MRC and supercomputer networking. We're excited to start sharing more about designing, building, and operating compute at planet scale. openai.com/index/mrc-supe… Join us: openai.com/careers/softwa…
OpenAI@OpenAI

AI supercomputers need a new kind of network to stay in sync at massive scale. OpenAI’s @markjhandley and @poyntingatgreg join @AndrewMayne to discuss what it takes to move data across record numbers of chips reliably and efficiently, the new Multipath Reliable Connection (MRC) networking protocol, and why it's available for the whole industry to use.

English
13
26
469
879.1K
Mark Handley
Mark Handley@MarkJHandley·
@PaulWil37983175 @OpenAI @Oracle @Microsoft Reducing tail latency was a key MRC design goal. Source-routed packet spraying essentially eliminates congestion delays caused by imperfect ECMP load balancing, so the whole network behaves like a single pool of bandwidth.
English
0
0
1
38
Paul Wilson
Paul Wilson@PaulWil37983175·
@OpenAI @Oracle @Microsoft Huge — open-sourcing the protocol that's actually battle-tested at Abilene and Fairwater scale is a much bigger deal than people will realize today. Curious how MRC handles tail latency vs. RoCEv2 under heavy all-reduce traffic.
English
2
0
1
153
OpenAI
OpenAI@OpenAI·
MRC is already deployed across all of OpenAI’s largest supercomputers that we use to train frontier models, including our site with @Oracle Cloud Infrastructure (OCI) in Abilene, Texas, and in @Microsoft’s Fairwater supercomputers. MRC is now available through the @OpenComputePrj for the entire industry to use and build on.
English
43
79
928
140.5K
Mark Handley retweetledi
OpenAI
OpenAI@OpenAI·
AI supercomputers need a new kind of network to stay in sync at massive scale. OpenAI’s @markjhandley and @poyntingatgreg join @AndrewMayne to discuss what it takes to move data across record numbers of chips reliably and efficiently, the new Multipath Reliable Connection (MRC) networking protocol, and why it's available for the whole industry to use.
OpenAI@OpenAI

We’ve partnered with @AMD, @Broadcom, @Intel, @Microsoft, and @NVIDIA, to release Multipath Reliable Connection (MRC), a new open networking protocol that helps large AI training clusters run faster and more reliably, with less wasted GPU time. openai.com/index/mrc-supe…

English
142
151
1.7K
1.1M
Mark Handley
Mark Handley@MarkJHandley·
Excited to be able to share what I've been working on for the last few years!
Sachin Katti@sk7037

Today we shared MRC (openai.com/index/mrc-supe…), a networking protocol developed with @Microsoft, @nvidia, @AMD, @Broadcom, and @intel to improve how large AI training systems move data and recover from failures. This innovation has come full circle for me personally, it was initiated by @OpenAI with my team at @intel then when I was leading the networking business there and it's great to see it come to life at scale! As training clusters scale, networking becomes a critical part of overall compute efficiency. It is not enough to add more capacity. You also need systems that keep jobs running reliably, use bandwidth well, and reduce wasted GPU time. MRC is one example of the kind of infrastructure work required to make frontier model training more efficient and more resilient. It reflects a broader view we have at OpenAI: progress in AI depends not just on better models, but on better compute systems across the stack.

English
1
1
8
588
Mark Handley
Mark Handley@MarkJHandley·
@paulg You do need to review the PRs and iterate on them when you don’t like its approach. Codex wrote almost all the actual code, so obviously did a lot of the thinking, but the part that mattered most, I did that. Is there a similar principle for writing English?
English
0
0
1
203
Mark Handley
Mark Handley@MarkJHandley·
@paulg Coding is thinking too. I’ve just used Codex to write a non-trivial distributed system. It’s very good - does the mechanical coding that I always found therapeutic very quickly and accurately, leaving me with all the big design decisions back to back. Which is pretty hard work.
English
1
0
2
458
Paul Graham
Paul Graham@paulg·
If you care about money or power, stay close to AI, because for the foreseeable future this will be the big source of change in both.
English
222
1.1K
12.2K
740.6K
Mark Handley
Mark Handley@MarkJHandley·
@Dominos_UK Why do you accept delivery orders if you don't have enough drivers to deliver? 75 mins and still waiting. Kingston
English
1
0
0
249
Mark Handley
Mark Handley@MarkJHandley·
@paulg @CcibChris Always loved the Victor (though as far as I know I'm not related to the company's founder). It's what you'd get if you asked an aircraft designer who grew up on 1930s Flash Gordon rockets to design a jet bomber.
English
0
0
4
585
Paul Graham
Paul Graham@paulg·
The perfect combination of futuristic and retro. Is there such a thing as jetpunk yet? Because this is it. (image via @CcibChris)
Paul Graham tweet media
English
33
13
257
54.7K
Trent Telenko
Trent Telenko@TrentTelenko·
This is so damaging to the USA as a reputable arms supplier. Just kiss all future F-35 sales to Europe goodbye.
English
592
2.4K
16.5K
663.7K
Mark Handley
Mark Handley@MarkJHandley·
@paulg We've accumulated about 3000 books (the number stabilized about 10 years ago, when we started to donate books to keep things from getting out of control). It took me a long time to get over the feeling of guilt of buying books and not reading all of them.
English
0
0
0
412
Paul Graham
Paul Graham@paulg·
If you can afford it and have the space, there's nothing wrong with buying books that seem interesting but that you don't intend to read immediately.
Paul Graham tweet media
English
374
482
8.9K
504.4K
Mark Handley
Mark Handley@MarkJHandley·
@NASASpaceflight He says "Again, not a case burn through." But that doesn't rule out a nozzle burn through, which is less likely to be catastrophic.
English
0
0
1
570
NSF - NASASpaceflight.com
NSF - NASASpaceflight.com@NASASpaceflight·
Fair play to Tory Bruno, who's been answering questions from anyone on X about the GEM 63XL nozzle deciding it didn't want to play ball today. A big note is he notes no burn-through. Also, fair play to the BE-4's for compensating. x.com/torybruno/with…
D Wise@dwisecinema

Vulcan during the "observation" seen during ULA's Cert-2 mission this morning. Watch how the rocket moves to adjust after the flash. 📸 - @NASASpaceflight 📺 - youtube.com/watch?v=ZPztD5…

English
19
17
486
52.9K
Mark Handley
Mark Handley@MarkJHandley·
@americascup @ineosbritannia @LouisVuitton Great race! All came down to a few knots speed difference crossing the start line. I'm an @ineosbritannia fan, but I really feel for Luna Rossa. They sailed an excellent race but Ineos had the tactical advantage off the start, and didn't put a foot wrong.
English
0
1
1
585
Mark Handley
Mark Handley@MarkJHandley·
@paulg Surely the right way up is whichever way up you like best?
English
0
0
0
518
Paul Graham
Paul Graham@paulg·
I sent this print to be framed. The framer couldn't tell which way was up, so he made two guesses, neither of which was right. (I couldn't tell either. I had to look it up.)
Paul Graham tweet media
English
78
15
526
126.5K
Mark Handley retweetledi
James Ward
James Ward@JamesWard73·
this is the alcohol / politics / statistics crossover we’ve all been waiting for
James Ward tweet media
English
13
18
89
19.6K
Simon King
Simon King@SimonOKing·
If you’re doing some #aurora watching tonight, send your pictures! Either here or via Weather Watchers. 📷🌌 Will look at them all and feature as many as I can on @BBCBreakfast in the morning 🤩
English
721
161
946
200.4K
Mark Handley
Mark Handley@MarkJHandley·
@garrett_wollman Generally, north america gets auroras further south than Europe because the geomagnetic pole is on your side of the actual north pole. I certainly never expected to see an aurora in London with the light polution here, but there you go!
English
0
0
0
567
Mark Handley
Mark Handley@MarkJHandley·
One more - I like the banding on this one
Mark Handley tweet media
English
1
1
11
2K
Mark Handley
Mark Handley@MarkJHandley·
Not often you see an aurora over the Thames
Mark Handley tweet media
English
1
1
26
2.3K

Keşfet

@PaulWil37983175 @OpenAI @Oracle @Microsoft @OpenComputePrj @WCelhen @AMD @Broadcom