Alexandr Notchenko

1.8K posts

Alexandr Notchenko banner
Alexandr Notchenko

Alexandr Notchenko

@Gang1man

Engineer ⋂ Scientist ⋂ Maker Prev: Co-founder and CTO at https://t.co/YweWtzzgM8 PhD grad from @Skoltech Founder of ODS London and @ods_ai

London Katılım Ağustos 2010
4.4K Takip Edilen784 Takipçiler
will depue
will depue@willdepue·
god has cursed everyone cool and attractive to live in new york and everything interesting and important to happen in san francisco
English
71
39
1.8K
100.1K
Alexandr Notchenko retweetledi
Ash Vardanian
Ash Vardanian@ashvardanian·
Scaling Elections with GPUs and Mojo 🔥 I love occasionally optimizing obscure algorithms no one cares about. One of those, also having O(n³) complexity, like matrix multiplication, is the Schulze method for ranked-choice voting. So last year, at one of the AGI hackathons I tried accelerating it across CPUs and GPUs, with CUDA C++, Numba, and Mojo 🔥 It was an epic event and I really wanted to share the results sooner, but without AMD GPUs they didn't feel complete! We are talking about plurality of choice, after all! Now, after gathering AMD MI355X results - the story is out. The Mojo variant didn't require a single line change, ran out of the box, and at scale delivered 4x the throughput of H100. Don't take the article too seriously. It's just a fun exploration of modern GPU tech beyond LLMs — tropical semirings, blocked Floyd-Warshall, and the participation paradox in voting! Blogpost: ashvardanian.com/posts/scaling-… Code: github.com/ashvardanian/S… Overall it was one of the best cozy gatherings that year - @clattner_llvm talked about Mojo's GPU support, @RajaXg explained the reasons for the success of the CUDA ecosystem in the last decade, @tri_dao gave the first public talk on FlashAttention-3... now superseded by his FlashAttention-4, and @dylan522p shared some insights on the data-center market! Thanks to @bztree, @verdagon, and Pradeep Ramani for collaborating with me on this one! Thanks to @JvNixon, @khoomeik, and @kylejohnmorris for bringing the AGI house together and hosting all of us and to @nebiusai for providing the compute! Can't wait to gather again!
English
1
13
95
36.9K
Alexandr Notchenko
Alexandr Notchenko@Gang1man·
Thank you for your work. It inspired a lot of researchers throughout the years including me. Even less popular papers like OpenDR - made a lot of impact down the line, inspired me to work on differentiable rendering in my PhD. Many more years of great papers and code!
Michael Black@Michael_J_Black

SMPL is 10 years old and has done what we hoped — it changed the way the field estimates and models 3D humans and their motion. I’m delighted that the original team has been recognized today at @ICCVConference with the Mark Everingham Prize. The prize is given to individuals or teams who have worked to further progress in the computer vision community as a whole. Mark Everingham understood that to have an impact, it is not enough to simply publish a paper. SMPL’s success is due to lots of hard work to provide the community with code, data, and support. My deepest thanks go out to all the members of the @PerceivingSys department who have supported SMPL and related technology over the years. It has been a team effort of many dedicated people and we share this award with you. Mark understood that big changes require community effort. Consequently my big thanks go to all the users of SMPL and related tools. You have pushed the field forward as a community in ways that no small team could. I’m constantly inspired by your work. Computer vision has changed a lot in 10 years but people keep finding new uses for SMPL, most recently in training humanoid robots. There are many more applications to come in games, interactive entertainment, sports, and biomechanics. Congratulations to my coauthors Matt Loper, @naureenmahmood, Javier Romero and @GerardPonsMoll1. smpl.is.tue.mpg.de

English
1
0
1
175
Alexandr Notchenko
Alexandr Notchenko@Gang1man·
@DrZeeshanZia Not even taking into account reduction in quality of service or direct harm caused by deploying half baked systems in civic service, healthcare and engineering. 100% a lot of harm happening right now.
English
0
0
0
74
Zeeshan Zia
Zeeshan Zia@ZeeshanZiaML·
Far too many people get hung up on the Sky Net / Terminator scenario, where there are plenty of harms taking place today: - kids have committed ChatGPT assisted suicide. - AI unlocks a new level of ransomware by enabling hackers to go through your data (e.g. identify cheating spouses etc) - gives ability to low-skilled people to build complex weapons and engage in terrorism I could go on and on. These are immediate harms that technologists can tackle.
Harj Taggar@harjtaggar

Those who can, do; those who can’t, get really into AI safety.

English
1
0
2
836
Alexandr Notchenko
Alexandr Notchenko@Gang1man·
Vibe engineering is a misnomer, it should be called stochastic coding.
English
0
0
0
101
Alexandr Notchenko
Alexandr Notchenko@Gang1man·
@iamgrigorev Make Screen recording too and put it on youtube, will be great way to log the process and be very educational to others.
English
0
0
1
436
George Grigorev
George Grigorev@iamgrigorev·
I am thinking of writing the next blogpost about these topics: Optimizing training throughout with FP8 I will show how to write FP8 kernels How to implement DDP How to implement FSDP, with distributed Muon How to implement TP Gradient accumulation Gradient checkpointing I think using “How to scale your model” on a real consumer gpus connected with pcie and writing that from scratch on pure PyTorch would be really useful
English
14
20
358
20.6K
Alexandr Notchenko
Alexandr Notchenko@Gang1man·
@AndrewMohawk I used their email forwarding mechanic for my domains, it worked fine. Is it going to be a Gmail clone or a MailChimp clone?
English
1
0
0
49
Alexandr Notchenko
Alexandr Notchenko@Gang1man·
@gwulfs Almost exactly what I did in my startup 3 years ago, data and artefact store in R2, and taking the cheapest servers anywhere in the world to train on, at the time it was lambda labs and paperspace.
English
0
0
0
61
Alexandr Notchenko
Alexandr Notchenko@Gang1man·
Mostly agree with takes in this blog (blog.jxmo.io/p/there-are-no…) about role of the datasets in advancement of ML models over the last decade and a half. But I would disagree on advancement claims, before robotics and formal verification a lot of "progress" was from learning labels.
English
0
0
1
87
Alexandr Notchenko
Alexandr Notchenko@Gang1man·
@y0b1byte Pseudo-code in the paper, python code listing into appendix, go back to classic approach. Also if you know there was a major war in 2010s for the appropriate research artefact storage. Figshare, ResearchGate, Academia.edu, but the true way is Uni hosting of course.
English
0
0
1
55
yobibyte
yobibyte@y0b1byte·
Can we all agree to put python code instead of pseudocode to describe algorithms in ml papers? RT if you agree!!!
GIF
English
3
3
40
2.5K
Alexandr Notchenko retweetledi
Isomorphic Labs
Isomorphic Labs@IsomorphicLabs·
We are thrilled to support the UK’s new #OpenBind consortium, a government-backed initiative to create the world’s largest open dataset for AI drug discovery.
English
3
11
116
9.1K