Roman Ring

1.7K posts

Roman Ring banner
Roman Ring

Roman Ring

@Inoryy

[email protected] Research Engineer @DeepMind Large Scale Deep Learning Is All You Need? AlphaStar, Gopher, Flamingo, ???

Katılım Temmuz 2011
708 Takip Edilen3.4K Takipçiler
Sabitlenmiş Tweet
Roman Ring
Roman Ring@Inoryy·
After high school, I ended up working odd jobs, e.g., as a night shift cleaner at a fast-food restaurant. One especially nasty night, I decided that I had to at least try to get more out of my life and began self-studying coding every free minute I had, up to 20 hrs/day. 1/5
English
28
79
639
0
Roman Ring
Roman Ring@Inoryy·
I don't think Twitter will go down soon, mostly because I believe the (ex) eng and infra teams did a good job building resilient systems. But it's unlikely I'll be posting from now on. To anyone stumbling on my profile seeking advice on AI, feel free to reach out via email.
English
2
1
14
0
Roman Ring
Roman Ring@Inoryy·
Truly visionary business moves this week. I wonder if more people will finally realize the emperor has no clothes.
Elon Musk@elonmusk

@mrddmia Thank you. A thermonuclear name & shame is exactly what will happen if this continues.

English
1
0
8
0
Roman Ring
Roman Ring@Inoryy·
@_aidan_clark_ I think Mastodon existed before all of the web3 hype. Thinking of joining it as well!
English
0
0
0
0
Aidan Clark
Aidan Clark@_aidan_clark_·
I wanna join mastodon but does that mean giving in to web3 a bit? That's fucked
English
3
0
1
0
Roman Ring
Roman Ring@Inoryy·
@0xWren I suppose the typical argument is that the runaround to make the ops vectorized isn't natural and the compiler should be able to do this by itself from a simple loop. It forces users to come up with clever tricks to make numpy work instead of just solving their problem.
English
0
0
0
0
𒀭ωren
𒀭ωren@0xWren·
@Inoryy What are the complaints about numpy’s api? I have always thought its peculiarities were outweighed by its expressivity but I’m not a professional ml person
English
1
0
0
0
Roman Ring
Roman Ring@Inoryy·
A bit late to the party but this subject comes up fairly often and I have some thoughts as I spend most of my time at the boundary of Python (JAX) and C++ (XLA), and in the past have been a (very minor) contributor to DeepMind's effort to speed up Python: github.com/deepmind/s6.
Talia Ringer 🕊🪬@TaliaRinger

It's really weird how much machine learning is done in Python, because numerical/array computing should in theory be like 50x easier in a compiled language where you can build abstractions and leave the optimization to the compiler, no?

English
2
1
10
0
Roman Ring
Roman Ring@Inoryy·
The unsatisfying reality is that the day-to-day issues researchers run into are usually either at the ML framework level or at the ML compiler level, and neither would be fully addressed by a language with a cleaner API for array computing.
English
0
0
0
0
Roman Ring
Roman Ring@Inoryy·
However, those switches have led to access to new major features or a significant boost in productivity and I just don't see opportunities to gain either in alternatives today. Python isn't great but all it has to be is *good enough* at serving as a DSL for ML compilers.
English
1
0
0
0
Nathan Benaich
Nathan Benaich@nathanbenaich·
Wanna best the performance of even the biggest baddest hedge funds et al. these days? Earn in USD, live in UK/EU.
English
2
0
20
0
Roman Ring
Roman Ring@Inoryy·
I feel like that blinking white guy meme coming back from a period of minimal social media to a Twitter full of stable diffusion / midjourney generated artwork. Genuinely in awe of the pace of progress.
English
0
0
4
0
Roman Ring
Roman Ring@Inoryy·
@dotstepan Not necessarily. AGI doesn't imply superhuman performance at all tasks, especially those involving embodiment and real-time interaction in complex environments.
English
1
0
0
0
Roman Ring
Roman Ring@Inoryy·
Hot? take: we might reach (some form of) AGI before we reach SAE J3016 L5 driving automation.
English
2
0
7
0
Roman Ring
Roman Ring@Inoryy·
@drjwrae It was a pleasure and a privilege working with you Jack, hope our paths cross again someday :)
English
1
0
3
0
Jack Rae
Jack Rae@jack_w_rae·
Life update: I've joined OpenAI 🎊 Had an amazing 7 ½ years at DeepMind, grateful to work with so many smart and kind people 🙏 Looking forward to new collaborations and friendships 👋🇬🇧👋 🌁 🌅
English
22
11
1K
0
Nathan Benaich
Nathan Benaich@nathanbenaich·
Packed house @londonai! Great to be back in person after >2 years 👋
Nathan Benaich tweet media
English
3
3
54
0
Roman Ring
Roman Ring@Inoryy·
@mark_riedl Nobody starts off at the deep end, people come to 4chan for the edgy jokes and are indoctrinated over time by bouncing increasingly toxic content off each other. Literally by definition of echo chamber it's clear that deploying AI into such ecosystem has a net negative effect.
English
0
0
3
0
Roman Ring
Roman Ring@Inoryy·
@_joaogui1 Genuinely baffled how anyone can argue there's no harm in doing this.
English
2
0
10
0
Roman Ring
Roman Ring@Inoryy·
@ykilcher It self-evidently contributed to 4chan's echo chamber, amplifying and solidifying their opinions. It's not impossible that gpt-4chan pushed somebody over the edge in their worldview. Whether a specially tuned LM can do it more efficiently than a regexp is a weird defense to make.
English
2
0
17
0
Yannic Kilcher 🇸🇨
Yannic Kilcher 🇸🇨@ykilcher·
I asked this person twice already for an actual, concrete instance of "harm" caused by gpt-4chan, or even a likely one that couldn't be done by e.g. gpt-2 or gpt-j (or a regex for that matter), but I'm being elegantly ignored 🙃
Lauren Oakden-Rayner 🏳️‍⚧️@DrLaurenOR

This week an #AI model was released on @huggingface that produces harmful + discriminatory text and has already posted over 30k vile comments online (says it's author). This experiment would never pass a human research #ethics board. Here are my recommendations. 1/7

English
33
19
360
0
Roman Ring
Roman Ring@Inoryy·
@zoombapup I think it depends a lot on the lab and the team. Some consolidate all of their efforts in a specific narrow direction (not necessarily a bad thing!), while others have more leeway to explore various options. This applies to both research and engineering sides of things.
English
1
0
0
0
Phil Carlisle
Phil Carlisle@zoombapup·
@Inoryy Out of interest, how much autonomy does a SWR/RE have to pursue their interests in those labs? I'd ruled those things out because I couldn't do things that interested me (creative tech stuff).
English
1
0
0
0
Roman Ring
Roman Ring@Inoryy·
People underestimate how much AI research is bottlenecked by engineering.
English
95
223
3K
0
Roman Ring
Roman Ring@Inoryy·
@_arohan_ Interesting! Can you test it at larger scale, e.g. 10B?
English
1
0
3
0

Keşfet

@_aidan_clark_ @0xWren @nathanbenaich @dotstepan @londonai @mark_riedl @elonmusk @BarackObama