Robert Monarch

3.7K posts

Robert Monarch banner
Robert Monarch

Robert Monarch

@WWRob

Private/Global Machine Learning at @Apple Runs @BayAreaNLP Wrote https://t.co/4rHlBPzGt2… Prev @StanfordNLP @AWSCloud Opinions my own 🚲🌍 they/he

San Francisco شامل ہوئے Şubat 2010
2.7K فالونگ4.5K فالوورز
Robert Monarch ری ٹویٹ کیا
DeepLearning.AI
DeepLearning.AI@DeepLearningAI·
Launching today: AI for Good! 🌎 Designed in collaboration with Microsoft’s AI for Good Lab and instructed by @WWRob, it will empower you to tackle real-world challenges using AI, and how to determine if AI is the right tool for the job. Enroll now: hubs.la/Q01WgbtZ0
English
3
26
84
36.9K
Robert Monarch
Robert Monarch@WWRob·
@dromanocpm @AndrewYNg Thanks, I’ve worked with/at the UN for ~20 years in disaster response, so it informs the course. We intro the Sustainable Development Goals in the course but qualify that they are more useful as a shared language than as a definitive set or division of objectives for impact
English
0
0
2
260
Dominick Romano
Dominick Romano@dromanocpm·
@AndrewYNg @WWRob This is what AI for Good at the UN / ITU stands for also. I like the ITU for setting that framework with the WHO.
English
1
0
2
623
Robert Monarch ری ٹویٹ کیا
Andrew Ng
Andrew Ng@AndrewYNg·
Our new specialization, AI for Good, teaches a framework for using AI when stakes are high and human lives may hang in the balance. @WWRob presents a practical framework for ML in socially important projects (and products of any kind), and illustrates it with real projects in improving climate change, disaster response, and public health. AI for Good is designed to be useful whether or not you have coding experience. It does include Python code examples that you can execute and interact with to gain deeper insight into different applications. Please check it out! deeplearning.ai/courses/ai-for…
Loyola, CA 🇺🇸 English
28
123
588
105.9K
Robert Monarch ری ٹویٹ کیا
DeepLearning.AI
DeepLearning.AI@DeepLearningAI·
Not every ML project is bound for success. @WWRob, ML engineer & disaster responder, shares a story of a failed system for maternal health and how it paved the path to create more succesful projects. Enroll in AI for Good to learn from real-life cases: hubs.la/Q021xy170
English
1
3
9
6.2K
Robert Monarch
Robert Monarch@WWRob·
Twitter just updated its privacy policies to permit it to infer and share your identity with anyone. Like @washingtonpost reports, I believe this will enable oppressive regimes to execute people with “anonymous” accounts with only 10 followers. washingtonpost.com/opinions/2023/…
Robert Monarch tweet mediaRobert Monarch tweet media
English
0
1
4
784
Robert Monarch
Robert Monarch@WWRob·
@LeonDerczynski I agree, but your now deleted tweet was more interesting bc it felt like you were throwing down a gauntlet
English
1
0
1
76
Leon Derczynski ✍🏻 🌞🏠🌲
Leon Derczynski ✍🏻 🌞🏠🌲@LeonDerczynski·
automatic llm red teaming is not the right tool for discovering new failure modes, only for discovering new ways of provoking known failure modes. discovering new failure modes needs creative humans
English
1
0
5
605
Robert Monarch
Robert Monarch@WWRob·
@AnimaAnandkumar Yes, RLHF seems like branding to cover up and differentiate from established practices in annotation. I’ve already seen multiple researchers abandon RLHf to use more established and more mathematically well-founded approaches to human feedback for LLM tuning
English
1
0
1
164
Prof. Anima Anandkumar
Prof. Anima Anandkumar@AnimaAnandkumar·
My hypothesis is that more RLHF and fine-tuning destroys the calibration of pretrained models. It is a shallow fix that encourages the models to convince the user that they are following instructions, rather than actually following them.
Arvind Narayanan@random_walker

This from a VP at OpenAI is from a few days ago. I wonder if degradation on some tasks can happen simply as an unintended consequence of fine tuning (as opposed to messing with the mixture-of-experts setup in order to save costs, as has been speculated). twitter.com/npew/status/16…

English
13
41
388
160.2K
Robert Monarch
Robert Monarch@WWRob·
@JWGrieve @yoavgo No, I regularly talked about work on Firthian linguistics at Stanford and Silicon Valley more broadly in the 2000s, including to authors of the lda & word2vec papers. This might be a case of genuinely thinking they invented something they heard - I was an outlier at that time
English
1
0
4
169
Jack Grieve
Jack Grieve@JWGrieve·
Hi @yoavgo I’m pretty sure it was you on here who once said the development of word embeddings had no direct link to Firth — this was a link made retroactively. Like Mikolov et al had never heard of him. Don’t doubt you’re right — but do you have a reference? Thanks!
English
3
0
5
3.3K
Robert Monarch
Robert Monarch@WWRob·
@ryandcotterell @adinamwilliams @ZeerakTalat If you haven’t already, you will be approached by people who profit from extractive industries and use NLP to identify political “enemies”, because this use case has always been NLP’s greatest impact on humanity. I support a new publication option that excludes these people.
English
0
0
0
254
Robert Monarch
Robert Monarch@WWRob·
@mayhewsw I kept telling people this when I was CTO of the largest data labeling company *and* that paying people fairly was more cost effective in the overwhelming majority of use cases. It would be a net economic benefit to introduce legislation to enforce fair pay for annotators
English
0
0
2
54
Stephen Mayhew
Stephen Mayhew@mayhewsw·
My favorite takeaway from this presentation was that quality of the dataset is correlated with amount paid to annotators. Water is wet etc but nice to see it said out loud. #acl2023nlp
Babelscape@babelscape

Thrilled to announce that we received the *outstanding paper award* at ACL 2023 for our paper "What's the meaning of superhuman performance in today's NLU"! #pubs" target="_blank" rel="nofollow noopener">babelscape.com/research#pubs #NLProc #ACL2023 #ACL2023NLP

English
1
1
22
4.1K
👩‍💻 Paige Bailey
👩‍💻 Paige Bailey@DynamicWebPaige·
I ❤️ working with machine learning research teams, and can't really imagine doing anything else (other than perhaps running a late-night coffeeshop + computer lab in a town that needs it 😅). But at some point, I really want to raise a family; and there is no way in heck I would feel safe or supported doing that in San Francisco. We desperately need a second large AI community hub that's located somewhere a bit less Mad-Max-y.
GIF
English
56
6
220
197.4K
Robert Monarch
Robert Monarch@WWRob·
@milindjagre The course emphasizes the importance of the human side of ML: we’re fortunate that you’re working on this for us @milindjagre !
English
1
0
1
48
Robert Monarch
Robert Monarch@WWRob·
I'm teaching new @DeepLearningAI courses on AI and Public Health, Climate Change & Disaster Response. Delighted to highlight: @onucharlesc @BDataScientist @felipeoviedop @IvaGumnishka @jack_kelly @LesterMackey @priyald17 @sarameghanbeery @shahrzaadghlm & @TapiwaChiwewe!
DeepLearning.AI@DeepLearningAI

Launching today: AI for Good! 🌎 Designed in collaboration with Microsoft’s AI for Good Lab and instructed by @WWRob, it will empower you to tackle real-world challenges using AI, and how to determine if AI is the right tool for the job. Enroll now: hubs.la/Q01WgbtZ0

English
3
5
19
3K
Robert Monarch
Robert Monarch@WWRob·
@random_walker It’s only millions FTE on outsourced platforms. More people want to work but there isn’t the demand, esp on platforms that pay fairly. But most annotation is internal to organizations and not necessarily the main job that someone performs, so that part is hard to estimate
English
0
0
3
454
Arvind Narayanan
Arvind Narayanan@random_walker·
Billions of people doing clickwork for AI sounds more dystopian than most of the AI safety risk scenarios that have been proposed tbh
Arvind Narayanan tweet media
English
20
360
1.4K
293.7K
Robert Monarch
Robert Monarch@WWRob·
To everyone coming to Dolores park for @TransMarch, my kids are sleeping nearby so … make as much noise as you want. Angry, Happy, Both, any sound of protest or celebration. Especially after this year’s attacks on trans/ngc folk 🩵🩷🤍
English
0
0
5
577