sarah hong ✨

2.1K posts

sarah hong ✨ banner
sarah hong ✨

sarah hong ✨

@latentcodes

pursuing the adjacent possible for the next era of human-aligned ai. cofounder @latentspaceai 👩🏻‍💻🇨🇦 @uoftcompsci

San Francisco, CA Katılım Haziran 2009
437 Takip Edilen1.2K Takipçiler
sarah hong ✨ retweetledi
Garry Tan
Garry Tan@garrytan·
Thousands of startups and small businesses are at risk due to the SVB failure. We ask for depositors to be made whole, and for regulation to prevent this catastrophe. 650 founders who employ more than 22,000 people, have already signed. Please spread the word. ycombinator.com/blog/urgent-si…
English
166
222
760
355.5K
Charles 🎉 Frye
Charles 🎉 Frye@charles_irl·
stoked to join @full_stack_dl as an instructor! when i first came to industry from my phd, this course helped me see clearly the rest of the pancakes underneath the rich tasty butter that is training models looking forward to sharing that learning experience with everyone
The Full Stack@full_stack_dl

We are excited to announce FSDL 2022! ✨ New lectures on continual learning, working with LLM's, and ML project management 💪 All lectures and labs updated for 2022 🗣 Discord-based cohort experience 🔜 Starting August 8th Register today at fullstackdeeplearning.com/course/

English
4
2
69
0
Tarun Chitra
Tarun Chitra@tarunchitra·
@latentcodes @VitalikButerin Haha, perhaps, but rollouts for reality are harder than games whose imperfect information assumption is because their state space is *too big* not because the state space is *unknown* (or partially revealed in a sequential manner)
English
1
0
0
0
vitalik.eth
vitalik.eth@VitalikButerin·
One broader sort-of-contradiction I think about is the open-mindedness vs passion tradeoff. Is it possible to both passionately act on the world based on your current beliefs and be open minded to the possibility that those beliefs are very wrong? How do yall handle this?
English
18
427
4.3K
0
Tarun Chitra
Tarun Chitra@tarunchitra·
@VitalikButerin Bandit problems (statisticians love using uncharitable terms like "exploitation vs. exploration" for the same phenomena) are hard to solve, esp. when you're *also* learning the utility functions for "open-minded" and "passion" Being able to admit I'm wrong a lot helped me though
English
2
1
56
0
sarah hong ✨
sarah hong ✨@latentcodes·
@VitalikButerin I like the Ideological Turing Test for this! I find it pushes me to try to understand the passion underlying a belief system I initially disagree with (more so than steelmanning). My grand plan is to eventually use this to trick @iantbd into thinking I am a 🤖
English
0
0
7
0
sarah hong ✨ retweetledi
Susan Zhang
Susan Zhang@suchenzang·
So excited to finally open up access to these models! Couldn't have asked for a better team to do this with: @stephenroller, @NamanGoyal21 (@myleott + @sam_shleifer at the start too)!
AI at Meta@AIatMeta

Today Meta AI is sharing OPT-175B, the first 175-billion-parameter language model to be made available to the broader AI research community. OPT-175B can generate creative text on a vast range of topics. Learn more & request access: ai.facebook.com/blog/democrati…

English
16
85
538
0
sarah hong ✨ retweetledi
Whyrusleeping
Whyrusleeping@Whyrusleeping·
Human's won't be obsoleted by AGI, we just need better tooling to stay on top.
English
2
1
10
0
sarah hong ✨ retweetledi
Gitcoin
Gitcoin@gitcoin·
As we kick off GR13, we’re especially proud to announce: A 🇺🇦Support for Ukraine🇺🇦 round We’ve raised $700K to go towards humanitarian aid for Ukrainians To learn more and get involved, read this 🧵
Gitcoin tweet media
English
6
31
76
0
sarah hong ✨
sarah hong ✨@latentcodes·
Me: The greatest love story: Alice & Bob… across time, for all time Him: Not for all time. It’s until the second law of thermodynamics defeats them — the last lovers — and dissipates them and all their messages into the uniform distribution — the maximum entropy state. Me: 🙃
English
1
1
13
0
sarah hong ✨
sarah hong ✨@latentcodes·
@_arohan_ same, same 🍔🍟 <insert recommender system alignment joke>
sarah hong ✨ tweet media
English
0
0
1
0
sarah hong ✨
sarah hong ✨@latentcodes·
@PatrickJBlum @pmarca @jordanbpeterson i'm convinced _you_ are the abstract manifestation of chaos 😂 please do newton and darwin next 🙏 twitter.com/iantbd/status/…
Ian Thompson@iantbd

Wordcel Darwin wrote millions of words in diaries during an expensive journey around the world to get labels for his training data (only to realize it was self-supervision all along…) Rotator Newton sat at home during a plague rotating apples in his head. (2/4)

English
0
0
1
0
sarah hong ✨
sarah hong ✨@latentcodes·
@snarkyzk yes! in fact, inspired by the current games, @scottfits is training for the next olympics under my vigilant guidance. at his exponential rate of progress, he'll be tackling the quad axel next ;) ⛸️⛸️
English
1
0
3
0
sarah hong ✨ retweetledi
Ian Thompson
Ian Thompson@iantbd·
Here’s another memetic isomorphism: Crypto is more like physics, and AI is more like biology – not in “biologically inspired” sense, but in the nature of possible solutions. So using the wordcel / rotator basis, Darwin is a wordcel and Newton is the ultimate rotator. (1/4)
vitalik.eth@VitalikButerin

16. It's fascinating how the two axes seem to imply each other: Pure tinkering is fast and effective, but it is unprincipled, so lacks large-scale legitimacy, so can only cooperate through centralization Theorycel thinking is slower, but well-suited for decentralization

English
1
1
5
0
sarah hong ✨
sarah hong ✨@latentcodes·
@savvyRL @csmisko Ahh, memories! Remember when you were telling us about your family in Wuhan while also teaching us how to make dumplings? The last gathering shortly before the world turned upside down 🥲
sarah hong ✨ tweet media
English
1
0
1
0
sarah hong ✨
sarah hong ✨@latentcodes·
CPT is much better than the current approach of "hacking" search on top of GPT3. irrespectively of how it compares to other existing models, the thing I'm worried about is that davinci (175b) does not perform significantly better than ada (300m)... 5/n
sarah hong ✨ tweet media
English
0
1
5
0
sarah hong ✨
sarah hong ✨@latentcodes·
a response from CPT author re eval, emphasizing that CPT is one model vs many, fine-tuned specific ones (similar to GPT3 vs task-specific models): twitter.com/arvind_io/stat… I do wish there were better ways to evaluate real-world settings! any public datasets / benchmarks? 🤔 4/n
Arvind Neelakantan@arvind_io

A thread on how we evaluate our embedding models in OpenAI’s API. We achieve state-of-the-art results in linear probe classification, text search and code search. It’s not fine-tuned, so it works great in the real world — and our customers love it. 1/7

English
1
1
3
0

Keşfet

@VitalikButerin @charles_irl @full_stack_dl @tarunchitra @iantbd @stephenroller @NamanGoyal21 @myleott