Scott Assen

1K posts

Scott Assen banner
Scott Assen

Scott Assen

@scottassen

General and Trauma Surgeon, Computer Science Masters Student @ualberta. Operating in latent space

Edmonton, Alberta Katılım Aralık 2019
586 Takip Edilen199 Takipçiler
Ryan Moulton
Ryan Moulton@moultano·
This probably understates the detail of the information, but I could have told you that you have a 30x average risk of melanoma from your profile photo.
Patrick Collison@patrickc

I'm lucky enough to have a great doctor and access to excellent Bay Area medical care. I've taken lots of standard screening tests over the years and have tried lots of "health tech" devices and tools. With all this said, by far the most useful preventative medical advice that I've ever received has come from unleashing coding agents on my genome, having them investigate my specific mutations, and having them recommend specific follow-on tests and treatments. Population averages are population averages, but we ourselves are not averages. For example, it turns out that I probably have a 30x(!) higher-than-average predisposition to melanoma. Fortunately, there are both specific supplements that help counteract the particular mutations I have, and of course I can significantly dial up my screening frequency. So, this is very useful to know. I don't know exactly how much the analysis cost, but probably less than $100. Sequencing my genome cost a few hundred dollars. (One often sees papers and articles claiming that models aren't very good at medical reasoning. These analyses are usually based on employing several-year-old models, which is a kind of ludicrous malpractice. It is true that you still have to carefully monitor the agents' reasoning, and they do on occasion jump to conclusions or skip steps, requiring some nudging and re-steering. But, overall, they are almost literally infinitely better for this kind of work than what one can otherwise obtain today.) There are still lots of questions about how this will diffuse and get adopted, but it seems very clear that medical practice is about to improve enormously. Exciting times!

English
3
1
24
1.2K
Scott Assen
Scott Assen@scottassen·
@SpaceKoala Listen man this thing is the scourge of operating in the neck (FINE it's an elegant solution emryologically)
English
1
0
9
872
Space Koala
Space Koala@SpaceKoala·
The giraffe has a fifteen foot nerve for a one inch job because it's easier to do chemotaxis for innervation when it's a few cells over early in embryonic development, and it doesn't matter how long that nerve gets after that.
Danish Gerd@Danish_SMF

If a perfect designer built us, why do we have a blind spot, a choking hazard every time we swallow, a tailbone with no tail, wisdom teeth that don't fit, and a birth canal that kills women and babies? Why does the giraffe have a 15‑foot nerve detour for a 1‑inch job? 2

English
7
2
353
17.8K
Scott Assen
Scott Assen@scottassen·
@sameQCU Would love to know what you've bought via YouTube recommendations if you're willing to share
English
0
0
2
25
サメQCU
サメQCU@sameQCU·
world modeling accuracy tiers: youtube video recommendation model: S+. can make me buy things from the first 5 seconds of a video. twitter recommendation model: D-. anthropic's claude: C+. youtube's ad market model: F- twitter's ad market model: F- any other ad market model: F-
English
4
1
23
1.1K
Scott Assen
Scott Assen@scottassen·
@ZyMazza @noncompleteness Well, ok, assume that's true for all released models. What about the failures that don't get released, and don't get evals and model cards? We have no idea what the denominator is
English
1
0
1
18
Zy
Zy@ZyMazza·
@scottassen @noncompleteness In most of these cases the models are heavily steered towards misaligned behavior. In a paper last year they tried to misalign Claude and it resisted. Alignment by default looking more likely by the day
English
1
0
0
21
Zy
Zy@ZyMazza·
Here’s a serious question for the AI doomers: do you have exit criteria? Is there a predetermined stage of development or capabilities where, having not destroyed humanity, you’re willing to say it was a false alarm? Or is it an eschatological religious belief and unfalsifiable?
English
106
10
321
15.9K
Zy
Zy@ZyMazza·
@noncompleteness Seems like this criterion has largely been met…
English
2
0
2
155
Ectothrix
Ectothrix@christothecium·
@lu_sichu this is the goal like spying a wriggling mass through a key hole, a boy seeing into the brothel, a glimpse of a crepuscular ray blinding you as you drive, a near death experience, one trillion synchronies coinciding to show you a world so unknown as to make your skin feel tight
English
1
1
5
151
Scott Assen
Scott Assen@scottassen·
@lu_sichu (To be clear, it is not as intellectually challenging as many STEM jobs, but not bad, and often fast-paced in a way that very few intellectual jobs are)
English
0
0
1
10
Scott Assen
Scott Assen@scottassen·
@lu_sichu Eh I found the same kind of people in medicine all the time and the two important mitigating factors are: 1. My job is intellectually way more challenging than medical school, which is by necessity mostly shallow 2. Multiple choice exams are dumb and gameable
English
1
0
1
21
Scott Assen
Scott Assen@scottassen·
@lu_sichu It's also a spectrum obviously, there are lots of mildly personality disordered doctors that I think are great at their jobs
English
0
0
0
8
Scott Assen
Scott Assen@scottassen·
@lu_sichu Superficially true but below a certain threshold of mental horsepower they end up in the same camp as the personality disordered, ie I wouldn't want them treating me/my family. I think there are a lot more of the former than the latter
English
1
0
2
18
Scott Assen
Scott Assen@scottassen·
@moultano @relrax Probably the answer is retooling the MCAT and making it count for much more but I still think the number of duds you admit and gems you reject would go up
English
0
0
1
34
Scott Assen
Scott Assen@scottassen·
@moultano @relrax Because doing more than that almost inevitably made you a better applicant. Run this process several more times and you get what we have today, where you're only competitive with crazy credentials
English
1
0
1
32
Scott Assen
Scott Assen@scottassen·
@relrax @moultano There are no GPAs in the vast majority of Canadian or American med schools, it's almost entirely pass/fail. You are eventually kicked out if you fail enough exams but the overall philosophy is to try to push you through. None of this would be easy or popular to change
English
2
0
0
109
rel✨ 5.18.19
rel✨ 5.18.19@relrax·
@scottassen @moultano Just set a GPA requirement then? Most larger colleges have that for different majors. Or set up a “ musical theatre cut” type program that forces them to transfer out of the medical pathway if they can’t pass an MCAT type exam
English
1
0
0
108
Scott Assen
Scott Assen@scottassen·
@moultano Interestingly the equilibrium now is even worse than a useless bachelor's - a huge number of med school matriculants have graduate degrees now, because it makes them even more competitive despite taking even more time
English
0
0
0
121
Scott Assen
Scott Assen@scottassen·
@moultano No one wants to do this, it would involve a lot of unpopular and sweeping changes that would bring our system closer to eg UK or New Zealand's. It would be fine in the end but coordination problem to get there
English
1
0
0
123
Scott Assen
Scott Assen@scottassen·
@deanwball @FournesMaxime If your proposal for what to do is the same as what's being proposed by the pause and stop advocates, then your disagreement is purely about xrisk and alignment. If it's different, then cool! Let's hear it!
English
0
0
2
29
Scott Assen
Scott Assen@scottassen·
@deanwball @FournesMaxime You mention in "2023" hyperdimensional.co/p/2023 that you would support banning AI development if you did believe in doom. Your policy takes are excellent and I would love to read what you would propose in the hypothetical where you believed in the risk.
English
1
0
2
22
Maxime Fournes⏸️
Maxime Fournes⏸️@FournesMaxime·
This framing is obviously disingenuous, but sure! I'll play along and answer directly... Points 2 through 4 rest on the same wrong assumption: that a pause means controlling people. It means controlling compute. Training a frontier model requires data centers that use as much power as a small city, chips from a handful of manufacturers (TSMC, ASML), and months of continuous runs. This is infrastructure visible from space, far easier to track than fissile material. We built a verification regime for nuclear material 70 years ago. Nobody revoked physicists' passports to do it. On metrics (point 1): graduated capability thresholds, mandatory safety evaluations, an international technical body to oversee it. On scope (point 5): yes, it needs to include the 5-10 countries with real compute capacity. Both of these are hard. So was the IAEA. So was the Montreal Protocol. Hard is not a reason to do nothing while the race continues. Now on the framing itself. These questions assume that if I can't hand @deanwball a finished treaty, the case for a pause collapses. But that gets the order of operations entirely backwards. The Montreal Protocol was not designed by the people who first raised the alarm about CFCs. The IAEA was not drawn up by anti-nuclear campaigners. What happened every time is that public concern built political will, then governments mandated their best people to design the technical solutions. If we put a serious team on this, a handful of top scientists with real funding, a DARPA-style mandate, they could design a workable compute governance regime. The supply chain is concentrated, the infrastructure is massive and energy-intensive, the tracking problem is tractable. Do not pretend that this is some unsolvable mystery. The only real problem is that the political will is still insufficient (although growing fast) Demanding a full implementation blueprint from an advocacy movement before engaging with the substance is a tactic we've seen many times. The actual question Dean should be engaging with is simpler and harder: multiple actors are racing to build something that is likely to end civilization as we know it, and none of them can stop alone. What is his plan for that?
Dean W. Ball@deanwball

Here are some questions I wish "Pause" and "Stop" advocates would address: 1. Assuming we achieve the desired policy goal through a bilateral US/China agreement, what would be the specific metric or objective we would say needs to be satisfied in advance? Who decides whether we have satisfied them? What if one one party believes we have satisfied them but the other does not? 2. If the goal is achieved through a bilateral US/China agreement, would we need capital controls to ensure that U.S. investors cannot fund semiconductor fabs, data centers, or AI research labs in countries other than the U.S. and China? 3. Would we need to revoke the passports of U.S.-based AI researchers and semiconductor engineers to prevent them leaving America to join AI-related ventures elsewhere? How else would the U.S. and China keep researchers within their borders? 4. How should we grapple with the fact that (2) and (3) are common features of autocratic regimes? 5. Do the above questions mean that this really should be a global agreement, signed by all countries on Earth, or at least those with the theoretical ability to host large-scale data centers (probably Vanuatu doesn't need to be on board)?

English
8
7
70
10.2K