akhil

25.9K posts

akhil banner
akhil

akhil

@fkasummer

You say that the times are bad. Be better yourselves, and the times will be better: You are the times. Technology must multiply human agency. DMs closed.

New York, USA Katılım Ekim 2018
2.2K Takip Edilen8.2K Takipçiler
Sabitlenmiş Tweet
akhil
akhil@fkasummer·
If you have an obsessive streak, this is the greatest time to be working on frontier technology. The problems are genuinely monumentally difficult, which makes progress feel amazing. Besides, it's quiet on the frontier. None of the circus of mainstream AI.
English
12
22
331
16.8K
akhil
akhil@fkasummer·
The intelligence-as-compression perspective was useful, but now it's damaging.
Steve Hou@stevehou

🚨 [Ackman-esque long post. You should prob skip. Don't tell you it's too long in the replies. I used AI to correct typos and run-on sentences.] This is a thoughtful write-up. I think I understand and sympathize with its core intuition, but I disagree with it. I don't think we've overestimated intelligence or hit a ceiling on what IQ can do. On the contrary, I think we don't have remotely enough intelligence, for long enough and cheap enough. Let me expand. Cliff's argument is two-fold: you cannot make genuinely useful output from doing first principles reasoning alone. To solve genuinely economically valuable problems, AI must directly interact with the world, collect data, leverage tools, and iterate. But I think that’s exactly the direction AI is currently traveling. And that’s why it was so important that we’ve had the agentic AI (re)evolution — AI directly using existing tools and analytics, basically being able to browse the internet, use a computer, call analytics functions instead of doing it from scratch. I think a telling example is that today few people doubt that AI will eventually be able to solve management consulting problems like McKinsey, or do legal research and prepare litigation strategies and court arguments. It’s already able to do tax saving optimizations or offer more accurate medical diagnoses. The funny thing is I actually think it’s the first principles stuff that AI has yet to show it is truly capable of, such as new scientific discoveries in maths, physics, biology, and medicine etc. I think it’s excellent at empirical analysis and will likely become very good at devising empirical analysis strategies — deciding what experiments to run and what data to collect. It’s not quite able to autonomously collect physical world data by itself yet, but with automation in drones and robotics maybe eventually it will. I think the reason we haven’t had an economic takeoff is exactly because we haven’t had enough “thinking.” On the one hand, “enterprise” adoption remains abysmally low. It’s a brand-new technology that’s changing extremely rapidly. It’s very costly and difficult to learn and adopt into workflows, especially when the cost of tokens is still very high. That’s why it’s actually a very good thing that frontier intelligence continues to deflate with further scaling. If you look at the problems I cited above, these are all actual concrete problems that human workers do to generate enormous billable value. With adoption of AI, we’ll be able to do all of those tasks more quickly and more cheaply. That brings us to the second reason. I think the lack of takeoff continues to derive from the fact that the “thinking” or model just isn’t good enough yet. We are a long way from hitting diminishing returns, much less the “ceiling” of intelligence or “good thinking.” As smart as the models have gotten, they are still pretty “dumb” in predictable ways. They can’t yet be fully trusted to complete the above-mentioned tasks without close human supervision — at least not in a way that makes us feel comfortable. The models are now able to think about much harder problems and work for a very long time to code up very impressive software. These are progresses that were unthinkable two years ago. The models only just recently — maybe this year — became genuinely and reliably useful. Most of the “multi-hour tasks” that AI is able to do are still in the coding domain. You wouldn’t really expect a good outcome from a multi-hour AI session on a more qualitative/judgement-heavy use case like consulting, medicine, or law. The last time I checked, ChatGPT still sucked at making good PPT presentations. I’m sure someone will jump up and tell me that I’m out of touch with AI progress and it’s already capable of doing such things. But that already tells us why enterprise adoption/takeoff is low. The tech is just moving too fast and is all too new. Adoption takes time and some stability of expectations. In short, I think there’s a crucial difference between the existence of certain frontier capabilities and the existence of such capabilities in cheap abundance. There was a long gap between the invention of electricity and its wide adoption and productivity boost. Similarly with the inventions of combustion engines and the internet. So the fundamental problem in my opinion is actually converse to Cliff's: the models are still simply not good enough both in capabilities and cost per intelligence. Like that famous line from the Jiang Wen movie: we have to let the bullets fly a while longer.

English
2
0
9
1.1K
akhil
akhil@fkasummer·
If you're unwilling, then you will find yourself attempting a paradigm shift by looking under the lamppost.
akhil tweet media
English
0
0
5
289
akhil
akhil@fkasummer·
There's incredible value in theoretical cs and pure math. It's just that you have to carry the full weight of problem selection, then actually creating the necessary definitions and other constructs, and then making it effective against reality. For frontier problems, you cannot insist that they be amenable to known methods. Nature doesn't negotiate.
English
2
2
52
3K
akhil retweetledi
Ronald Christ
Ronald Christ@RonaldCHRIST12·
“I will open my mouth in parables; I will utter what has been hidden since the foundation of the world.” Matthew 13:35 ESV
Ronald Christ tweet media
English
1
3
31
1.1K
akhil
akhil@fkasummer·
Remarkably, writing on paper – something about the friction involved – makes me more productive. I've been averaging 30pg/day.
English
2
1
16
582
akhil
akhil@fkasummer·
"to manifest the heroic mind you possess and to lay foundations of learning and wisdom for the blessings of the race"
akhil tweet media
English
0
0
15
516
akhil
akhil@fkasummer·
Sunday reading
akhil tweet media
English
0
0
8
303
akhil
akhil@fkasummer·
Sunday afternoon thrilled about the work ahead.
English
0
0
3
249
akhil retweetledi
Under Secretary of War Emil Michael
So let me get this straight @deanwball This was about ensuring that DoD IT networks were not connected to adversary networks. You think your deep state regulatory capture scheme is equivalent to making sure our warfighter networks are not compromised? I take it back: 50 IQ difference (75 versus 125). Take a breather and enjoy the match.
English
40
57
786
205.3K
akhil
akhil@fkasummer·
Increase in knowledge from trade will outpace the increase in knowledge from any attempt to confine and stockpile it. The eigenform of intelligence is default open as a result.
English
0
0
12
1.7K
akhil retweetledi
akhil
akhil@fkasummer·
I think the simplicity of the next great AI breakthrough will be heartbreaking.
English
1
1
7
616
akhil retweetledi
akhil
akhil@fkasummer·
Are we approaching a singularity or a fractal? Fractal: increasing complexity, more details at new scales, fragility, multiplicity of failure modes. Singularity: radical simplicity, discontinuous change, failures are concentrated.
akhil@fkasummer

Scaling as a strategy works as long as the transition to victory is a clear line you cross. If it's a fractal, you will get closer but never cross. As an exercise, consider how this changes the game theory.

English
7
4
28
1.8K
akhil
akhil@fkasummer·
We haven't got a full theory of observation. Some partial attempts made over the years. Everyone averts their eyes from the problem.
English
0
0
2
253