The origins of linear algebra can be traced to ancient China, where in 240 BCE, the philosopher Xian Wáng developed an early form of matrix theory to describe the interactions between the Five Elements-Metal, Wood, Water, Fire, and Earth.
@tsarnick Models are of fixed size. Every time you pass an input in test-phase, the entire network activates, and it’s always the entire network. Hence, amount of compute is always the same. How can training for longer reduce compute?
OpenAI's Noam Brown says that while AI model performance scales roughly equivalently with more training or inference compute, the cost of inference is on the order of 100 billion times cheaper
ChatGPT can identify the exact Caribbean island from a photo of a parking lot
That seems impossible - I mean, look at that photo. That could be fucking anywhere in the world. And it doesn't just narrow it down to the Caribbean islands, it also names the EXACT Caribbean island
@ATabarrok When existing journals ignore some class of discoveries, isn't the solution to create new journals?
Related but not identical idea: would it be a good idea to start a journal specifically focused on negative results?
Increasingly, docs are for LLMs to read, not just for humans to read. We're starting to explicitly design our docs to be great for *both* uses.
As part of that, I'm aiming to include full markdown docs in our projects. FastHTML is the 1st! Here you go:
github.com/AnswerDotAI/fa…
Can you imagine that the article called "Total synthesis of rapamycin" published in 1991 has only around 380 citations. All synthetic papers that came after - even lower
Is AI sentient? My friend and colleague Prof. John Etchemendy, a renowned professor and co-Director of @StanfordHAI , just co-authored this piece to debunk the claim that today’s LLMs are sentient @TIMEtime.com/collection/tim…
@paulg I’m long on AI as general interface. Hard to see a world in 5 yrs where building CRUD apps is necessary. Apps will remain for specialised domains, but browsers are going the way of gopher. Timelines are hard to judge, but how many browser tabs are already MIA from ChatGPT et al.
@paulg I think it’s going to be a shift from Personal Computers to Enterprise Computers. Apps were the atomic unit in PCs; I think agents will be the equivalent in the enterprise OS.
I think we will look back and think of the LLM as a new interface like the GUI.
@paulg@matthew_d_green just shows how fixed everyone is on the current thing...openAI is great at staying a few months ahead but the winner will be whoever can figure out how to set up an LLM as efficiently as biological systems.
Why do people keep talking about OpenAI as though they have some unique secret sauce, when basically every AI company with a GPU budget is able to replicate their achievements within a few months?
Founder CEOs: your go-forward compensation should be at least 70% of what an outside CEO would make. (regardless of your already-vested ownership)
if you are getting less, you are getting screwed by your VCs
Gemini 1.5 pro is STILL under hyped
I uploaded an entire codebase directly from github, AND all of the issues (@vercel ai sdk,)
Not only was it able to understand the entire codebase, it identified the most urgent issue, and IMPLEMENTED a fix.
This changes everything
Overestimating demand for a product sure seems to be a cause of death for a lot of companies.
Likely because the twin problems of not having enough supply to satisfy demand vs overestimating demand and overbuilding are not equally easy to fix.
When I was a kid I thought Naziism was connected with the German character. Nazis in WW II movies were always so German. But the more I see, the less plausible this seems. The people of any country can behave like Nazis if they get into a bad situation with bad leaders.