A I T O M A T I C

x.com/i/article/2003…

1995-2025: The Decline of Germany & Japan vs US & China. Can All-Purpose Robots Fuel a Comeback? In 1995, in terms of nominal GDP, a combined Germany and Japan were almost 1:1 economically with a combined USA and China. Only 3 decades later, this ratio is now down to 1:5! Self-replicating AI-driven all-purpose robots may be the answer. Around 2000, Japan still was the country with the most robots; Germany was 2nd. Today, China is number 1. However, most existing robots are dumb. They are not adaptive like the coming smart robots that will learn to do all the jobs humans don't like, including making more such robots. The text below extends an AI-based translation of my 2024 F.A.Z. guest article [FA24] written for a German audience, but its basic ideas apply to all countries with a strong engineering background. References and illustrations under people.idsia.ch/~juergen/GerJa… Build the AI-controlled all-purpose robot! Germany is losing out - partly because performance counts for too little. How can the country keep up in artificial intelligence (AI)? I have a suggestion. Today's AI seems impressive. But it is nothing compared to what will come in the next 20 years. I said that 40 years ago and I was right. I said that 20 years ago and I was right. And I'm saying it again today, and indeed, in 20 years' time, everything that currently seems impressive will seem trivial in retrospect. A key component of this is AI-controlled general-purpose robots. Today, everyone is talking about Generative AI and ChatGPT. What many people don't know: the current boom in "Generative AI" using artificial neural networks has its roots in the early nineties at the Technical University of Munich, especially the "G" and the "P" and the "T" in "ChatGPT." At that time, we published "Artificial Curiosity" through what's now called "Generative Adversarial Networks" (1990, now widely used) [AC90-20][DLH][DLP], self-supervised pre-training for deep learning with long texts (1991, the P in ChatGPT stands for "pre-trained") [UN][UN0-3][NOB], and unnormalized linear Transformers (1991, the T in ChatGPT stands for "Transformer") [ULTRA]. The Long Short-Term Memory [LSTM0-15][VAN1] — the most cited AI of the 20th century and "arguably the most commercial AI achievement" [AV1] — was also developed in my lab at TU Munich. Here is an overview including references [MOST]. At that time, Munich was also the birthplace of the first self-driving cars in traffic [AUT][DLH]. So why are the biggest beneficiaries of AI today not in Germany, but in America and China? Germany has messed this up itself. Research and art follow the money, but unfortunately Germany has spent almost nothing on AI since the 1990s compared to other countries. Let's take a closer look: Germany has been going downhill since the late 1990s, and not just in AI. In 1995, according to the IMF, Germany still had 33% of the economic power of the USA in nominal terms; today it has only 16%. In 1995, Japan (the origin of foundational neural network breakthroughs of 1967-1988 [GD1-2][RELU1][AMH1][NOB][CNN1][CNN1a][CNN1a+]) had 72 percent of the economic power of the USA, today it is only 15 percent. In 1995, the two big losers of WW II together were economically stronger than the USA; today they are less than a third as strong. In fact, according to the IMF, Japan (which had the five most valuable listed companies in the world in 1990) and Germany were roughly as strong economically in nominal terms as the much larger USA and China combined! See the title image. Since then, things have gone downhill in waves. By 2008, Germany only had 25% of the nominal economic power of the USA, but at least the EU as a whole was still as strong as the USA and China combined [EU08]. As a result of the financial crisis, however, Germany's taxpayers then lost enormous sums of money to the USA, for which the crisis was not really a crisis at all, but a major financial gain that led to the loss of importance of German and other European banks. Since 2015, the relative decline of Germany (and the EU) has progressed particularly rapidly. Since then, Germany has spent a lot of money on things that have yielded little and has become increasingly poorer and less significant compared to the USA. And as I said, research and art follow the money. Germany was also much stronger militarily in the 1990s than it is today. And even in sport, the decline in performance became clear. Until 2006, German athletes often led the Olympic medal tables, especially at the Winter Games [OLY10]. Today, they are mostly among the "distant runners-up." Even at the Summer Games, Germany still won 90 percent of the gold medals won by the USA in 1992, but only 30 percent in 2024. Its small neighbor, the Netherlands, has more. Why is that? Because Germany abolished its performance incentives. Example: as a pupil, I found the incentive provided by the points system in the National Youth Games enormously motivating: I wanted to be the best in the class. It was one of many performance incentives that have been deleted by politicians. I continue to train excellent young German researchers. But they often don't see any attractive opportunities in Germany afterwards. Instead, many want to go to the best-equipped foreign (mostly American) AI labs of the big platform companies, where they can earn 350,000 euros or more straight after their doctorate, much more than a German chair holder, who only receives a good 100,000 euros plus bonuses. In foreign AI laboratories, researchers are also provided with far more computing resources (very important in AI). They don't have to write research proposals and are still allowed to publish and make a name for themselves. Unfortunately, it looks a bit like my home country no longer wants to or can't really keep up in this merciless global competition for outstanding talent. I can't tell you what a shame I think that is. The incentives are wrong: many of the best and most expensively trained specialists are leaving the country and are being replaced by others who can contribute little to the country's success with a lot of tax money and false incentives. It's a self-reinforcing vicious circle. What immigration policy would a rational country pursue? One that raises the average in the country through appropriate incentives. If someone comes into the country who is richer than the average of those who are already there, the average wealth in the country increases and they are likely to pay more into the social systems than they take out. If he has a higher IQ than the average, the average IQ rises. If he is less criminal than the average, the number of crimes per inhabitant decreases. If he can speak German better than average, the German language skills per inhabitant increase. And so on. Many politicians do not understand these truly simple correlations and instead set well-intentioned but deeply counterproductive incentives that do not raise the important averages, but lower them, and thus harm the country. Germany has already worked its way back up from much worse valleys. I therefore remain a cautious optimist. But fundamental changes are needed. AI in the physical world is still in its infancy The only AI that works well today is AI in the virtual world behind the screen, for example for automatically summarizing documents, creating images, programs and PowerPoint slides. The next big thing will be AI in the physical world. However, the latter is much more demanding than the world behind the screen. So today it is quite easy for AI to learn how to play chess, Go or video games superhumanly well. But there is no AI-controlled soccer-playing robot that can keep up with a little boy. There is no robot that can do what a plumber can do. That will come at some point, but AI software research is not enough, it has to be combined with the physical world of machines and robots. That’s why in 2014 - when compute was 100 times more expensive than today - we founded our AI company for the physical world. Alas, like some of our projects, it may have been a bit ahead of time, because the real world is very challenging. After all, passing the so-called "Turing Test" [TUR3,a,b][TUR21] is much easier than True AI in the physical world! But every 5 years, compute is getting 10 times cheaper, and smart robots are now starting to become a reality. For every 10,000 AI software companies, there are perhaps only 10 AI robot companies. So the field is not yet overcrowded. With its strong mechanical engineering sector, Germany still has a chance of becoming an international leader. However, I already wrote this six years ago in my F.A.Z. article "AI is a huge opportunity for Germany" [FA18] (see also my earlier 2015 F.A.Z. article on intelligent robots [FA15]). The leader of the CDU/CSU parliamentary group at the time was Volker Kauder. He said that everyone had to read the article. I was invited to the Reichstag, where many famous politicians listened to what I had to say on the subject. I suggested investing a small number of billions for a world-class AI campus in an attractive city as a basis for further investment. The proposal fell on open ears and initial thoughts were given to this. A few weeks later, however, Kauder was no longer leader of the parliamentary group and everything came to nothing. While the major powers are now investing hundreds of billions in AI, Germany prefers to spend hundreds of billions on unemployed immigrants. I can only recommend that our politicians rethink the incentives in this country. There is a huge opportunity in German mechanical engineering What can Germany do to get back on its feet and avoid a further exodus of the best? How about a big, visionary yet realistic national project that, if successful, would have a truly world-changing impact? Namely: build an all-purpose robot that can learn to do all the jobs humans don't like! In the not-too-distant future, someone will for the first time produce such intelligent (but not necessarily super-intelligent) robots at low cost, with which you can talk and interact and which you can teach something new without much prior knowledge (there are already approaches to this). A country with such versatile all-purpose robots would no longer need to worry about a shortage of skilled workers, secure pensions and unconditional basic income. AI-controlled general-purpose robots would of course also be extremely exportable, as everyone would like to have them to do thousands of inconvenient jobs. And they would be extremely scalable: robots that can operate the tools and machines operated by humans can also build (and repair when needed) more of their own kind. I called this the ultimate form of scaling [JY24]. The country that, through a combination of private initiative, universities and industrial policy, is the first to produce such general-purpose robots will change world history. Let's go, Germany!