Daniel Lemire

34.9K posts

Daniel Lemire banner
Daniel Lemire

Daniel Lemire

@lemire

Software performance expert. Ranked in the top 2% of scientists globally (Stanford/Elsevier 2025) and among GitHub's top 1000 developers. Father, husband.

Montreal, Quebec Katılım Kasım 2007
2.2K Takip Edilen34K Takipçiler
Daniel Lemire
Daniel Lemire@lemire·
Updated the fast fastrand library. We now support ARM on linux out of the box. It provides fast random number generation in an interval in Python: Up to 10x faster than random.randint. It is great if you are running simulations, etc. pypi.org/project/fastra…
English
0
0
13
1.5K
el jack
el jack@Lotsoffoodinme·
@lemire I shall watch tomorrow. C++ reflection I can just tell is going to be something I like with syntax I despise.
English
1
1
3
237
Daniel Lemire
Daniel Lemire@lemire·
Just gave a talk on SIMD-accelerated data processing in C++! We push JSON parsing to ~14 GB/s single-threaded on a macBook, added C++26 compile-time reflection for zero-boilerplate (de)serialization, and brought blazing fast UTF-8/16 + Base64 to browsers (16+ GB/s). Hardware keeps getting wider & faster, our code has to keep up. Full talk youtube.com/watch?v=BBLDgs… Joint work with lots of people such as @geofflangdale, @GeimanThiesen, @FUZxxl and @yagiznizipli
YouTube video
YouTube
English
2
39
299
21.9K
Daniel Lemire
Daniel Lemire@lemire·
So Visual Studio 2026 uses GitHub Copilot (AI!!!) to make recommendations about how you should build your projects. And, apparently, it was getting it wrong. I wonder whether this kind of deep tooling integration with AI is a net positive.
Daniel Lemire tweet media
English
5
1
22
3.2K
Vittorio Romeo
Vittorio Romeo@supahvee1234·
@lemire It is a net positive only if a good model is used (e.g. Claude Opus 4.7, or ChatGPT 5.5). But good models are expensive, so they will never be used for stuff like this. So, it is not a net positive. 😀
English
1
0
0
285
Shreerang Sarpotdar
Shreerang Sarpotdar@shreerangs·
Ahahaha best of luck
Daniel Lemire@lemire

For years, my employer has required professors to fill out complicated Excel spreadsheets every year. After all, someone has to keep track of who teaches what and who is responsible for the students in each course. These Excel spreadsheets are incredibly complex. We use a wide range of metrics to measure each professor’s workload in the name of “fairness.” There are multiple spreadsheets, each containing several tabs. Why Excel? Probably because someone on the IT staff was (and still is) very good at it. Once we’ve all completed our forms, they are emailed to administrative staff, who then manually re-enter the data into the actual database. This year, we received the new forms on Thursday. By Friday morning, I had launched my AI with a simple prompt: “Take these spreadsheets and build a web app that does the same thing.” Within an hour, I had a fully functioning web application. It is far superior to the Excel version: it includes autosuggestions, autosave, the ability to synthesize data across all sections, and a much cleaner interface. That same day, I called a meeting with the department chair. He immediately agreed that this was the way forward. Over the weekend, I created a short video presentation and sent a link to the live, working app. Upper management seems genuinely pleased. Their only request was that the new system must still be able to generate the exact same Excel spreadsheets they are used to receiving. This morning, I asked my AI to add an export button that produces those identical files. A few minutes later, I had a robust function that generates spreadsheets virtually indistinguishable from the originals. Are there bugs? Of course. But historically, the Excel spreadsheets had their own bugs and quirks. None of the issues in the new app are critical or could cause real damage. In the worst-case scenario, data could be lost or corrupted—yet the old Excel process was hardly safer, given how easy it is to accidentally overwrite or break formulas. “But Daniel, aren’t you a senior professor? Why are you building web apps?” Because I want to see, empirically and in the real world, what AI can actually do. We have several meetings this week. I’ll let you know how it turns out.

Nederlands
1
0
0
766
Daniel Lemire
Daniel Lemire@lemire·
How do you find new ideas? How do you make discoveries? One model is that a society that has a deep reverence for science will be a technological leader. In many countries, we have seen programs to promote 'STEM' (a political acronym for 'tech') as a way to spur a culture of technological innovation. I believe that it is almost entirely irrelevant. I believe a fundamental ingredient is curiosity within the right culture. My impression is that most people are not very curious. Not enough to start building a new piece of engineering in their (virtual) garage. And it may well not be a normal adaptation. After all, too much curiosity becomes a danger to yourself and others. But curiosity does not thrive anywhere. It needs what Toffler called 'Adhocracy': a culture that values innovation and adaptation. You may think that your culture is pro-innovation, but it is likely that it is not. Here is a question you may ask yourself... Do you rely on ad hoc teams or on rigid hierarchies? Adhocracy does not mean 'lack of hierarchy', but it means that hierarchies are dynamic, not rigid. In an adhocracy, Joe who arrived a month ago might end up leading the most important project of the organization... just because he happens to have the right skills and drive. There are boundaries, but they are flexible, they change, quickly. grokipedia.com/page/Adhocracy
Daniel Lemire tweet media
English
1
0
25
2.5K
Daniel Lemire
Daniel Lemire@lemire·
For years, my employer has required professors to fill out complicated Excel spreadsheets every year. After all, someone has to keep track of who teaches what and who is responsible for the students in each course. These Excel spreadsheets are incredibly complex. We use a wide range of metrics to measure each professor’s workload in the name of “fairness.” There are multiple spreadsheets, each containing several tabs. Why Excel? Probably because someone on the IT staff was (and still is) very good at it. Once we’ve all completed our forms, they are emailed to administrative staff, who then manually re-enter the data into the actual database. This year, we received the new forms on Thursday. By Friday morning, I had launched my AI with a simple prompt: “Take these spreadsheets and build a web app that does the same thing.” Within an hour, I had a fully functioning web application. It is far superior to the Excel version: it includes autosuggestions, autosave, the ability to synthesize data across all sections, and a much cleaner interface. That same day, I called a meeting with the department chair. He immediately agreed that this was the way forward. Over the weekend, I created a short video presentation and sent a link to the live, working app. Upper management seems genuinely pleased. Their only request was that the new system must still be able to generate the exact same Excel spreadsheets they are used to receiving. This morning, I asked my AI to add an export button that produces those identical files. A few minutes later, I had a robust function that generates spreadsheets virtually indistinguishable from the originals. Are there bugs? Of course. But historically, the Excel spreadsheets had their own bugs and quirks. None of the issues in the new app are critical or could cause real damage. In the worst-case scenario, data could be lost or corrupted—yet the old Excel process was hardly safer, given how easy it is to accidentally overwrite or break formulas. “But Daniel, aren’t you a senior professor? Why are you building web apps?” Because I want to see, empirically and in the real world, what AI can actually do. We have several meetings this week. I’ll let you know how it turns out.
Daniel Lemire tweet media
English
6
6
135
9.8K
Daniel Lemire
Daniel Lemire@lemire·
Book shack : progress report.
Daniel Lemire tweet media
English
1
0
25
2K
Daniel Lemire
Daniel Lemire@lemire·
@EricMauroSG Importantly, you need to move so as to have energy... and not let the busy work drain you.
English
1
0
0
528
Eric Mauro Stained Glass
Eric Mauro Stained Glass@EricMauroSG·
I probably do only 45 minutes of real artistic work a week. Most of the rest of my day is rote production work of some sort or administrative work with clients or general office work. As a sole proprietor I did all the production work and I became expert in everything about making stained glass windows, often through taking apart and rebuilding historic windows. The creativity then comes in very short bursts. The challenge is how to structure the rest of the time to support those bursts, and notice what I am doing with my rote work time that isn’t supporting the creativity, or is directing those bursts of energy into the wrong places, so I get insights into doing my taxes or something, instead of making new windows.
Daniel Lemire@lemire

How many productive hours can you actually work in a day? Time spent is almost always irrelevant, or at best secondary. Your brain is like a laptop constantly slipping into energy-saving mode. It’s easy to “work” for hours without ever fully engaging your mind in a productive way. Even when you do manage to focus, the output is highly uneven: you probably do your best work in short spikes of a few minutes. This means it’s entirely possible for someone to outwork you in a fraction of the time. Staying focused and energized is difficult. You can’t simply will it into existence. Does that mean you should cut your working hours? Not quite. The problem is that you can’t just sit around waiting for your brain to “turn on.” Nobody ever became a highly productive engineer by watching Netflix. What looks like unproductive time might simply be the necessary groundwork, the seeds, for later bursts of productivity. To answer my own question: you are probably only capable of being fully engaged for a few minutes per day, but it takes a lot of time and effort to create the conditions that allow those productive minutes to emerge.

English
1
1
3
819
GiganteMenguante
GiganteMenguante@GiganteMenguant·
@lemire Creo que sería importante empezar a cambiar totalmente los benchmarks para detectar aquellas IAs que se están entrenando especificamente para mejorar en esos benchmarks sus resultados anteriores, pero no porque intrínsecamente sean mejores... nos vamos llevar una sorpresa
Español
1
0
1
136
Daniel Lemire
Daniel Lemire@lemire·
We are now at the point where measuring the performance of AI is difficult. In more and more instances, AI reaches superhuman performance. Moreover the competition is fierce. For some time, OpenAI dominated. It has now been matched or surpassed. Currently, Anthropic is leading, but by a thin margin. There is no moat. Source: Stanford HAI
Daniel Lemire tweet mediaDaniel Lemire tweet media
English
6
1
23
4.5K
Maxime Chevalier
Maxime Chevalier@Love2Code·
@lemire Did you build this on your property for people who pass by? Very cool
English
1
0
3
875
Daniel Lemire
Daniel Lemire@lemire·
Progressively renovating the book shack
Daniel Lemire tweet mediaDaniel Lemire tweet media
English
2
1
36
3.3K
John McMillion
John McMillion@johnmcmillion·
There’s still this strange disconnect between AI being superhuman and super stupid at times. I spent over two hours on a video yesterday trying to tell AI how to make toast pop up in a toaster like a normal toaster, and it still couldn’t get it right. It took an hour just to get the start frame image of the two slices of toast lowered down into the toaster, along with the lever.
English
2
0
1
267
Hassan Abedi 📚🌿🦉🪬
@lemire It can have multiple reasons. For example, could keep employees on their toes, could feel good to do for a CEO, or could cut the costs, etc.
GIF
English
1
0
0
74
Daniel Lemire
Daniel Lemire@lemire·
Could anyone explain what Cloudflare is saying? They are cutting positions BECAUSE of its use of AI but not for cost cutting. Here is why I think CEOs of highly profitable companies will periodically fire a large fraction of their staff. Once you get beyond, say, 12 employees, then your workers are an opaque blob. You don’t know their names. You know some of them are useless, but you cannot find them. There is Michael who seems useless; reports indicate that he is not communicative. He shows up late to meetings. But if you fire Michael, you might find that he alone held together a critical system. But the blob tends to grow. If you only fire people for cause, you will have more and more staff—and possibly more and more useless people. It is not too bad if they are just useless, but deadwood often costs you more than just a salary. A single bad player can drain the energy of 12 other people. But no matter how smart you are as a CEO, you cannot tell, at scale, what is really happening. Knowledge is going to be distributed through many people. Unless you have a very strict meritocracy, useless people will get to build castles within your walls. If you have groups of people, like divisions, it is a tad easier. You might identify that this group is causing problems or is doing work that is less necessary. Even so, there might be great people even in bad groups. What do you do? So you do what our immune system does: you fire up inflammation and burn through the staff, firing a sizable fraction of them. You will, of course, fire good and bad people at the same time. However, you can later course-correct. If you fired Michael and things stop working, you can either rehire Michael or find a new Michael. OK, so that’s the classic theory behind these waves of firings. How does AI fit in? The only narrative that makes sense to me is that IA is cover for the immune system. --- « Hence, Prince insisted, the 20% cuts were not to reduce expenses but were strictly because of its use of AI. “Today’s actions are not a cost-cutting exercise or an assessment of individuals’ performance; they are about Cloudflare defining how a world-class, high-growth company operates and creates value in the agentic AI era,” Prince and Cloudflare co-founder and president, Michelle Zatlyn, wrote in a related blog post about the layoffs »
Daniel Lemire tweet media
English
3
0
34
6.5K