Michael Cafarella

The Great American AI Race. I wrote something about how we need a holistic AI effort from academia, industry, and the US government to have the best shot at a freer, better educated, and healthier world in AI. I’m a mega bull on the US and open source AI. Maybe we’re cooking something bigger… stay tuned or contact us.

A very cool, interesting new paper on how to orchestrate and optimize data processing tasks with LLMs

This project has been a ton of fun to work on. If you think it can solve a problem that's important to you, please get in touch!

Check out the paper, code on GitHub, and colab demo

@RussoMatthew This is a project we've been working on for some time, and which I think is really exciting. If you're doing AI or data work, I think it will be exciting to you, too

We’re excited to announce a pre-print and prototype system for Palimpzest: A Declarative System for Optimizing AI Workloads. Check out our full paper, blog post, and demo: - 📄Paper: arxiv.org/pdf/2405.14696 - 📬Blog Post: dsg.csail.mit.edu/projects/palim… - 💻Demo: bit.ly/pz-demo

@etzioni Oren: Happy birthday to the best advisor in the business!

I’ve been intrigued by the world of tools that automate what typically takes data practitioners days to weeks of error-prone/not-so-repeatable work. I call this space autodata, and wrote a blog post about it: blog.marcua.net/2021/02/07/aut…

@simonw @marcua Ten years ago I tried to work on a project for a smart data ingestor modeled partially after Kathleen Fisher et al's LearnPADS system. One challenge was that I couldn't build a good dictionary of schemas to match against. Would be worth another try

@marcua I'm hoping to add a schema type detection mechanism to sqlite-utils soon for CSV imports, would welcome thoughts on how that could best work github.com/simonw/sqlite-…

I love Election Day.

A photo is circulating online of Trump holding up the New York Post with Hunter Biden on the cover. A White House spokesman told CNN the photo is real. The alleged emails underpinning the NY Post stories may be part of a Russian disinformation campaign. cnn.com/2020/10/16/pol…

@infoxiao This would be great

Thinking if doing one pilot episode of Computational Social Science podcast. On the topic of cities and wfh. Let me know if you are interested!

This is a shame

Jerry Lawson (1940-2011), the developer of the first interchangeable cartridge video game console with a microprocessor, the Fairchild Channel F (1976). This console predated the Atari 2600 by one year!

Congrats! Very well deserved

Very proud that my student @jmfaleiro won this year's ACM SIGMOD Jim Gray award for the top PhD dissertation in the area of data systems. sigmod.org/sigmod-awards/… Jose's thesis focused on scalable, multi-core transaction processing.

Some of the cruelest things I’ve ever seen in print were in a female colleague’s course evaluation.

@bariskasikci If I recall correctly there was a big effort to fund tons of postdocs in wake of financial crisis faculty hiring crunch. We should do it again.

Academic hiring freezes are sad, but perhaps expected

Goodness. I ran the same trends query again. First image is from 11pm eastern on Thursday night. Second image is from 240pm eastern on Friday.

This seems concerning