Max Irwin

🚀 Announcing Mighty Inference Server! ☺️ Say goodbye to your NLP latency and cost pain. ⚡️ GPU speed on CPU, using our Rust webserver that works with many transformer models. Your models. Your stack. Your rules. Try it now! max.io

@OpenAI IT'S TERRIBLE. Look, I think ChatGPT is great and I'm a plus subscriber, but it's just an OK RAG on top of a web search engine (Bing API I think?). This isn't what a web search should be. The relevance is only bound to top 5, the UX is poor, and it's slow compared to web search.

🌐 Introducing ChatGPT search 🌐 ChatGPT can now search the web in a much better way than before so you get fast, timely answers with links to relevant web sources. openai.com/index/introduc…

@jobergum @turbopuffer I made a calculator a while ago that I use with clients and training. Here's a rough equivalent for hot (all vectors in RAM) using traditional compute, across various clouds/configs. The cost is on RAM and CPU, but I don't have numbers for QPS

People say that @turbopuffer is cheap, but as always with vector search, there are nuances and tradeoffs. If I understand the price model, it only rings true if you can pre-partition your data into namespaces or don't have queries ($1.5 per 1K queries). Here 10M vectors with 768 dims, 0 writes (immutable) and 10M reads for a month (4 queries/s), but only 1 namespace.

The year is 2027 and OpenAI just dropped AGI, but no one noticed because it was called gpt-5.5-o3-large2-preview-2027-09-06

Looking forward to seeing @CoPivotApp, @binarymax and Nikhil Shah from MARCIE app present tonight on AI and AI products! #startup #startupgrind #rochesterny #startupny startupgrind.com/events/details…

I'll never understand homebrew

@RiffTrax I thoroughly enjoyed this riff. Hadn't seen this movie since 1991 as a teen - and got a bit nostalgic. The visuals and soundtrack are mesmerizing. Roger Ebert gave it 3.5/4 stars! But the riffs were so good. I'll be ordering cold pizza for breakfast via BuseyEats tomorrow.

Thank you all SO MUCH for everyone who came out to see #RiffTraxLive Point Break tonight! We truly cannot do these shows without your support. If you can, catch it in theaters one more time this Tuesday, August 13th! rifftrax.com/pointbreaklive

My timeline today

@rossfledderjohn Nice overview. I made a similar framework and spoke about it in early 2023. linkedin.com/posts/maxirwin… ...while my first two levels are a bit different, I'd argue levels 4 and 5 are mostly unachievable, as they require complex social interactions.

The future of AI?

My reaction to the daily RAG solution pitch spam I get.

I don't post on twitter anymore (well except for this) but I lurk every week or so. Apparently it wants my birthdate or I'll lose access. If I get kicked out then so be it. Catch me on linkedin, email, or slack. ✌️

Taking bets as to whats going on here...

@RebeccaLeclair6 @evandawson Thanks for everything @evandawson it was a truly wonderful event. Looking forward to your show with Masum today. @RebeccaLeclair6 based on the praise and support we received, I think we'll have to do it again next year!

@evandawson @binarymax Can you do this again next year?

I’m an AI skeptic. But I very much want to stay out front and keep learning. Tomorrow I’m taking a day off work to attend an inaugural Rochester AI conference. The organizer, @binarymax , is the kind of thoughtful person I hope can lead us into the AI future. 1)

Thrilled to announce that @evandawson will be the emcee for next week's flowercity.ai conference. There's some amazing talent coming and sharing their work and passion. Going to be something amazing that Rochester's never seen before.

I have no idea.

🎉 Flower City AI - the local Rochester NY community AI conference - is out of stealth! This is a not-for-profit community event on December 6th showcasing AI tech in Rochester. Tickets cover the cost of the event, and students attend free. flowercity.ai

Big thanks to all the listeners and supporters! Many of you reached out to say thank you for the podcast and some of your became guests. Stay tuned for the new episodes :)

FYI, we've just renamed the default branch from 𝘮𝘢𝘴𝘵𝘦𝘳 to 𝘮𝘢𝘪𝘯 for github.com/treygrainger/a…. You can run the following to quickly update a previously pulled repo: git branch -m master main git fetch origin git branch -u origin/main main git remote set-head origin -a