Andrew Hinh

244 posts

Andrew Hinh banner
Andrew Hinh

Andrew Hinh

@ajhinh

devrel @modal

San Francisco Katılım Haziran 2022
349 Takip Edilen123 Takipçiler
Sabitlenmiş Tweet
Andrew Hinh
Andrew Hinh@ajhinh·
After graduating this weekend, I'll be joining @modal as a Developer Relations Engineer! I want to describe how I got here, as my path was rather unconventional. My first "connection" to Modal was back in 2022: after graduating high school, I took @charles_irl's Full Stack Deep Learning course, where I created admirer, a flavor of a VLM powered by AWS Lambda and GPT-3 (for those who remember!). I suppose my age and being a one-person team left an impression on him, and we continued to stay in touch. When he discovered Modal, I quickly became a user and found it just so delightful and easy to use. Plus, the free $30/month was more than enough for personal projects and experimentation, and I was always telling others to try it out. In fact, during a summer internship at an edtech startup, I helped secure a $5000 grant that allowed us to switch from to Modal for our fine-tuning and deployment jobs. Last summer, Charles unexpectedly offered an internship on the growth team, where I was initially uncertain how I'd use my full-stack ML experience at an infrastructure company. As it turned out, quite nicely: while contributing to the wide-ranging (and actually helpful!) set of examples (modal.com/docs/examples), I quickly saw that a sufficiently useful and captivating example empowered devs to take the next step. Soon after, I was tasked with showing how to mesh together RL, LLMs, and Modal Sandboxes. After a weekend or two of experimentation, I came up with a web demo of Street Fighter III where you could play against an RL-trained Qwen 3-8B (btw, you can try it out here: andrewhinh--sf3.modal.run). The most fun part for me, besides getting it to work as well as it did, was seeing the joy and excitement from the team. What makes me so excited to rejoin is that, really, I'm just continuing where I left off last summer to spread the good word about Modal. I can't thank Charles, @bernhardsson, @akshat_b, and the team at Modal enough for the opportunity to do so. Stay tuned for more!
Andrew Hinh tweet media
English
10
5
100
12.9K
Andrew Hinh retweetledi
joy liu
joy liu@qjoyliu·
the best view is the one on our laptop screen 🔒🔒🔒
joy liu tweet media
English
0
1
14
764
Andrew Hinh retweetledi
Andrew Hinh retweetledi
lily zhang
lily zhang@lily_gpupoor·
. @monishee @modal knows how to serve inference and party. congrats on closing the series c!
lily zhang tweet medialily zhang tweet medialily zhang tweet medialily zhang tweet media
English
2
2
16
1.9K
Andrew Hinh retweetledi
can
can@can·
the new auto endpoints look simple b/c they absorb a lot of the complexity and hide it from you to make them fast. and now, you can use those building blocks for your own apps on @modal !
can tweet media
Modal@modal

Our new Auto Endpoints feature is powered by a new Modal primitive: Modal Servers. In this blogpost, we walk through design principles and detailed architecture: @EnvoyProxy, @googlecloud Spanner config store, and a @Cloudflare Pingora-based custom proxy.

English
2
4
28
5.1K
Andrew Hinh retweetledi
Emily Han
Emily Han@emilyhanyf·
“Each component of the system (after the AWS NLB) is an HTTP server, and so they must return a response to… the original client. The whole process completes in 5-7ms… All of the work described above can be done faster than a neural impulse can travel down your leg.” the team’s been cooking, and the secret sauce is here:
Modal@modal

Our new Auto Endpoints feature is powered by a new Modal primitive: Modal Servers. In this blogpost, we walk through design principles and detailed architecture: @EnvoyProxy, @googlecloud Spanner config store, and a @Cloudflare Pingora-based custom proxy.

English
2
2
24
2.8K
Andrew Hinh retweetledi
Akshat Bubna
Akshat Bubna@akshat_b·
For @modal endpoints, we had to build our own routing and proxy layer. We're making this primitive generally available as `app.server()` — deploy any server code for low-latency, high throughput serving. Same fast cold start times.
Akshat Bubna tweet media
Modal@modal

Our new Auto Endpoints feature is powered by a new Modal primitive: Modal Servers. In this blogpost, we walk through design principles and detailed architecture: @EnvoyProxy, @googlecloud Spanner config store, and a @Cloudflare Pingora-based custom proxy.

English
3
5
77
6.5K
Andrew Hinh retweetledi
Peyton Walters
Peyton Walters@peywalt·
My favorite bit is we built this for real-time inference, but it's paying off everywhere. Now, regular web servers are drastically more performant on Modal across the board. Very Modal to build strong, generalizable primitives that benefit all our users.
Modal@modal

Our new Auto Endpoints feature is powered by a new Modal primitive: Modal Servers. In this blogpost, we walk through design principles and detailed architecture: @EnvoyProxy, @googlecloud Spanner config store, and a @Cloudflare Pingora-based custom proxy.

English
3
2
31
2.6K
Andrew Hinh retweetledi
Charles 🎉 Frye
Charles 🎉 Frye@charles_irl·
Modal Servers deliver 6x faster responses than classic Modal Web Functions. We've used them to support world-wide inference services at world-class latency. Excited to finally share how they work -- not least because I personally learned a lot about networking from this project!
Charles 🎉 Frye tweet media
Modal@modal

Our new Auto Endpoints feature is powered by a new Modal primitive: Modal Servers. In this blogpost, we walk through design principles and detailed architecture: @EnvoyProxy, @googlecloud Spanner config store, and a @Cloudflare Pingora-based custom proxy.

English
3
4
73
6.7K
Andrew Hinh retweetledi
Modal
Modal@modal·
Our new Auto Endpoints feature is powered by a new Modal primitive: Modal Servers. In this blogpost, we walk through design principles and detailed architecture: @EnvoyProxy, @googlecloud Spanner config store, and a @Cloudflare Pingora-based custom proxy.
English
4
11
81
35.6K
Andrew Hinh retweetledi
Alec Powell
Alec Powell@alecpowell·
things move so fast at @modal that just last week we were hand packing invites and tomorrow we get to celebrate with our favorite builders in SF
Alec Powell tweet media
English
1
1
16
6K
Andrew Hinh retweetledi
Monishee Matin
Monishee Matin@monishee·
Not all heroes wear capes. Some guard a glass box so their human can finish her calls in a crowded office
Monishee Matin tweet mediaMonishee Matin tweet media
English
2
1
10
871
Andrew Hinh retweetledi