Sabitlenmiş Tweet
I made AgentIR: a scheduler for distributed LLM serving that makes agent workloads run much faster.
41.3% lower E2E latency, and up to 70% higher throughput
English
Krish Modi
187 posts
Krish Modi
@krishmodi404
@uwaterloo se, incoming @palantirtech, prev @bloomberg, @Huawei, ISEF
Sarnia ON Katılım Şubat 2022
439 Takip Edilen669 Takipçiler
turned 21 today
big year ahead:
> joining @PalantirTech in NYC
> built the fastest scheduler for LLM requests
> launching something in the next couple days to make all agent systems run faster and cheaper
couldn’t be more excited for what’s next
English
@ConnorKowallo this is pretty cool. are there tools like this alr?
English
don't get me wrong, i love building startups
but every time i'm about to launch, i get a little heart attack that i missed an important bug
that's why i made gauntlet :)
just drop your url and get a swarm of 12 ai agents to battle test your app before your users do
English
There was a time when the only reason I knew waterloo for was that one war
Now I see some insanity every day or two popping out of there
Krish Modi@krishmodi404
turned 21 today big year ahead: > joining @PalantirTech in NYC > built the fastest scheduler for LLM requests > launching something in the next couple days to make all agent systems run faster and cheaper couldn’t be more excited for what’s next
English
> cracked profile
> looks inside
> uwaterloo
Every fucking time
Krish Modi@krishmodi404
turned 21 today big year ahead: > joining @PalantirTech in NYC > built the fastest scheduler for LLM requests > launching something in the next couple days to make all agent systems run faster and cheaper couldn’t be more excited for what’s next
English
planning to deep dive OPD, seems like a lot of interesting research recently! what are the best reads?
English
@krishmodi404 @PalantirTech hey Krish , all this sound facinating, would love to talk about it more with you.
English
@krishmodi404 @PalantirTech Congrats dude, the first person from tpot to work in palantir 😭🤣
English
@krishmodi404 @PalantirTech happy birthday !
congrats btw
English
