Sabitlenmiş Tweet
Omar Kilani
647 posts
Omar Kilani
@omarkilani
vibes @nvidia, ex-vibes @groqinc. you can just do things enthusiast.
San Francisco, CA Katılım Mart 2007
892 Takip Edilen1.5K Takipçiler
NVIDIA has moved incredibly fast. Today everyone woke up to codex pre-installed on every device. The shocking part is that knowledge workers are the fastest group to onboard, with Sales and PR being the top categories.
Sam Altman@sama
We tried a new thing with NVIDIA to roll out Codex across a whole company and it was awesome to see it work. Let us know if you'd like to do it at your company!
English
Omar Kilani retweetledi
Omar Kilani retweetledi
@JeffDean Turned this into an agent skill: github.com/omarkilani/per…
English
Performance Hints
Over the years, my colleague Sanjay Ghemawat and I have done a fair bit of diving into performance tuning of various pieces of code. We wrote an internal Performance Hints document a couple of years ago as a way of identifying some general principles and we've recently published a version of it externally.
We'd love any feedback you might have!
Read the full doc at: abseil.io/fast/hints.html
English
Never seen more glorious words
Groq Inc@GroqInc
Spotted in a Groq onboarding doc 👀 (we're hiring)
English
Petition to make the standard meeting length 15 minutes
English
I'm very excited to share that @FireworksAI_HQ has raised $250M in Series C funding co-led by @lightspeedvp and @IndexVentures , and participation from @sequoia Capital and @EvanticCapital, bringing up valuation to $4 billion. In total, we raised $327M from prior rounds led by @benchmark and @sequoia, with participation of strategic investors including @nvidia , @AMD , @databricks, @MongoDB , and many angel investors.
When we founded Fireworks in 2022, the vision was simple, but the problem was complex: give builders the speed, cost, and control they need to win. Our mission is to reach Artificial Autonomous Intelligence – automated product and model co-development to reach maximum quality, speed and cost-efficiency using generative AI. This round propels our execution to expand our current product of tuning and inference platform towards Artificial Autonomous Intelligence.
↗️ We have onboarded hundreds of thousands of developers to customize the latest models to create unique applications and impactful user experiences. 10x from Series B.
↗️ 10K+ organizations are running on Fireworks. Companies including Notion, Shopify, Uber, GenSpark, Vercel have built and scaled on Fireworks.
↗️ We process more than 10 trillion tokens daily. More than 20x from Series B.
We will use the new funding in the following investment:
📖 Deepen our research in post-training and inference alignment to maximize quality, speed and cost efficiency of computation, including R&D in system research and algorithmic research.
🛠️ Expand our product towards a comprehensive tool-chain for the new user experience creation lifecycle, centered around product and model co-design and automation, from model evaluation, reinforcement learning to ultra fast inference engine.
🌎 Grow our computation footprints 3x higher in the next one year, and continue R&D to minimize computational cost and maximize system utilization.
This round is not just evidence that our bet three years ago is driving a big impact, it's concrete proof of the trust and commitment we've built with our customers, partners, and our community.
Join our mission to build Artificial Autonomous Intelligence fireworks.ai/careers
English
me when a new model drops and benchmarks claim better X, Y, and Z
English
The Production Engineering team at @GroqInc is looking for engineers to scale and operate our global chip-to-cloud, mission-critical AI inference platform.
Own reliability from LPU silicon to global runtime: every nanosecond counts. ⚡️
Apply today: jobs.gem.com/groq/am9icG9zd…
English
The Tiny TPU team (@evanliin, @XanderChin, @suryasure05 and @kennykgguo) are absolute legends.
Insanely excited to have them join the @GroqInc team. 🚀
surya@suryasure05
I just wrapped up what will probably be the MOST memorable summer of my life. tldr: built a cool project and ended up joining @GroqInc to work on distributed systems. here's a timeline of everything that happened in the last ~6 months: > feb 24: @evanliin explains to me (having no ml/hw background) how a systolic array works > march - april: I learn hardware design basics and make some small projects > may 8: @evanliin calls me and @XanderChin and says we should live together for a month and see what we cook up > may 12: we start living together in toronto and decide to build a toy tpu that does inference and training > may 20: we get inference fully working > may 21 - june 12: continue chipping away at getting training working > june 13: all of us go to sf for yc sus and meet @kennykgguo who ended up joining us > june 19: we visit an up and coming ml asic startup and talk to some really smart engineers > june 20 - august 4: continue working on training > august 5: see @karpathy's challenge about building an educational resource on a unique topic so we decide to finish tinytpu and push out our article in 2 weeks > august 10 - august 16: spend half of my time working on the tinytpu article while on an alaska cruise (top tier experience btw) > august 17: flight back to ottawa gets cancelled by air canada strikes so I decide to go to sf > august 18: make the tinytpu tweet before getting on my flight and noticing that it blew up after I got off my flight (also @karpathy gave us a shoutout!!!) > august 19: get dms from @omarkilani and @JonathanRoss321 about working for @GroqInc > august 21: have lunch with @omarkilani who basically gives us all a verbal offer > august 22: visit the @GroqInc hardware lab and meet @GavinSherry and @jwswj > august 27: meet @JonathanRoss321 to talk about the tpu and he gives us our offer letters in person > sept 22: first day at @GroqInc truly, everything that happened in the last two weeks was straight out of a movie and I am still processing it. I cannot be more grateful to everyone we met from @GroqInc for betting on us and bringing us on. I have a lot more thoughts on everything which I plan to write a blog post about, but my one biggest takeaway and the driving principle of everything that's happened is that you can just do things.
English
@vbingliu Much needed eval. 🫡
Were GPT-5 and Opus 4.1 run with “default” reasoning effort?
(May have missed this in the paper.)
English
Great write up of some difficult root causing.
Running LLMs (especially on custom stacks, compilers, etc) and putting them on the internet turns out to be one of hard problems in computer science.
Huge respect to the teams in the trenches keeping it all running day after day.
Claude@claudeai
In our investigation, we uncovered three separate bugs. They were partly overlapping, making diagnosis even trickier. We've now resolved all three bugs and written a technical report on what happened, which you can find here: anthropic.com/engineering/a-…
English
