Kai Huang

138 posts

Kai Huang banner
Kai Huang

Kai Huang

@KaiHuang

Head of Product @parasail_io. Prev @hyperbolic_labs

San Francisco, CA Katılım Mayıs 2008
413 Takip Edilen404 Takipçiler
Kai Huang retweetledi
Parasail
Parasail@parasail_io·
We’re excited to partner with @dMatrix_AI and @nvidia to deliver up to 10x faster interactive token generation. “Parasail is proving what we’ve believed from the start: the future of inference is heterogeneous,” said @sidsheth, founder and CEO of d-Matrix. By deploying Corsair alongside their NVIDIA fleet, Parasail is embracing a heterogeneous inference approach designed to optimize each phase of the workload across multiple accelerators.” D-Matrix’s incredibly fast SRAM-based inference and NVIDIA’s willingness to collaborate and open up their system makes this all possible. Link in thread.
Parasail tweet media
English
1
4
16
9.9K
Kai Huang
Kai Huang@KaiHuang·
The models are improving at too rapid a pace to make it a worthy investment. You might as well give it as little context as possible and let the model figure out the right thing to do things.
English
0
0
2
41
Kai Huang
Kai Huang@KaiHuang·
I just spent a couple days configuring pi for subagents orchestration and everything and the thing that I realized is that the less context bloat you give good models, the better you do. I believe the future is going to be harness engineering but not yet. It’s too early.
English
1
0
3
47
Kai Huang
Kai Huang@KaiHuang·
@Yuchenj_UW @ClementDelangue The fact that it’s close and significantly cheaper is insane. In the medium term everyone’s going to have to figure out how to extract the most value out of their tokens. The thing I’m scared about the open source labs blocking their models
English
1
0
2
209
Yuchen Jin
Yuchen Jin@Yuchenj_UW·
After using GLM-5.2 for a day, I’m surprised by how often it feels close to Opus 4.8/GPT-5.5 level. I compared it side by side with Opus 4.8, and sometimes I even preferred GLM-5.2’s results. OSS LLMs are impressive, especially given how many fewer GPUs they were trained on.
English
69
59
1.2K
119.6K
Kai Huang
Kai Huang@KaiHuang·
Fable 5 is great and all but I’m just hyped that Apple seems to finally have made Siri good. All I’ve ever wanted
English
1
0
3
166
Kai Huang
Kai Huang@KaiHuang·
@Yuchenj_UW Not true. As long as you use your own apps, you now have 67 users, not bad
English
0
0
3
177
Yuchen Jin
Yuchen Jin@Yuchenj_UW·
Before AI, I’d spend a weekend building 1 useless app. Now I can build 67 useless apps over a weekend, each with a logo, a fancy webpage, and 0 user.
English
424
547
8.2K
268.7K
Kai Huang
Kai Huang@KaiHuang·
@packyM Kiplimo ran a 2:00:28 and got third, insane
English
0
0
0
24
Yuchen Jin
Yuchen Jin@Yuchenj_UW·
Life update: I joined Databricks this week! I thought I’d do another startup after Hyperbolic, but I was surprised by how startup-y Databricks AI is. @alighodsi, @pwendell, @matei_zaharia are in full founder mode. They’re the best founders I’ve met. I like working with people who aren’t “normal” and they definitely aren’t. For example, they invited me to an all-hands before I joined. I’m also impressed by how many former founders are here. @akhilgupta and @hanlintang are incredible leaders. A big bonus: I finally have unlimited Claude Code & Codex tokens! AI adoption on the Databricks AI team is insanely high. Every engineer I’ve met uses AI heavily and shares their own ways to drive agents. Many talented people here. I’m super pumped for this new journey!
English
154
36
1.6K
142.1K
Kai Huang
Kai Huang@KaiHuang·
@Yuchenj_UW This is equivalent to judging PMs by how many pages of PRDs are written
English
0
0
0
12
Yuchen Jin
Yuchen Jin@Yuchenj_UW·
The dumbest way to evaluate engineers today is by counting lines of code.
English
127
22
561
66.8K
Yuchen Jin
Yuchen Jin@Yuchenj_UW·
hey friends! 👋 Only cool people are allowed to reply to this tweet obviously.
English
259
3
477
49.8K
Yuchen Jin
Yuchen Jin@Yuchenj_UW·
The wild thing about the Bay Area right now: Every Chinese restaurant I go to, the next table is debating: > “Claude Code vs. Codex” > “OpenAI vs Anthropic vs Google vs xAI, who will win” > “Is OpenClaw hype or real?” I just want to enjoy my meal… but I really couldn’t.
English
87
19
628
51.8K
Kai Huang
Kai Huang@KaiHuang·
Saying “Hey, Siri” is like time traveling back a decade. How is Apple dropping the ball so hard on AI
English
0
0
7
136
Kai Huang
Kai Huang@KaiHuang·
@Yuchenj_UW You got me up to speed and taught me the ins and outs of this industry. Will always be grateful for that. I'm excited to see what you work on next and the massive impact you'll be making. Godspeed.
English
1
0
12
3.6K
Yuchen Jin
Yuchen Jin@Yuchenj_UW·
I have decided to step down as CTO at Hyperbolic. Leaving a company you co-founded and poured your heart into is not easy. So many moments still feel vivid: launching our AI inference product for open-source models and seeing tens of thousands of developers sign up in a week; the week we were hit by a massive DDoS attack and the entire engineering team fought around the clock until we won; the day we launched the GPU platform and watched ARR take off. There were also hard moments. That’s the nature of building a startup. I’m grateful for all of it. What I’m most grateful for is the team. Thank you for your trust. Most startups never build something people want. I believe we did. You should be proud of yourselves. I will look forward to seeing your success. What’s next for me? I’m still figuring it out. I believe this is the most extraordinary moment in human history. We’re standing at the edge of the Singularity. AI will reshape everything, and I still feel the same excitement I felt when I first fell in love with AI. Time to start over. Time to climb another mountain. Thank you to everyone who has been part of the journey, — Yuchen
English
241
34
1.5K
184.4K
Kai Huang
Kai Huang@KaiHuang·
@Yuchenj_UW We're going to see a huge number of companies from small teams. We might be a little ways away from a 1 man billion dollar company, but we're not too far off from 1 man 10-100M companies
English
1
0
5
449
Yuchen Jin
Yuchen Jin@Yuchenj_UW·
4000 jobs got replaced by AI. Smaller, flatter teams powered by AI are the future. I hope these AI-driven layoffs unleash a wave of new companies and creativity. Otherwise, we’d better figure out UBI.
Yuchen Jin tweet media
jack@jack

we're making @blocks smaller today. here's my note to the company. #### today we're making one of the hardest decisions in the history of our company: we're reducing our organization by nearly half, from over 10,000 people to just under 6,000. that means over 4,000 of you are being asked to leave or entering into consultation. i'll be straight about what's happening, why, and what it means for everyone. first off, if you're one of the people affected, you'll receive your salary for 20 weeks + 1 week per year of tenure, equity vested through the end of may, 6 months of health care, your corporate devices, and $5,000 to put toward whatever you need to help you in this transition (if you’re outside the U.S. you’ll receive similar support but exact details are going to vary based on local requirements). i want you to know that before anything else. everyone will be notified today, whether you're being asked to leave, entering consultation, or asked to stay. we're not making this decision because we're in trouble. our business is strong. gross profit continues to grow, we continue to serve more and more customers, and profitability is improving. but something has changed. we're already seeing that the intelligence tools we’re creating and using, paired with smaller and flatter teams, are enabling a new way of working which fundamentally changes what it means to build and run a company. and that's accelerating rapidly. i had two options: cut gradually over months or years as this shift plays out, or be honest about where we are and act on it now. i chose the latter. repeated rounds of cuts are destructive to morale, to focus, and to the trust that customers and shareholders place in our ability to lead. i'd rather take a hard, clear action now and build from a position we believe in than manage a slow reduction of people toward the same outcome. a smaller company also gives us the space to grow our business the right way, on our own terms, instead of constantly reacting to market pressures. a decision at this scale carries risk. but so does standing still. we've done a full review to determine the roles and people we require to reliably grow the business from here, and we've pressure-tested those decisions from multiple angles. i accept that we may have gotten some of them wrong, and we've built in flexibility to account for that, and do the right thing for our customers. we're not going to just disappear people from slack and email and pretend they were never here. communication channels will stay open through thursday evening (pacific) so everyone can say goodbye properly, and share whatever you wish. i'll also be hosting a live video session to thank everyone at 3:35pm pacific. i know doing it this way might feel awkward. i'd rather it feel awkward and human than efficient and cold. to those of you leaving…i’m grateful for you, and i’m sorry to put you through this. you built what this company is today. that's a fact that i'll honor forever. this decision is not a reflection of what you contributed. you will be a great contributor to any organization going forward. to those staying…i made this decision, and i'll own it. what i'm asking of you is to build with me. we're going to build this company with intelligence at the core of everything we do. how we work, how we create, how we serve our customers. our customers will feel this shift too, and we're going to help them navigate it: towards a future where they can build their own features directly, composed of our capabilities and served through our interfaces. that's what i'm focused on now. expect a note from me tomorrow. jack

English
59
19
293
65K
Yuchen Jin
Yuchen Jin@Yuchenj_UW·
The Anthropic vs. OpenAI Super Bowl ads tonight are going to feel like Kendrick vs. Drake beef for tech bros, while most of the fans in the stadium will be so confused.
OpenAI@OpenAI

You can just build things.

English
33
23
710
57.2K
Kai Huang
Kai Huang@KaiHuang·
@Yuchenj_UW Use opencode with the same subagents and rules and you can test both models side by side, or mix and match depending on the output
English
0
0
0
20
Yuchen Jin
Yuchen Jin@Yuchenj_UW·
Is Codex actually ahead of Claude Code now??? I tried Codex yesterday while doing some training optimizations on Andrej’s nanochat. It has worse UI, ran my code in a CPU-only sandbox despite I have GPUs. It feels less agentic than Claude Code for sure. Sonnet 5, I'm still patiently waiting for you...
Yuchen Jin tweet media
English
180
18
719
169.8K
Kai Huang
Kai Huang@KaiHuang·
This is why product builders need to think about how AI shows up in their products. The problem is users can't tell when AI is making them worse off. If you're building AI products, your job isn't just giving users what they ask for. Sometimes you need to push back, ask clarifying questions, or build products in a way that encourage people to actually think through what they want. Good product design means guiding people toward better decisions instead of always giving them what they think they want.
English
0
0
6
655
Anthropic
Anthropic@AnthropicAI·
New Anthropic Research: Disempowerment patterns in real-world AI assistant interactions. As AI becomes embedded in daily life, one risk is it can distort rather than inform—shaping beliefs, values, or actions in ways users may later regret. Read more: anthropic.com/research/disem…
English
201
340
1.9K
828K
Kai Huang
Kai Huang@KaiHuang·
All this talk about security concerns with Molt(Clawd)bot. All you have to do is run multiple instances with separate. Example for my home automation when I say "open my garage": 1. Manager bot - creates subtasks and divvies them out 2. Trust bot - uses speech pattern recognition to make sure I'm the one who sent the request 3. Environment bot - searches environmental factors to determine if it's safe to go outside 4. Garage bot - controls the garage door Total cost to open door: ~$70, but worth it
English
0
0
3
411