Jihui Yang

215 posts

Jihui Yang banner
Jihui Yang

Jihui Yang

@alsiens

feel the AGI

Katılım Temmuz 2012
374 Takip Edilen2.1K Takipçiler
Juntang Zhuang
Juntang Zhuang@archanfel_anoth·
I left xAI earlier this year after two incredible years. I joined still early in my career, and had the privilege of meeting many great people and friends along the way. Over time, I ended up leading pretraining across architecture, training, and parts of infra, and later led major RL runs for Coding. Together, we pushed forward generation after generation without missing a beat. None of this would have been possible without the fantastic team. Grateful for my team and friends —their talent and dedication made this possible. Working through hard problems together was the most rewarding part of the journey, and I’ll miss it deeply. It’s hard to walk away from people you’ve spent years building with. But I’m proud of everything we built together, and ready for the next chapter.
English
59
6
472
43.1K
heiner
heiner@HeinrichKuttler·
@pranjalssh I must have bamboozled both ChatGPT and Claude to give me A with high confidence. No matter, the test is a joke otherwise.
English
2
0
2
420
heiner
heiner@HeinrichKuttler·
Finally doing my CA driver license. Guess: When is it permitted to drive across double solid yellow lines? A When making a U-turn or left turn. B When the road is clear to pass the vehicle in front of you. C When instructed by construction or other signs due to a road closure.
English
7
1
32
11.5K
Jihui Yang
Jihui Yang@alsiens·
🚀🚀🚀
RadixArk@radixark

Today, we are thrilled to officially launch RadixArk with $100M in Seed funding at a $400M valuation. The round was led by @Accel and co-led by @sparkcapital. RadixArk exists to make frontier AI infrastructure open and accessible to everyone. Today, the systems behind the most capable AI models are concentrated in a small number of companies. As a result, most AI teams are forced to rebuild training and inference stacks from scratch, duplicating the same infrastructure work instead of focusing on new models, products, and ideas. RadixArk was founded to change that. We are building an AI platform that makes it easier for teams to train and serve the best models at scale. RadixArk comes from the open-source community. We started with SGLang, where many of us are core developers and maintainers, and expanded our work to Miles for large-scale RL and post-training. We will continue contributing to both projects and working with the community to make them the strongest open-source infrastructure foundations for frontier AI. We would like to thank our long-term partners, contributors, and the broader SGLang community for believing in this mission. We're also grateful to @Accel and @sparkcapital, NVentures (Venture capital arm of @nvidia), Salience Capital, A&E Investment, @HOFCapital, @walden_catalyst, @AMD, LDVP, WTT Fubon Family, @MediaTek, Vocal Ventures, @Sky9Capital and our angel investors @ibab, @LipBuTan1, Hock Tan, @johnschulman2, @soumithchintala, @lilianweng, @oliveur, @Thom_Wolf, @LiamFedus, @robertnishihara, @ericzelikman, @OfficialLoganK, and @multiply_matrix among others. Thanks for the exclusive interview with @MeghanBobrowsky at @WSJ about our vision.

ART
0
1
4
391
Byron Hsu
Byron Hsu@hsu_byron·
After 1 year at @xai, I'm joining @periodiclabs to build the RL system for atoms. xAI was a once-in-a-lifetime experience: building the inference stack at megascale from zero, countless late-night debugging sessions, endless memes and Slackmojis with the team. I'm deeply grateful for the trust xAI leaders (@lm_zheng @ying11231 @Guodzh @makro_ai) placed in me, and for the incredible people I got to build alongside. AGI really is the friends we made along the way. Digital AI has come incredibly far, and I have no doubt physical AI will go through the same revolution, starting from the fundamentals: atoms and labs. Born and raised in Taiwan, I deeply understand how transformative materials are to technology — and how much is still left to explore. Periodic Labs has an unmatched combination of elite scientists and research engineers, tackling one of the most ambitious problems out there. I'll be focused on building the world's first and best RL system for atoms. So excited to work with @LiamFedus @ekindogus @AnjneyMidha to build a better future for humanity! Bonus: we'll be building on a lot of open source technology and contributing back generously — feels incredible to be back in the OSS community again.
Byron Hsu tweet media
English
68
24
821
205.4K
Jihui Yang retweetledi
Ying Sheng
Ying Sheng@ying11231·
Deepseek V4. This is the most comprehensive day 0 support I have ever experienced. Rich SGLang features including hierarchical caching for sparse attention and Miles support for RL. Enjoy 🥰
LMSYS Org@lmsysorg

DeepSeek V4 by @deepseek_ai just dropped! SGLang is ready on Day 0 with a full stack of optimizations from architectures to low-level kernels. We also deliver a verified RL training pipeline in Miles (by @radixark) for V4 at launch: 1️⃣ Native "ShadowRadix" Design: DeepSeek V4's hybrid attention is complex. Our new ShadowRadix engine is the first to provide native prefix caching for SWA and compressed KV pools, making 1M+ context retrieval seamless and memory-efficient. 2️⃣ High-Performance Kernels: - Flash Compressor: IO-aware fused kernels, 10x faster than naive implementations. - Lightning TopK: High-speed indexing for 1M context in just 15µs. - Integrate FlashInfer trtllm-gen MoE, FlashMLA, and MegaMoE kernels 3️⃣ Rich Features: Speculative decoding, HiSparse, Attention DP/TP/CP and MoE TP/EP, and multi-platform support 4️⃣ Verified RL: The open-source RL pipeline: full parallelism (DP/TP/EP/PP/CP), tilelang kernels, tensor-level checked precision, verified with growing reward. Get started immediately with our out-of-the-box Cookbook 👇 Enjoy! #DeepSeekV4 #SGLang #LLM

English
7
27
337
27.3K
Jihui Yang retweetledi
Lianmin Zheng
Lianmin Zheng@lm_zheng·
DeepSeek V4 is out. The SGLang OSS and @radixark teams acted so fast with comprehensive inference optimizations. They even made e2e RL work on Day0! 🚀
LMSYS Org@lmsysorg

DeepSeek V4 by @deepseek_ai just dropped! SGLang is ready on Day 0 with a full stack of optimizations from architectures to low-level kernels. We also deliver a verified RL training pipeline in Miles (by @radixark) for V4 at launch: 1️⃣ Native "ShadowRadix" Design: DeepSeek V4's hybrid attention is complex. Our new ShadowRadix engine is the first to provide native prefix caching for SWA and compressed KV pools, making 1M+ context retrieval seamless and memory-efficient. 2️⃣ High-Performance Kernels: - Flash Compressor: IO-aware fused kernels, 10x faster than naive implementations. - Lightning TopK: High-speed indexing for 1M context in just 15µs. - Integrate FlashInfer trtllm-gen MoE, FlashMLA, and MegaMoE kernels 3️⃣ Rich Features: Speculative decoding, HiSparse, Attention DP/TP/CP and MoE TP/EP, and multi-platform support 4️⃣ Verified RL: The open-source RL pipeline: full parallelism (DP/TP/EP/PP/CP), tilelang kernels, tensor-level checked precision, verified with growing reward. Get started immediately with our out-of-the-box Cookbook 👇 Enjoy! #DeepSeekV4 #SGLang #LLM

English
2
11
123
9.5K
heiner
heiner@HeinrichKuttler·
Update on the below: 9 months later we're expecting our third child any day now. I decided to focus on my family for a while. Leading Supercomputing at @xai will remain the honor of my life. Thank you @elonmusk for the opportunity. We will win.
heiner@HeinrichKuttler

me trying for kid no. 3:

English
79
4
551
46.4K
Scott Fitzgerald
Scott Fitzgerald@BigFitzEnergy·
Today was my last day at @xai First, I want to thank all the incredible people I worked alongside. This past year has been one of the most memorable of my life, and I’m deeply grateful for it. To my team - I’m really proud of everything we accomplished together and how hard you worked to build one of the best voice experiences available. I’m confident you’ll continue to crush it. To all the friends I made during my time at xAI, I’ll truly miss you. One of xAI’s greatest strengths has always been the incredible camaraderie among everyone here. Saying goodbye to that, and to all of you, is the hardest part. I hope we stay in touch. So long, and thanks for all the fish.
English
46
4
442
38.9K
Alex Chen
Alex Chen@chenchen·
Asking my math major friend which wisdom teeth he had removed:
Alex Chen tweet media
English
9
1
9
1.4K
Ebby Amir
Ebby Amir@ebbyamir·
Today was my last day at @xAI. My mission here was to introduce Grok to the world by helping create an inspiring brand, build beautiful products, launch the best voice mode, and most importantly grow the incredible team that made it all happen. These past two years have been exhilarating, gratifying, and unforgettable – we achieved the impossible again and again, with the most talented and dedicated people I’ve ever worked with. To @elonmusk, thank you for the opportunity, the mentorship, and the adventure of a lifetime – it’s been an honor. To the team, I’ll be rooting for you and can’t wait to see what you accomplish next. As xAI begins its next chapter, I’m ready for a new one as well. I’m excited to spend some time seeking new inspirations, reflecting on what I’ve learned, and exploring what comes next.
English
174
38
1.4K
119.2K
Jaime Alonso
Jaime Alonso@JaimeAlns·
It’s one of those: today was my last day at @xAI. xAI has been a tremendous formative experience for me, building the API, Grok.com, and everything in between, it’s been crazy and hectic, but overall amazing. I’m especially grateful to everyone I’ve worked with, @TobyPhln and the team in London, you’re the most talented team I’ve ever worked with. I’ll be cheering from the sidelines, really excited to see what the xAI team is going to come up with next!
English
37
1
316
18.7K
heiner
heiner@HeinrichKuttler·
my phone loves autocorrecting nodes to nudes and it leads to misunderstandings
English
14
0
80
3.7K
Haotian Liu
Haotian Liu@imhaotian·
I left xAI earlier this week. It was a difficult decision. The past two years have been an intense, fun, and deeply rewarding journey, and I accomplished things I could not have imagined two years ago. Thank you @elonmusk for the opportunity and for everything I learned at xAI. Thank you @Guodzh for the trust you placed in me and for all the days and late nights we worked through together. And thank you to the entire Omni / Imagine team: thank you for your trust, and for growing together with me. It has been an honor, and I am incredibly proud of what we achieved together. I feel fortunate to have had the chance to work with all of you. At xAI, everything feels possible. I had the chance to work with and learn from some of the most exceptional people I have ever met. I was able to explore across domains: from pretraining to post-training, from language models to multimodal, from perception to generation. Joining xAI was one of the best decisions I have ever made. @grok imagine is special to me. Building video generation models, where I started with almost zero prior knowledge, from 0 to No.1, as an IC and as a lead, alongside an extraordinary team, and shipping it as a great product used by millions, all within 6 months, at age 28: I feel proud. But now it’s time for me to move on. I’m burnt out, and I know my happiness is no longer maximized in my current state. It is sad to say goodbye, but it is just the right time for a change. Best wishes to the Imagine team, you are absolutely the best, and you deserve the best. I will cherish all our memories for the rest of my life. For now, I’m taking a break and giving myself time to figure out what comes next. Posted from Hawaii.
English
162
57
1.9K
179.9K
Jihui Yang
Jihui Yang@alsiens·
@Guodzh Absolute legend, thank you for everything!
Sunnyvale, CA 🇺🇸 English
0
0
7
1.3K
Guodong Zhang
Guodong Zhang@Guodzh·
Last day at xAI. Wild journey past three years but excited about next chapter. Thanks all for the love and support yesterday. So many friends made along the way and I will miss you all!
English
237
62
2.5K
659.8K
Toby Pohlen
Toby Pohlen@TobyPhln·
Three years, thousands of PRs, and a million jokes. Today was my last day @xai. To the team: you rock, no one burns the midnight oil better. To @elonmusk, thanks for taking me on board. I've learnt more about execution, speed, and product perfectionism than I could ever have imagined. Thanks for everything. My next priorities: sleep for more than 8h, write down all the things I've learnt (I have a list), and then think about what I want to do next. @gork wdyt?
English
342
155
5.1K
1.2M
Jihui Yang retweetledi
Elon Musk
Elon Musk@elonmusk·
xAI was reorganized a few days ago to improve speed of execution. As a company grows, especially as quickly as xAI, the structure must evolve just like any living organism. This unfortunately required parting ways with some people. We wish them well in future endeavors. We are hiring aggressively. Join xAI if the idea of mass drivers on the Moon appeals to you.
xAI@xai

Since xAI was formed just 30 months ago, the small and talented team has made remarkable progress. The future has never looked more exciting!

English
8.9K
8.1K
52.4K
20.6M