Sabitlenmiş Tweet
Christina ¨̮
377 posts
if you've been storing your llm conversations for a month, you probably have a decent SFT dataset
English
English
Today was my last day at @xAI.
My mission here was to introduce Grok to the world by helping create an inspiring brand, build beautiful products, launch the best voice mode, and most importantly grow the incredible team that made it all happen. These past two years have been exhilarating, gratifying, and unforgettable – we achieved the impossible again and again, with the most talented and dedicated people I’ve ever worked with.
To @elonmusk, thank you for the opportunity, the mentorship, and the adventure of a lifetime – it’s been an honor. To the team, I’ll be rooting for you and can’t wait to see what you accomplish next.
As xAI begins its next chapter, I’m ready for a new one as well. I’m excited to spend some time seeking new inspirations, reflecting on what I’ve learned, and exploring what comes next.
English
Christina ¨̮ retweetledi
Christina ¨̮ retweetledi
Introducing 𝑨𝒕𝒕𝒆𝒏𝒕𝒊𝒐𝒏 𝑹𝒆𝒔𝒊𝒅𝒖𝒂𝒍𝒔: Rethinking depth-wise aggregation.
Residual connections have long relied on fixed, uniform accumulation. Inspired by the duality of time and depth, we introduce Attention Residuals, replacing standard depth-wise recurrence with learned, input-dependent attention over preceding layers.
🔹 Enables networks to selectively retrieve past representations, naturally mitigating dilution and hidden-state growth.
🔹 Introduces Block AttnRes, partitioning layers into compressed blocks to make cross-layer attention practical at scale.
🔹 Serves as an efficient drop-in replacement, demonstrating a 1.25x compute advantage with negligible (<2%) inference latency overhead.
🔹 Validated on the Kimi Linear architecture (48B total, 3B activated parameters), delivering consistent downstream performance gains.
🔗Full report:
github.com/MoonshotAI/Att…
English
Last day at xAI.
Wild journey past three years but excited about next chapter.
Thanks all for the love and support yesterday. So many friends made along the way and I will miss you all!
English
Today is my last day at xAI.
It's been an intense, memorable year building in the frontier —
I'm grateful to have worked with and learned from such talented and supportive colleagues.
The journey itself is the reward.
So long, and thanks for all the fish! 🐬
English
Christina ¨̮ retweetledi
Hiring to build git for VMs. We fork, snapshot, and resume full sandboxes in 26ms. DM me if you are interested.
English
Very honored to contribute to the building of Grok 4.2 and lead a major change of the training recipe, one of the most significant changes compared with previous grok versions. 🚀
Elon Musk@elonmusk
The Grok 4.2 release candidate (public beta) is now available for use. You need to select it specifically. Critical feedback is appreciated. Unlike prior versions of Grok, 4.2 is able to learn rapidly, so there will be improvements every week with release notes.
English
Christina ¨̮ retweetledi
Thanks for being an incredible leader and person. Your amazing research taste has had a profound impact on @Grok reasoning and you are one of the few people who’s able to make self-evolving intelligence a reality.
Personally, i appreciate your trust in me when I’m just a freshman in college. Best future onwards 🐐
English
I resigned from xAI today.
This company - and the family we became - will stay with me forever. I will deeply miss the people, the warrooms, and all those battles we have fought together.
It's time for my next chapter. It is an era with full possibilities: a small team armed with AIs can move mountains and redefine what's possible.
Thank you to the entire xAI family. Onward. 🚀
And to Elon @elonmusk - thank you for believing in the mission and for the ride of a lifetime.
English
@YuchenHe07 @humansand @ericzelikman @gharik @noahdgoodman @TheAndiPenguin Miss the 3am discussion but congrats this is huge!
English
A new adventure starts today at @humansand with my amazing humans & cofounders @ericzelikman& @gharik& @noahdgoodman& @TheAndiPenguin✨
Grateful to work alongside an wonderful group of thoughtful & insightful & cheerful humans—exploring new paradigms of learning from interactions among humans & AI, innovating long-horizon & multi-agent RL & memory & user understanding, developing systems that effectively adapt compute to signals & truly learn to learn, as well as building models & products that empower & evolve with humans.
If you also deeply care about shaping the future of intelligence that humans can feel, ping us! Can’t wait to learn, build & grow together ❤️
&
humans&@humansand
Today we introduce humans&, a human-centric frontier AI lab. We believe AI can be reimagined, centering around people and their relationships with each other. At its best, AI should serve as a deeper connective tissue that strengthens organizations and communities
English
@ericzelikman @gharik @YuchenHe07 @TheAndiPenguin @noahdgoodman Eric is one of the most human human i know and congrats on building @humansand
English
finally announcing i’ve started humans& w/ amazing friends @gharik & @YuchenHe07 & @TheAndiPenguin & @noahdgoodman & many other world-class folks. we're optimists: it’s possible to rethink how we build ai, to empower people to accomplish more together
tldr: love is all you need
humans&@humansand
Today we introduce humans&, a human-centric frontier AI lab. We believe AI can be reimagined, centering around people and their relationships with each other. At its best, AI should serve as a deeper connective tissue that strengthens organizations and communities
English
Christina ¨̮ retweetledi
In the future, nearly all hardware and software will be formally verified and provably correct, along with mathematics and physics.
Harmonic@HarmonicMath
We’re excited to welcome @NVidia's NVentures to the quest for mathematical superintelligence, alongside @RibbitCapital and other great investors
English
Very excited to share the news I’ll be joining @xai, focusing on talent.
I grew up chasing the American Dream the only way I knew how - watching my immigrant mom work nonstop so I could have a chance to try. From Chinatown to SF, the path hasn’t been linear, but it’s been life changing.
I wrote more about that journey below.
Grateful to @TheGregYang and @barisakis for the opportunity and trust.
As my mom always says: be kind, be honest, take care of people.
We’re building something special here.
Would love to meet thoughtful builders and kind humans.
Time to make @grok 🚀🚀🚀
English
Today is my last day @xai.
xAI has been an incredible place where hard work is truly rewarded. On leave from my PhD at Berkeley, 6 months here felt like 2 years anywhere else: I contributed to 4 different agent teams and had the opportunity to lead an agent research team myself.
This was a difficult decision — but I’m excited for what’s next 🚀
English
Christina ¨̮ retweetledi
Apply to the kernel team and you get the chance to show @elonmusk how to write efficient kernels in PTX for GB300.
Elliot Arledge@elliotarledge
This is my favorite clip of the new Elon pod. He opens up saying xAI struggles with memory usage/bandwidth and CUDA kernel optimization (matmul, attention, MoE, etc). If you are good kernel or performance engineering in general, you should apply. Steer the world in a better direction.
English
