Aditya Ramesh

@maharshii it is a strange feeling that you might spend months optimizing half a dozen microsseconds out of your kernel, just for someone to put an await inside of a loop in the chat app's javascript and your work is gone lol

A few hours of memory aliasing bugs later, Qwen3.5 is available on MLC-LLM! Take a look at llm.mlc.ai - always cool to see these things run on your own hardware. Big thanks to our community contributors!

It doesn't help that many indians are apathetic and apolitical

the messaging ignores how dynamic this country is along with racism along racial lines that don't include white people (ex. black hate in indian communities, indian hate in latino communities, vice versa).

the social issues surrounding indians in america are so poorly understood and deeply incompatible with messaging from both political parties. i could write a book about it but i got more pertinent priorities rn. maybe someone with more time on their hands should do so.

@tanishqkumar07 @tri_dao @avnermay Hi Tanishq, great work here! Have you seen TiDAR from NVIDIA by any chance? If so, do you have any thoughts on their approach? tidarlm.github.io

I've been working on a new LLM inference algorithm. It's called Speculative Speculative Decoding (SSD) and it's up to 2x faster than the strongest inference engines in the world. Collab w/ @tri_dao @avnermay. Details in thread.

@sgdescent @SCSatCMU Was a great lecture Saksham!

Started a ml sys reading group with friends @SCSatCMU Systolic arrays are so cool!

I remember growing up a being hopeful the status of Indians in the United States would improve, but my experiences in the last few years has made me more disillusioned with this hope. I remember seeing more higher quality depictions of India and its people in high school. I remember a time when Indians were included in the progressive causes. I remember when racism was actually shunned properly by both parties. I became increasingly disappointed with the democrats when they kept introducing race-based socialist policies, simultaneously talking about racism while leaving out Indians, ignoring the caste systems that exists within the black and Latino population, and portray itself as a classist movement, as socialism should be, when it’s just a racial movement that’s no different to me than the white movement. I haven’t seen anyone make Marxist criticisms of these policies, yet I see them failing because of the corporate incentives these companies and universities have. It’s not hard to see that Walmart reproduces the mechanisms of the systemic racism by selling opioids to black communities while simultaneously changing their logo to a rainbow and promoting DEI, providing a better ESG score and public image. It’s not had to see at universities, immense amount of capital is only available for certain races and the same perverse incentives exists. Constantly, these policies are described to combat racism, yet they undermine the Indian population constantly and reduce the racism and disrespect as if it is non existent. The Republican Party is not welcoming to Indians, which is not a surprise to anyone. I don’t think there’s much to expand on this that people don’t already know, but I do see Trump often supporting measures like Green Card on graduation and better immigration pathways for higher skilled workers. But i see this more as Trump’s interest and the Indian interest aligning rather than social progress. And just like every group, I see Indians are complicit in their own problems. I see an increasing divide between Indian immigrants and Indian Americans. It just hurts the entire diaspora. I see so much internalized racism. I see so much generational trauma. I see so much negativity and pessimism and selfishness. I see so many who are apolitical and don’t see the value in advocating for oneself and their people. This is a bit of a rant, not much of a normative argument here. I dont know how to fix it. Better representation in media would probably be good but it’s all profit incentive in Hollywood and I don’t see it happening soon. Progressives can’t deconstruct their own arguments properly. People on the right project their insecurities and blame their problems on immigrants. I do believe progress can be made. I’m not sure if this is the generation to do it.

@VestedTrade wow that’s crazy

@VestedTrade Being from Florida made this less obvious to me

@VestedTrade excited to launch Vested Trade!

@Yampeleg This has been shown before in 2022. They introduced a momentum gradient descent from this intuition. arxiv.org/pdf/2212.10559…

Wild paper They prove (!!) a transformer block (Attn + MLP) running on prompt Outputs the same logits with no prompt If MLP weights updated by vector: W′ = W + ΔW Calc from attn latent: ΔW = (W·Δa) × (A(x)ᵀ / ‖A(x)‖²) Given prompt: Δa = A(C, x) − A(x) Fucking fine tuning.

making an electrical engineering/chip design social network called FETLife, who’s in?