Kai Yi
26 posts

Kai Yi
@williamyi96
Research Scientist @AIatMeta. CS PhD @cemseKAUST, BS @XJTU_China, Interned @SonyAI_global @VectorInst @Tencent_AI_Lab.




Me a week ago: I can easily beat GPTQ (method from 2022), and maybe after a month, I can make ~SOTA quantization. Me yesterday: F***, this work moved SOTA very far, no chance to catch it. Anyway, LLM quantization is becoming unbelievably good. arxiv.org/pdf/2405.14852

Join the #KAUST Global Fellowship Program, an incredible opportunity for exceptional postdocs with groundbreaking ideas to advance Saudi's research priorities. The program offers access to cutting-edge research tools, top-notch facilities and expert mentorship.













"One Model To Learn Them All" another step in Google's attempt to turn all of itself into one big neural network arxiv.org/abs/1706.05137




