HongyeJ@NeurIPS

90 posts

HongyeJ@NeurIPS

HongyeJ@NeurIPS

@serendip410

Katılım Kasım 2019
238 Takip Edilen239 Takipçiler
HongyeJ@NeurIPS retweetledi
Furong Huang
Furong Huang@furongh·
I saw a slide circulating on social media last night while working on a deadline. I didn’t comment immediately because I wanted to understand the full context before speaking. After learning more, I feel compelled to address what I witnessed during an invited talk at NeurIPS 2024 by Professor Rosalind Picard. I deeply respect Professor Picard’s scholarship and contributions to the field. However, her comments during the talk reflected a deeply troubling and racist view of Chinese scholars. This was not just inappropriate but also profoundly disheartening. First, it was entirely unnecessary to mention the student’s nationality when discussing an incident of cheating. The point about academic integrity could have been made without emphasizing nationality. Yet, Professor Picard chose to highlight it. This choice perpetuates harmful stereotypes about Chinese scholars and reflects a broader bias against Asians, often rooted in the assumption that we “work hard, avoid conflict, and don’t push back.” This needs to change. Asians, like everyone else, have the right to speak out and demand accountability when racism occurs. We will ensure that being racist against Asians has consequences, including here, Professor Picard. What made this incident worse was how it unfolded during the Q&A session. A Chinese attendee asked a professional and thoughtfully articulated question. She began by thanking Professor Picard for her talk and posed this question: Are you calling out the student’s nationality because you find most Chinese scholars honest, and the fact that the cheating student was Chinese is rare? Is that why you emphasized nationality? This was a generous and high-EQ question, offering Professor Picard an opportunity to reconsider or clarify her comments. Unfortunately, she doubled down instead. Professor Picard reinforced her remarks by quoting the student’s excuse —that ethics wasn’t taught in their school—and generalized this as a broader issue with Chinese education. This statement is both factually incorrect and deeply offensive. There are glaring logical flaws in this argument: 1.If the student cheated, why would their excuse about ethics education be taken at face value? A serious scholar would investigate the claim before making it a central part of their argument. 2.Even if the student’s school didn’t teach ethics (which is false for schools in China), other sources like family and community often instill strong ethical values. Ignoring this nuance is careless and reinforces stereotypes. What is most heartbreaking is that Professor Picard couldn’t even acknowledge something as simple as: “Most Chinese scholars are honest and upright.” Instead, she focused on the singular exception and added, “Of course, with this one exception in this case” in her response. I regret that this happened at NeurIPS. I regret that this happened in my research community—a place I have cherished and contributed to for over 14 years. I regret that this happened at MIT, an institution of excellence and aspiration for many Chinese scholars. Racism has no place in academia, and incidents like this tarnish the principles of inclusion and respect that we, as a global research community, should uphold. I hope NeurIPS and the broader academic community take this as a wake-up call to address the biases and systemic issues that enable such comments to go unchallenged. We must do better. @MIT_CSAIL @NeurIPSConf
Xin Eric Wang (hiring postdoc)@xwang_lk

It is just so sad that the #NeurIPS2024 main conference ended with such a racist remark by a faculty when talking about ethics. How ironic! I also want to commend the Chinese student who spoke up right on spot. She was respectful, decent, and courageous. Her response was exemplary: she began by acknowledging the speaker’s efforts, then gave the speaker an opportunity to clarify (though, regrettably, the speaker’s reply only reinforced her bias), and ultimately called attention to the inappropriate racial bias and offered constructive suggestions. Thank you for speaking out!

English
49
174
1K
156K
HongyeJ@NeurIPS retweetledi
Cheng Lu
Cheng Lu@clu_cheng·
I don’t feel offended because this is not the truth. I feel funny because @NeurIPSConf allowed such an absurd keynote that was presented to all the brilliant Chinese scholars
Jiao Sun@sunjiao123sun_

Mitigating racial bias from LLMs is a lot easier than removing it from humans! Can’t believe this happened at the best AI conference @NeurIPSConf We have ethical reviews for authors, but missed it for invited speakers? 😡

English
13
20
660
102.5K
HongyeJ@NeurIPS retweetledi
Jiao Sun
Jiao Sun@sunjiao123sun_·
Mitigating racial bias from LLMs is a lot easier than removing it from humans! Can’t believe this happened at the best AI conference @NeurIPSConf We have ethical reviews for authors, but missed it for invited speakers? 😡
Jiao Sun tweet media
English
175
777
3.7K
2.2M
HongyeJ@NeurIPS retweetledi
Yao Fu
Yao Fu@Francis_YAO_·
What makes this slide even worse is the little trick trying to hedge the language: the speaker first make an offensive quote specifically targeting a particular nationality, then make the note that tries to exempt herself from the responsibility, or equivalently “I didn’t say it, you said it yourself”. It is rather unfortunate to see language technique is used in this way 🙃
Jing-Jing Li@drjingjing2026

1/3 Today, an anecdote shared by an invited speaker at #NeurIPS2024 left many Chinese scholars, myself included, feeling uncomfortable. As a community, I believe we should take a moment to reflect on why such remarks in public discourse can be offensive and harmful.

English
17
29
564
55.9K
HongyeJ@NeurIPS retweetledi
Jeongwhan Choi
Jeongwhan Choi@jeongwhan_choi·
I was at the invited talk. As a Korean researcher, I know that such ethnic stereotyping could target any Asian academic community. One of the questioners confronted the inappropriate generalization, and Prof. Picard's response was inconvenient: "Maybe there is one, maybe they are common... I hope it was an outlier." The audience applauded when the questioner concluded with: "I hope in the future, if you present this again, you can remove that nationality note because that seems unfair for this special group of people." I think today it's directed at Chinese students; tomorrow it could be any of us. #NeurIPS2024 @NeurIPSConf
Jiao Sun@sunjiao123sun_

Mitigating racial bias from LLMs is a lot easier than removing it from humans! Can’t believe this happened at the best AI conference @NeurIPSConf We have ethical reviews for authors, but missed it for invited speakers? 😡

Vancouver, British Columbia 🇨🇦 English
22
59
1.1K
90.8K
HongyeJ@NeurIPS retweetledi
Xin Eric Wang (hiring postdoc)
It is just so sad that the #NeurIPS2024 main conference ended with such a racist remark by a faculty when talking about ethics. How ironic! I also want to commend the Chinese student who spoke up right on spot. She was respectful, decent, and courageous. Her response was exemplary: she began by acknowledging the speaker’s efforts, then gave the speaker an opportunity to clarify (though, regrettably, the speaker’s reply only reinforced her bias), and ultimately called attention to the inappropriate racial bias and offered constructive suggestions. Thank you for speaking out!
Xin Eric Wang (hiring postdoc) tweet media
English
61
260
2.1K
373.7K
HongyeJ@NeurIPS retweetledi
Michael Saxon
Michael Saxon@m2saxon·
If you feel the need you make the "I'm not stereotyping" disclaimer, maybe you should reconsider what you're saying She could have saved a lot of words by deleting "Chinese" and "NOTE: I am not a racist but blah blah blah blah"
Wenda Xu@WendaXu2

Using racial labels to describe misconduct is harmful and inappropriate. @NeurIPSConf must not condone speech that targets specific ethnic groups. We urge Rosalind Picard @MIT @medialab to retract and apologize for her statement. Btw, most Rosalinds I know are honest and morally upright. I hope this is an exception :)

English
14
19
529
39.9K
HongyeJ@NeurIPS retweetledi
Jiayi Yuan
Jiayi Yuan@jiayiy·
🚀Excited to share our latest #EMNLP2024 work on benchmarking the long context ability with KV Cache compression across RNN-based architectures, token eviction, prompt compression, and quantization. We also provide an easy-to-use codebase (it also has my favorite WoW quote 😉). Feel free to give it a try and ⭐ it if you find it useful! 📄 Paper: arxiv.org/abs/2407.01527 💻 Code: github.com/henryzhongsc/l… Some interesting findings/suggestions include: 1️⃣ Maintaining an uncompressed prefill process is essential for performance, especially with harder tasks. 2️⃣ Combining RNN-based models with attention significantly enhances long-context capabilities. 3️⃣ In "needle-in-a-haystack" evaluation for recent LLMs like Llama-3, we should use longer needles (like 64 digits) since these models tokenize multiple digits into one token. More results and insights can be found in the paper! Kudos to all collaborators: @jiayiy, Hongyi Liu, @henryzhongsc, @YuNengChuang, Songchen Li, Guanchu Wang, Duy Le, @serendip410, Vipin Chaudhary, @ZhaozhuoX, @ziruirayliu, @huxia
Jiayi Yuan tweet mediaJiayi Yuan tweet media
English
1
10
42
10.2K
HongyeJ@NeurIPS retweetledi
xr-5 🐀
xr-5 🐀@xariusrke·
1/4 Reproducing research results in ML is hard: no code, vague descriptions, noisy results.A lot of effort @huggingface goes into making new methods available for the community, thus we wrote a blog with the challenges and strategies on the example of @GoogleAI’s Infini-Attention
xr-5 🐀 tweet media
English
2
38
241
54.6K
HongyeJ@NeurIPS retweetledi
Jingfeng Yang
Jingfeng Yang@JingfengY·
Thanks Forbes for discussing about our work: forbes.com/sites/lanceeli… Arxiv: arxiv.org/abs/2408.00114 . We rigorously defined and studied inductive reasoning and deductive reasoning in the era of LLMs. Thinking of how in-context-learning is working and why neural models are not good at deduction compared with symbolic systems, we doubt that deductive reasoning poster a greater challenge to LLMs, compared with inductive reasoning. Welcome more people to studying this interesting topic.
English
0
3
31
3.2K
HongyeJ@NeurIPS
HongyeJ@NeurIPS@serendip410·
Attending #ICML2024. Will be presenting our Spotlight Poster: “LLM Maybe LongLM: SelfExtend LLM Context Window Without Tuning” on Tue 23 Jul 1:30 p.m. CEST — 3 p.m. CEST at Hall C 4-9 #806 and our Poster: “KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache” on Tue 23 Jul 1:30 p.m. CEST — 3 p.m. CEST at: Hall C 4-9 #812 Come across to the poster if you are interested in Long context, Efficiency or new architecture for LLMs! 🌟 Or DM me for a coffee chat anytime for in-depth discussions!😌
English
6
4
17
1.4K
HongyeJ@NeurIPS retweetledi
Rulin Shao
Rulin Shao@RulinShao·
🔥We release the first open-source 1.4T-token RAG datastore and present a scaling study for RAG on perplexity and downstream tasks! We show LM+RAG scales better than LM alone, with better performance for the same training compute (pretraining+indexing) retrievalscaling.github.io 🧵
GIF
English
20
88
394
117.7K
Yao Fu
Yao Fu@Francis_YAO_·
I’ll be attending @icmlconf next week presenting my long context data engineering paper! Come and discuss long context architecture, data, inference efficiency, and I will reason with you why long context is much better than RAG arxiv.org/abs/2402.10171
English
7
17
150
13K
HongyeJ@NeurIPS retweetledi
Yu-Neng Chuang
Yu-Neng Chuang@YuNengChuang·
Introducing the LTSM-bundle Package! 🌟Thrilled to launch our open-source tool 🔧Assess various crucial designs to train Large Time Series Models (LTSMs), and identity the best training practices 🔗 Paper: arxiv.org/abs/2406.14045 🔗 GitHub: github.com/daochenzha/ltsm
Yu-Neng Chuang tweet mediaYu-Neng Chuang tweet media
English
0
7
13
1.7K
HongyeJ@NeurIPS retweetledi
Yifan Gao
Yifan Gao@Yifan__Gao·
Our Amazon Stores Foundational AI team is seeking talented PhD students to join us as research interns in Fall/Winter 2024. We are looking for candidates with top-NLP/ML publications and familiarity with LLM research. Contact me at yifangao@amazon.com if you are interested.
English
1
13
59
20.5K