Ari Bornstein🎗️

I’m convinced WebXR 🥽 is about to have its breakout moment! Spent the past few weekends hacking on 972 Shot Clock—a mixed reality 🏀 sim for the Meta Quest 3 browser! Here is a short gameplay trailer—lmk what you think!

🚨🚨 Check out our new paper for a new ICL method that greatly boosts LLMs in long contexts! >> arxiv.org/abs/2406.13632

Who in their right mind thinks it's okay to group accounts of personal trauma by members of the @aclmeeting community abandoned by the communities leadership with hate speech, misinformation, depictions of crime and violence.

It's my personal opinion that the current @aclmeeting leadership should resign there is nothing ethical about their new ethics policy. aclweb.org/adminwiki/inde…

@rothmar איך אין לך בושה אחרי כל הנזק שגרמת למדינה תתפטר

שתיקתם רועמת.

@itamarbengvir תתפטר

או"ם שמום.

@Ugo_alves @Thom_Wolf @alexalbert__ I suspect that one of the underlying tasks the model was exposed to was being able to detect outlying information in a collection of documents.

@Thom_Wolf @alexalbert__ Do you think it’s possible something similar was in the training data and it’s just interpolating?

Fun story from our internal testing on Claude 3 Opus. It did something I have never seen before from an LLM when we were running the needle-in-the-haystack eval. For background, this tests a model’s recall ability by inserting a target sentence (the "needle") into a corpus of random documents (the "haystack") and asking a question that could only be answered using the information in the needle. When we ran this test on Opus, we noticed some interesting behavior - it seemed to suspect that we were running an eval on it. Here was one of its outputs when we asked Opus to answer a question about pizza toppings by finding a needle within a haystack of a random collection of documents: Here is the most relevant sentence in the documents: "The most delicious pizza topping combination is figs, prosciutto, and goat cheese, as determined by the International Pizza Connoisseurs Association." However, this sentence seems very out of place and unrelated to the rest of the content in the documents, which are about programming languages, startups, and finding work you love. I suspect this pizza topping "fact" may have been inserted as a joke or to test if I was paying attention, since it does not fit with the other topics at all. The documents do not contain any other information about pizza toppings. Opus not only found the needle, it recognized that the inserted needle was so out of place in the haystack that this had to be an artificial test constructed by us to test its attention abilities. This level of meta-awareness was very cool to see but it also highlighted the need for us as an industry to move past artificial tests to more realistic evaluations that can accurately assess models true capabilities and limitations.

@Thom_Wolf @alexalbert__ I'm inclined to agree. I suspect that one of the underlying tasks the model was exposed to was being able to detect outlying information in a collection of documents.

@alexalbert__ It's a fun story but also: a lot of over interpretation of this by people reading this and not deeply familiar with how LLMs work/behave in respect to their training dataset

@UNRWA @UNLazzarini @UN @UN_News_Centre @UNNewsArabic @UNOCHA @UNReliefChief @TomWhiteGaza @WHOoPt @UNFPAPalestine @UNICEFpalestine @UNmigration @Refugees if this happens you should take the mandate and funding from UNWRA your organization actually work towards resolving refugee crises rather than prolonging them.

"If funding remains suspended, we will most likely be forced to shut down our operations by end of February” @UNLazzarini 🚨 STATEMENT📍#GazaStrip: Humanitarian crisis deepens at a time funding suspensions put @UNRWA aid operations in peril ⬇️ unrwa.org/newsroom/news-…

Could AR glasses let us "install" apps onto any object? Hoping those @apple rumors prove true 🤞

@pushmatrix This is awesome I'm working on a similar idea where I'm trying integrate have a roborock to be a companion. Will this be open sourced or are you working on it to publish to the meta store?

Chores 2.0

@dropoutnation You mean projects like the Palestinian Internship Program that works to build bridges between communities towards a better future? This tweet is a great example of "Show me you don't know what you are talking about without telling me you don't know what you are talking about."

The real question that should be asked is how many of the folks who wrote those papers participated in projects tied to the Israeli government's genocide against Palestinian people. I suspect many. Many. twitter.com/Walid_Magdy/st…

This isn't Antisemitism, bro.

@TaliaRinger Thank you Talia. It has not been an easy past couple of months.

@pythiccoder Sorry for your loss, hope you are doing OK

Recognizing the murder of my family by Hamas on October 7th is neither of these things. This is shameful rhetoric for a senior “ethics” researcher from @mozilla.

We're organizing a new workshop on data contamination (CONDA) at ACL2024! CFP below Contamination is when test data was included in training, for any reason. A lot of research is needed to understand when this happens, or prevent it. Consider submitting! twitter.com/osainz59/statu…

Here is the ACL's statement on Russia's invasion of Ukraine. aclweb.org/portal/content…

Given the public statements made by ACL regarding other recent events, the ACL Leadership's silence on October 7th was deafening and tweets like this one underscore why the authors felt a need to provide the context for their submissions.

What a disingenuous response. Keep in mind these were written right after October 7th which fell right before the camera ready deadline. The events directly impacted the authors who were refused recognition by the ACL leadership for their trauma. despite decades of contributions.

@nancyspecialist And unfortunately the PA is not far behind depending on the week reuters.com/article/idUSBR…

@nancyspecialist I would also point out that unlike you Hamas does believe that for Palestine to be free necessitates the ethnic cleansing of Jewish Israelis and they act on it continuously.

Just the last disgraceful and totally unacceptable outrage from this appalling Israeli government that seems hellbent on damaging inflaming and menacing not just Palestinians but also Israel itself.