Nicholas Monath

Want to train LLMs with less cost? We introduce BiClip, a clipping-based method that `approximates' adaptive optimizers without maintaining expensive preconditioners

The DukeNLP group is hiring PhD students in all areas of natural language processing! Apply at gradschool.duke.edu/admissions/app… by Dec 15 to work with @_samwiseman or @bhuwandhingra.

AKBC 2021 is around the corner! You can now access the public virtual platform at: akbc.ws/2021/virtual You will receive the credentials for the conference hub today if you already registered. If you haven't done so, it's not too late! Register at: akbc.ws/2021/registrat…

Hi all! We have open PhD and Postdoc positions on using AI to improve scientific communication and combat misinformation. Positions are part of an interdisciplinary collaboration between researchers at ETH Zurich (@mrinmayasachan @ellliottt) and UZH (Markus Leippold). #NLP

(1/9) Presenting: Bayesian Algorithm Execution (BAX) and the InfoBAX algorithm. Bayesian optimization finds global optima of expensive black-box functions. But what about other function properties? w/ @KAlexanderWang @StefanoErmon at #ICML2021 URL: willieneis.github.io/bax-website

One of my favorite underutilized NER datasets is the Medmentions dataset, by Sunil Mohan and Donghui Li, funded by @ChanZuckerberg arxiv.org/abs/1902.09476 It provides a very interesting testbed for biomedical NER models, here's why 🧵

🚨 We decided to extend the paper submission deadline by 96 hours. The new deadline is Monday, June 21st 11:59pm UTC-12. 🛎️ We also welcome non-archival submissions! (listed in AKBC schedule with the flexibility to also submit elsewhere). Please submit your work to #AKBC2021!

OpenReview just smoothly weathered the #NeurIPS2021 deadline today, hardly breaking a sweat. Over 41k sessions, 35k active users (29k in final 2 hours), more PDFs submitted than we’re allowed to say, sub-second response time on most requests, CPU utilization never surpassing 15%.

A reminder that the AKBC deadline (June 17th) is 4 weeks away! Please help RT and submit your work! The submission site is open and all the details can be found at: akbc.ws/2021/cfp/ #AKBC2021

Excited to announce that the 3rd Conference on Automated Knowledge Base Construction (AKBC) will be held virtually during October 4-7 this year! #AKBC2021 The call for paper is out! akbc.ws/2021/cfp/ Paper deadline: June 17, 2021 Please help RT and consider submitting!!

Many Transformer #NLP models have computational requirements that scale quadratically with input sequence length. Learn how sparse attention methods reduce the dependency from a quadratic to linear and achieve state-of-the-art results on challenging tasks. goo.gle/2PxgxPe

Constructing Transformers For Longer Sequences with Sparse Attention Methods ai.googleblog.com/2021/03/constr…

Interesting talk coming up this Thursday! Manzil Zaheer | Big Bird: Transformers for Longer Sequences meetup.com/London-Machine… #Meetup via @Meetup

@anthonygarvan Hey Tony, i'm so sorry to hear :( if you ever want to talk, I'm always happy to!

Feeling really lost & distracted today, but in an urgent way. Like my son is hurt and I can't find a band-aid. Terrible nightmares. I recognize it from the early pandemic days: it's a new wave of grief. Yet another layer of assumed stability and security has ruptured.

(1/4) We are deeply saddened to share that Pat Quinn, co-founder of the ALS Ice Bucket Challenge passed away at the age of 37. Pat was diagnosed with ALS in 2013 and went on to help popularize the greatest social media campaign in history.

We turn Family Feud into a commonsense dataset😏. Learn more about this in the gather town session at 9pm ET! #EMNLP2020

Please RT! If you're looking for a PhD position in a world leading information retrieval research lab, the Center for Intelligent Information Retrieval (CIIR) at @UMassCS is hiring multiple students for Fall 2021. Deadline: Dec. 15. Questions? drop me an email. @sigir_students

Read ⤵️: @andrewmccallum on his work leading the @UMassAmherst Computable Knowledge project, which is advancing #OpenScience and better knowledge discovery for researchers across the globe 🌐 cziscience.medium.com/extracting-kno…

COVID thrives in big gatherings. Here’s how dangerous it is. 7 people who DID NOT even attend a wedding in August died. We all must take care of each other.

USPS disregards court order to conduct sweeps in 12 postal districts after more than 300,000 ballots can’t be traced. The Postal Service said instead it would stick to its own inspection schedule. wapo.st/3862RCg