Nishant Kambhatla

🚨Our #acl2022 paper on a novel data augmentation method for machine translation is now up on arXiv. A TLDR thread with more details coming soon. /w @anoopsarkar

@gneubig The serverless endpoints by Runpod.io have worked well for us - you don’t have to keep the endpoint permanently open, you can set the min/max workers for it to autoscale. Both cost effective and reliable. We’ve had a good experience with their customer service too.

I'm looking for cost effective and simple ways to serve LLMs that we trained or fine tuned ourselves (7-70B range). What are the best options nowadays? (Self promotion welcome!)

# on shortification of "learning" There are a lot of videos on YouTube/TikTok etc. that give the appearance of education, but if you look closely they are really just entertainment. This is very convenient for everyone involved : the people watching enjoy thinking they are learning (but actually they are just having fun). The people creating this content also enjoy it because fun has a much larger audience, fame and revenue. But as far as learning goes, this is a trap. This content is an epsilon away from watching the Bachelorette. It's like snacking on those "Garden Veggie Straws", which feel like you're eating healthy vegetables until you look at the ingredients. Learning is not supposed to be fun. It doesn't have to be actively not fun either, but the primary feeling should be that of effort. It should look a lot less like that "10 minute full body" workout from your local digital media creator and a lot more like a serious session at the gym. You want the mental equivalent of sweating. It's not that the quickie doesn't do anything, it's just that it is wildly suboptimal if you actually care to learn. I find it helpful to explicitly declare your intent up front as a sharp, binary variable in your mind. If you are consuming content: are you trying to be entertained or are you trying to learn? And if you are creating content: are you trying to entertain or are you trying to teach? You'll go down a different path in each case. Attempts to seek the stuff in between actually clamp to zero. So for those who actually want to learn. Unless you are trying to learn something narrow and specific, close those tabs with quick blog posts. Close those tabs of "Learn XYZ in 10 minutes". Consider the opportunity cost of snacking and seek the meal - the textbooks, docs, papers, manuals, longform. Allocate a 4 hour window. Don't just read, take notes, re-read, re-phrase, process, manipulate, learn. And for those actually trying to educate, please consider writing/recording longform, designed for someone to get "sweaty", especially in today's era of quantity over quality. Give someone a real workout. This is what I aspire to in my own educational work too. My audience will decrease. The ones that remain might not even like it. But at least we'll learn something.

@linylinx @jeremyphoward Totally unrelated and random, but just found out that all 4 members on Isomorphic’s scientific advisory board are Nobel prize winners isomorphiclabs.com/about-us

How does a company that's literally meant to be an expert at this get salaries so wrong? GBP45k for an ML research scientist in London... Really?

And the beautiful Old Town

Thank you @eaclmeeting for a great conference in the amazing Dubrovnik, Croatia! Had the best time. #EACL2023

@eaclmeeting @RicoSennrich @Jiang_Zifan @amitmoryossef @bricksdont @ebling_sarah Nishant @protonish_ is presenting their EACL findings paper at LoResMT 2023. @SFU Decipherment as Regression: Solving Historical Substitution Ciphers by Learning Symbol Recurrence Relations Nishant Kambhatla, Logan Born, Anoop Sarkar @anoopsarkar aclanthology.org/2023.findings-…

My Schengen visa was approved just in time for #EACL2023 . Super excited to meet #NLProc folk *in person* in Croatia ✌🏻

are you kidding me rn?

@bhatia_mehar @UBC_CS @VeredShwartz Vancouver is great! Glad you’re joining the NLP scene here 🙌🏻

AHHH😬! 2 days to go! 🇮🇳✈️🇨🇦 Never ever felt so nervous. @UBC_CS @VeredShwartz

"The mathematics of burger flipping" (by Jean-Luc Thiffeault): arxiv.org/abs/2206.13900 "What is the most effective way to grill food? Timing is everything, since only one surface is exposed to heat at a given time. Should we flip only once, or many times?"

🚨 New paper at #EAMT2022 - "Auxiliary Subword Segmentations as Related Languages for Low Resource Multilingual Translation" We construct pairs of “related languages” by segmenting a source twice, each time with a diff subword vocabulary size and tokenizer. w/ @anoopsarkar

@eamt2022 Hey @eamt2022 any update on when the notifications will be sent out?

It's almost here! The deadline for submitting your work to #EAMT2022 is in one week. We welcome anyone who is excited about #MT, from users to researchers to translators! More info: eamt2022.com #EAMT

20 ideas I can’t stop thinking about:

I miss the time when we write tokenizers from scratch. I had a clear mind back then. Tokenizers nowadays always surprise us.

always a mind***k when I remember that r/place and wordle were created by the same dude

Spent 2 hrs writing an elaborate OpenReview for a paper. It had 8 references to support my comments. I carefully re-read the paper & my #review before submission only to be redirected to the *error* page as the link had expired. Alas! Lost the review. Can't write again. In pain💔

@Noelle7777 @aclmeeting The registration form will ask you to specify the type of registration (regular/student/volunteer etc.) you want to opt for. No extra forms.

The moment you have all been waiting for has arrived. We are pleased to announce that registration for the 60th annual meeting of the ACL is now open! The conference will be hybrid. aclweb.org/portal/content…

@jlibovicky Adding Russian, as a related language, to the mix might also help. Folks have shown in the past that adapting models trained on Russian to Ukrainian and Belarusian helps in low-res settings.

We are building a direct 🇨🇿 Czech-Ukrainian 🇺🇦 translation system. Any parallel data would be appreciated 🙏 We have everything from Opus, TED talks, Wikimatrix, and some works of fiction. Anything we have missed?

Our pick of the week: Moradi et al. #EACL2021 paper "Measuring and Improving Faithfulness of Attention in Neural Machine Translation". By @DennisFucci aclanthology.org/2021.eacl-main… #nlproc @protonish_ @anoopsarkar