One week (ish) left to apply: I'm recruiting Linguistics PhD students to come work with me on getting NLP to work for as wide a range of languages as possible! Apply below by December 1
sas.rochester.edu/lin/graduate/a…
English
C.M. Downey
69 posts
C.M. Downey
@cmdowney
Asst. professor at @UofR Ling and Data Science | NLP for low-resource, endangered, and Indigenous languages | formerly @uwlinguistics, @uwnlp
Rochester, NY Beigetreten Haziran 2019
135 Folgt417 Follower
@Olukanni_Jnr Students can apply regardless of undergrad major. However, your Statement of Purpose essay will need to demonstrate clear and tractable ideas for research you want to pursue within (computational) Linguistics. I am also unlikely to take students without programming experience
English
@cmdowney Can someone with History as an undergrad course of study apply for this ?
English
C.M. Downey retweetet
@tylerachang and my paper “When is Multilinguality a Curse?” was awarded outstanding paper! Thank you @emnlpmeeting ❤️
EMNLP 2026@emnlpmeeting
Announcing the 20 **Outstanding Papers** for #EMNLP2024
English
Reminder that I'm recruiting NLP-oriented Linguistics PhD students with a passion for low-resource languages this cycle! Applications are due December 1 (see link). I'll be at #EMNLP2024 next week if anyone wants to chat, so feel free to reach out!
sas.rochester.edu/lin/graduate/a…
English
C.M. Downey retweetet
What's the only thing better than NASSLLI (North American Summer School for Logic, Language and Information)?
Summer in Seattle!
Luckily, you can have both: I'm hosting NASSLLI at UW this summer.
nasslli25.shane.st
Please share widely, submit proposals, and attend!
English
Correction: this cycle I will be recruiting into the Linguistics program ONLY. Students with a CS background can still pursue NLP research with me, but they will take the Ling core curriculum, and an emphasis on less-studied languages is desired. My apologies for any confusion
C.M. Downey@cmdowney
📣 I'm recruiting PhD students this cycle! Researchers interested in expanding NLP for mid- and low-resource languages - and/or developing tools for endangered languages and field linguistics - should apply to work with me either through the UR Ling or CS PhD programs!
English
Happy to say that this work has been accepted to Findings of #EMNLP2024! Thanks to my fantastic co-authors for getting it across the finish line. I'll probably come to Miami to present it, so come say hi if you find the work interesting!
C.M. Downey@cmdowney
Preprint! We test methods to adapt a crosslingual model to a language family, and argue for targeted multilinguality as a middle ground for low-resource langs, avoiding the "curse of multilinguality" arxiv.org/abs/2405.12413 w/@TerraBlvns, @quirkyDhwani, @dwija_parikh, @ssshanest
English
3. For this cycle, I'm unlikely to bring on a student interested in machine learning but not NLP / CompLing
English
Because I can't individually respond to every email:
1. Programming skills (ideally Python) are important for my students in either program
2. For Ling especially, I will strongly weigh interest in endangered languages / fieldwork, to complement existing strengths of the dept
...
C.M. Downey@cmdowney
📣 I'm recruiting PhD students this cycle! Researchers interested in expanding NLP for mid- and low-resource languages - and/or developing tools for endangered languages and field linguistics - should apply to work with me either through the UR Ling or CS PhD programs!
English
Here's a link to apply for the University of Rochester Linguistics program: sas.rochester.edu/lin/graduate/a…
English
📣 I'm recruiting PhD students this cycle! Researchers interested in expanding NLP for mid- and low-resource languages - and/or developing tools for endangered languages and field linguistics - should apply to work with me either through the UR Ling or CS PhD programs!
English
A bit belated, but I finished my PhD! Can't express enough thanks to my amazing advisors @ssshanest and Gina for their investment in my time at UW. Excited for my next adventure of joining the faculty at the University of Rochester!
English
@dmimno @TerraBlvns @quirkyDhwani @dwija_parikh @ssshanest Thanks! I suspect the part it would have the most potential to effect is the vocabulary specialization, since it exploits the structure of the original model's embedding space
aclanthology.org/2023.mrl-1.20/
aclanthology.org/2023.emnlp-mai…
English
@cmdowney @TerraBlvns @quirkyDhwani @dwija_parikh @ssshanest Cool work! We found XLM-R had weaker cross-language alignments than mT5, I’d be curious if results would be different:
aclanthology.org/2023.emnlp-mai…
English
Preprint! We test methods to adapt a crosslingual model to a language family, and argue for targeted multilinguality as a middle ground for low-resource langs, avoiding the "curse of multilinguality"
arxiv.org/abs/2405.12413
w/@TerraBlvns, @quirkyDhwani, @dwija_parikh, @ssshanest
English
Our results suggest new best practices for bootstrapping NLP systems in low-resource language groups. All of our software, results, and analysis can be found on at github.com/CLMBRs/targete…. If you find our work interesting, feel free to reach out and let us know what you think!
English
Our most surprising result may be that choosing a low sampling alpha (up-sampling low-resource langs and down-sampling high-resource) has a significant beneficial effect for low-resource langs, but does *not significantly harm performance in high-resource ones (pics repeated)
English
In fact, adapted vocabulary size does *not have a significant effect on task performance in our lowest-resource languages
English
We perform an extensive sweep of adaptation parameters and directly model the effect of adaptation steps, vocab size, and sampling alpha on downstream performance. While steps and vocab size both positively effect performance, doubling steps is ~3x as effective as doubling vocab
English
For very under-resourced and endangered languages, our targeted multilingual adaptation is far more effective than adaptation to individual languages
English
Using the Uralic family as a test case, we adapt XLM-R with targeted language modeling and vocab specialization. Our best models show sizable improvements over multilingual baselines for tasks like UAS, while simultaneously cutting up to 65% of the original parameters
English