Leonard Salewski

📢 #scholarGPT now can perform complex filtering operations like selecting a specific year 📅, making research even more efficient! 💪 Build with self-query from @langchain Sign up on the waitlist to be the first to try it out mailchi.mp/d8b3dbb881ae/s…! 🚀✨ #ChatGPT #Research🧑‍💻

A big thank you as well to @uni_tue and the International Max Planck Research School for Intelligent Systems (IMPRS-IS) @MPI_IS for providing an inspiring environment to learn and grow.

I’m incredibly grateful to my supervisors @zeynepakata and Hendrik Lensch for their invaluable guidance and support throughout this journey. I am also very thankful for all of the support from my two amazing groups, @ExplainableML and @CG_Tuebingen.

I am very happy to announce that I successfully defended my PhD thesis with the title "Advancing Multimodal Explainability: From Visual Reasoning to In-Context Impersonation".

🎓PhD Spotlight: Leonard Salewski Celebrate @L_Salewski, who will defend his PhD on 24th June! 📸🎉 Leonard has been a PhD student in the EML and @CG_Tuebingen groups at @uni_tue since May 2020. He is part of the IMPRS-IS program (@MPI_IS), jointly supervised by @zeynepakata and Hendrik Lensch. His research centers on explainable and multimodal AI, and can be summarized in three key contributions: 💡 Natural Language Explanations: Developing models, datasets, and benchmarks for generation and evaluation of natural language explanations. 🗣️ Multimodal Learning: Specialized in vision-language and audio-language models. 🧠 LLM Impersonation: Investigating LLM's in-context impersonation ability with its impact on performance and bias in downstream tasks. During his PhD, Leonard broadened his expertise through an internship at @nvidia, working on yet another multimodal challenge—enabling vision-language models to understand and describe actions in popular computer games. 🎮🤖 Join us in celebrating Leonard’s achievements and wishing him the best for his defense and future endeavors! 🥳🎓 👇 Check out his amazing works in this thread🔥

We are hiring a Ph.D. intern (in-person at an NVIDIA, USA, office; California preferred) to work on multi-modal foundation models + agents / digital avatars. Ideal candidate is one with a track record of leading impactful research & the ability to obtain work permit in the US.

I’m happy to share that from today I’m starting a new position as a Research Intern at @nvidia. I will be working with @ekta_prashnani, Joohwan Kim and Iuri Frosio.

🔊 Do you want to know how ZerAuCap generates audio captions without training on paired data? Come to our #NeurIPS2023 ML for Audio talk at 11:10am in Room 228 - 230 or visit us at our poster from 1:30pm to 3:00pm!

Are you interested in #LLM's and their ability to impersonate? Visit us during the upcoming poster session 2 at #1426, where Stephan Alaniz and I will present our #NeurIPS2023 Spotlight. Paper: arxiv.org/abs/2305.14930

🎷🎺 Excited to be at #NeurIPS2023! Hit me up if you want to chat about my Spotlight paper on LLM impersonation, my ML-for-Audio workshop oral paper on zero-shot audio captioning or RAG for scientific #Chatbots.

Amazing collaboration with Stephan Alaniz, Isabel Rio-Torto, Eric Schulz (@cpilab) and Zeynep Akata (@zeynepakata)!

✅ These findings earned us an "Excellent rebuttal" statement by the most skeptical reviewer and finally a Spotlight at #NeurIPS2023! Read the revised paper on arXiv (arxiv.org/pdf/2305.14930…) and visit our poster in #NewOrleans on December 12th in poster session 2.

Do you want to know how we earned a #NeurIPS2023 Spotlight for our "In-Context Impersonation Reveals Large Language Models' Strengths and Biases" paper 🧐? Buckle up and join for a ride on the rebuttal roller coaster 🎢🧵

This was joint work with Stefan Fauth, A. Sophia Koepke and Zeynep Akata (@zeynepakata). You can find the paper here arxiv.org/abs/2311.08396 and we will present our work in #NewOrleans on December 16th at 11:10 am in Room 228 - 230.

🎉Excited to share that our project "Zero-shot audio captioning with audio-language model guidance and audio context keywords" is now live on @arxiv and has been accepted as an Oral in the ML for Audio Workshop @ #NeurIPS2023 🤩 (Paper link below 👇)

If you enjoyed the #GaussianSplatting of "Diana of Versailles" from the @MuseeLouvre and this overview, follow me for similar tweets!

"Encyclopedic VQA" by @tejmensink, @JRRU, Lluis Castrejon, @goelarushi27, Felipe Cadar, Howard Zhou, @feishaAI, André Araujo and @VittoFerrariCV (openaccess.thecvf.com/content/ICCV20…)

#ICCV2023 in #Paris was great! Saw lots of great art in the @MuseeLouvre and amazing research at the @ICCVConference. A thread on some really cool papers on vision-language papers in no particular order 👇