Andrés Villa

I'm happy to share that our paper, PIVOT: Prompting for Video Continual Learning, was accepted on #CVPR2023. I thank all the fantastic team @MotassimF, @KumailAlhamoud, @JuliousHurtado, @FabianCabaH, @BernardSGhanem, #JuanLeonAlcazar, and #AlvaroSotoA. deepai.org/publication/pi…

Prof. Bernard Ghanem, Chair of GenAI Center of Excellence and PI of @KaustVision (ivul.kaust.edu.sa)!

🎉 Excited to share that I’ll be presenting my poster: 🪄 Behind the Magic: MERLIM A benchmark for evaluating Large Vision-Language Models (IT-LVLMs) on core vision tasks. 📅 June 11 from 10:05 to 10:45am | 📍@CVPR Exhall D board 46. 🔗 arxiv.org/abs/2312.02219 #AI #Multimodal

Our research on satellite image analysis and one of its application for archeological site discovery highlighted on Arab News 🥳

📢 Open Call: Fully funded #PhD student positions starting in 2025 at IVUL @KAUSTVision Lab with Prof. @BernardSGhanem If you are passionate about computer vision and machine learning, contact us now and apply to #JoinOurTeam. 🔗 Our lab: cemse.kaust.edu.sa/ivul

For those attending @CVPR, there will be a vote for ICCV29 after the PAMI TC meeting tomorrow. Make sure to vote. There is a bid for Dubai and I am one of the PCs. Check out our website/bid for details: iccv2029.com. Let's bring ICCV to the Middle East!

Thrilled to share that our research group at KAUST is making waves at #CVPR2024! We've had EIGHT papers accepted this year. Huge congrats to all the authors and our incredible collaborators! 🦾📚 #AI #ML #ComputerVision @CVPR Let’s connect in Seattle next week! 🇺🇸 @KaustResearch

For the first time, we show that the Llama 7B LLM can be trained on a single consumer-grade GPU (RTX 4090) with only 24GB memory. This represents more than 82.5% reduction in memory for storing optimizer states during training. Training LLMs from scratch currently requires huge computational resources with large memory GPUs. While there has been significant progress in reducing memory requirements during fine-tuning (e.g., LORA), they do not apply for pre-training LLMs. We design methods that overcome this obstacle and provide significant memory reduction throughout training LLMs. Training LLMs often requires the use of preconditioned optimization algorithms such as Adam to achieve rapid convergence. These algorithms accumulate extensive gradient statistics, proportional to the model's parameter size, making the storage of these optimizer states the primary memory constraint during training. Instead of focusing just on engineering and system efforts to reduce memory consumption, we went back to fundamentals. We looked at the slow-changing low-rank structure of the gradient matrix during training. We introduce a novel approach that leverages the low-rank nature of gradients via Gradient Low-Rank Projection (GaLore). So instead of expressing the weight matrix as low rank, which leads to a big performance degradation during pretraining, we instead express the gradient weight matrix as low rank without performance degradation, while significantly reducing memory requirements. @jiawzhao @BeidiChen @tydsh

🌞We are glad to announce a new venture: the @latinxincv coaching program! 🥳 💡Get to know the reseach done by LatinX researchers and become the new generation of researchers in Computer Vision and AI! Work along well-known professors and researchers around the world!

Don't miss this opportunity 📢 . The submission deadline for full papers for LXAI #CVPR2024 has been extended! 🌐 🌟There are travel grants for accepted papers. Share this opportunity with peers and encourage them to participate 🤝 @latinxincv @CVPR

@sarahookr @3scorciav @_LXAI @latinxincv @SomosNLP_ @OmarUFlorez @LucianaBenotti Dear Sara @sarahookr, one of my colleagues at PUC is working on developing a model and dataset (Machine Translation) for Rapa Nui and Mapudungun. Rapa Nui has some similarities to Hawaiian. He is open to collaborating.

@3scorciav @_LXAI @latinxincv @SomosNLP_ @OmarUFlorez @LucianaBenotti For the Americas right now, we are supporting Portuguese, Spanish, Haitian Creole and Hawaiian. We are still looking for language ambassadors for Haitian Creole and Hawaiian. These two languages are currently at high risk. If you know of anyone -- please let us know.

Are you a speaker of Xhosa, Zulu, Afrikaans or Malagasy? These are the four languages project AYA still doesn't have ambassadors for. Join us, and meet others who are working on multilingual representation across the world. We are open sourcing all data and models we build.

@jperezrua @FrostXuMengmeng @CVPR See you there @jperezrua 😀

@FrostXuMengmeng and I will be in Vancouver next month for @CVPR. Frost will present his work on few shot detection and query detection. This is the current SOTA on Ego4d and FS-COCO. arxiv.org/pdf/2211.10528

#BREAKING: IRCC Strike ends with employees to start reporting for work on May 1 at 9 am EST 🇨🇦 CRA strike continues as of May 1 🇨🇦 Get full details here 👇 immigrationnewscanada.ca/ircc-strike-20…

📰 April 24 Strike #New Update: Positive developments 📰 🇨🇦 #Union has lowered their wage raise demand and #willing to end the strike 🇨🇦 #Government issues an #open letter stating only 4 major demands remain out of 570 🇨🇦 Get #latest updates here👇 immigrationnewscanada.ca/ircc-strike-20…

@Adel_Bibi @ferjadnaeem @CVPR @ferjadnaeem is this portal-portail.apps.cic.gc.ca/signin?lang=en the new portal?

@ferjadnaeem @CVPR Hey Ferjad, I wonder, what type of visa did you apply for? Business visa or the temporary visit visa? Was there any place in the application form where you can enter CVPR's event code sent in the invitation letter?

Updating on here since I got several DMs about my experience. It was a pleasant surprise once I submitted my application. I received my request for biometrics a day later, gave my biometrics a week after and received the approval and request to submit passport 3 days after that.

What platform do you recommend to apply for the Canadian Visiting Visa, the GCKey, or the new IRCC portal? #CVPR2023

@MotassimF It is always a pleasure to work with you @MotassimF and this fantastic team.

This too got accepted in #CVPR2023 !

@3scorciav @jawrainey @mattia_soldan Great collection, @3scorciav. I need to visit you. Btw, it would be best if you add a pisco bottle to complete the collection. I will prepare it for you 😉

Actually, just realized that five pieces above are gifts 🍶 Public thanks to @AndrsVi28 @jawrainey @mattia_soldan & my mom 😊

Este año promete 😋😁 Ahora que mis compatriotas 🇨🇴 pueden entrar a UK 🇬🇧 sin visa hay que recibirlos como se merecen. Quien dijo yo?

@3scorciav @skamalas @CSProfKGD @rvolpis @dlarlus @naverlabseurope @KumailAlhamoud @victorturrisi Thank you very much @3scorciav.

@skamalas @CSProfKGD @rvolpis @dlarlus @naverlabseurope ☝🏼☝🏼☝🏼@AndrsVi28 @KumailAlhamoud @victorturrisi

@FabianCabaH Congratulations @FabianCabaH. Well deserved!! You will do a great job 👏

Thanks for the shot-out. Excited to be a first-timer AC 😅