Vittorio Ferrari

63 posts

Vittorio Ferrari

@VittoFerrariCV

Principal Research Scientist at Meta Reality Labs

Zurich 가입일 Haziran 2020

15 팔로잉5.6K 팔로워

Vittorio Ferrari@VittoFerrariCV·10 Mar

Paper accepted to #ICLR2026! MaskInversion: Localized Embeddings via Optimization of Explainability Maps Paper: arxiv.org/abs/2407.20034 Project: walidbousselham.com/MaskInversion/ Code: github.com/WalBouss/MaskI… With @BousselhamWalid, @HildeKuehne, @chrirupp

English

4.5K

Vittorio Ferrari@VittoFerrariCV·23 Eyl

Last week I attended #ICIAP2025 in Rome, where I delivered a keynote talk. The conference was great, with exciting talks, delicious food, and lively social events. Plus, the auditorium had a grand painting in the background! I thank the organizers for inviting me! Grazie Roma

English

771

Vittorio Ferrari@VittoFerrariCV·29 Tem

My favourite project from my time at Synthesia is now ready! Avatars now move their hands matching the meaning and intonation of the words they are saying. This body language makes the videos even more engaging! synthesiaresearch.github.io/express-video/

English

1.4K

Vittorio Ferrari@VittoFerrariCV·31 May

I am happy to announce that I have joined Meta Reality Labs as a Principal Research Scientist, working on Spatial AI to power AR/MR experiences on Meta's wearable devices. It's the start of another adventure, and I thank all my new colleagues for making me feel welcome!

English

2.4K

Vittorio Ferrari@VittoFerrariCV·28 Eki

Paper accepted to the “Multimodal Algorithmic Reasoning” NeurIPS workshop! HAMMR: Hierarchical multimodal agents for handing many diverse VQA tasks in a single system arxiv.org/abs/2404.05465 @LluisCastrejon @tejmensink @howardzzh @andrefaraujo @JRRU

English

1.2K

Vittorio Ferrari@VittoFerrariCV·19 Haz

Come to poster 354 at #CVPR2024's to see our work! 10:30am today, Arch 4A-E "Grounding Everything: Emerging Localization Properties in Vision-Language Transformers" Paper: arxiv.org/abs/2312.00878 Demo:huggingface.co/spaces/WalidBo… Code: github.com/WalBouss/GEM

English

Vittorio Ferrari@VittoFerrariCV·22 Nis

Our EXPRESS-1 AI model enables @Synthesiaio avatars to understand and adjust to the script automatically 💥 This is a big milestone, so tune in tomorrow for a pre-launch chat with @MattNiessner, @jnstrck, @vriparbelli and @AlexVoica X Spaces event link: twitter.com/i/spaces/1YpJk…

English

2.2K

Vittorio Ferrari 리트윗함

Synthesia 🎥@synthesiaIO·16 Nis

AI Avatars have learned to interpret text now. 😬 Our soon-to-be-public EXPRESS-1 AI model enables Synthesia avatars to understand and adjust to the script automatically. 🤯 Join the pre-launch tech chat with: @vriparbelli, @MattNiessner & @jnstrck 👀 twitter.com/i/spaces/1YpJk…

English

6.7K

Vittorio Ferrari@VittoFerrariCV·13 Nis

Introducing HAMMR: hierarchical multimodal agents that handle a broad range of VQA tasks within a single system (counting, spatial reasoning, OCR, visual pointing, external knowledge, and more). arxiv.org/abs/2404.05465 @LluisCastrejon @tejmensink @howardzzh @andrefaraujo @JRRU

English

1.9K

Vittorio Ferrari@VittoFerrariCV·29 Şub

Paper accepted to #CVPR2024! Grounding Everything: Emerging Localization Properties in Vision-Language Transformers Paper: arxiv.org/abs/2312.00878 Demo:huggingface.co/spaces/WalidBo… Code: github.com/WalBouss/GEM With @BousselhamWalid, @FHKPetersen, @HildeKuehne

English

127

8.2K

Vittorio Ferrari@VittoFerrariCV·21 Şub

We are running the Vision and Sports Summer school again this year! Prague, July 22-27. We offer a broad-range of lectures on state-of-the-art Computer Vision techniques, as well as exciting sport activities, such as Volleyball, Frisbee and Table Tennis. cmp.felk.cvut.cz/summerschool20…

English

3.1K

Vittorio Ferrari@VittoFerrariCV·27 Eki

Happy to share this filmed interview - if you want to join @SynthesiaIO, now is the perfect time!

Synthesia 🎥@synthesiaIO

Will AI ever take over humanity? 🤔 We’ve got a theory about this in our Social Media team, but let’s double check with an actual expert. Introducing our Director of Science, @VittoFerrariCV, who recently joined Synthesia! And btw, he’s already looking for new hires, here: synthesia.io/careers

English

5.2K

Vittorio Ferrari@VittoFerrariCV·13 Eki

Three papers accepted to #NeurIPS 3/3 NAVI: a dataset of image collections of objects, along with high-quality 3D object scans, near-perfect 2D-3D alignments, and accurate camera parameters. arxiv.org/abs/2306.09109 navidataset.github.io With @jampani_varun, @kmaninis, others

English

104

22K

Vittorio Ferrari@VittoFerrariCV·13 Eki

Three papers accepted to #NeurIPS 2/3 "Estimating Generic 3D Room Structures from 2D Annotations" 3D room layouts annotations for 2246 videos (part of CAD-Estate dataset). arxiv.org/abs/2306.09077 github.com/google-researc… With @DRozumnyi,@StefanPopovCV, @kmaninis, @MattNiessner

GIF

English

27.2K

Vittorio Ferrari@VittoFerrariCV·13 Eki

Three papers accepted to #NeurIPS 1/3 StoryBench: a new benchmark for text-to-video generation of stories to guide progress in assistive technology for filmmaking 🧑‍🎨 arxiv.org/abs/2308.11606 github.com/google/storybe… twitter.com/ebugliarello/s… With @ebugliarello, @hhm, many others

Emanuele Bugliarello@ebugliarello

Wouldn’t it be cool if AI could help us generate movies?🎬 We built a new benchmark to measure progress in this direction🍿 “StoryBench: A Multifaceted Benchmark for Continuous Story Visualization” 📄 arxiv.org/abs/2308.11606 👩‍💻 github.com/google/storybe… 📈 paperswithcode.com/dataset/storyb…

English

4.1K

Vittorio Ferrari@VittoFerrariCV·3 Eki

I am happy to share that I have joined Synthesia as Director of Science. Excited to start this new adventure! x.com/synthesiaIO/st…

Synthesia 🎥@synthesiaIO

Our R&D team just got a major boost - please welcome @VittoFerrariCV, our new Director of Science! 👋 He joins us from Google, where he was a Principal Scientist leading research in computer vision and machine learning. Before that, he built and led teams at ETH Zurich and the University of Edinburgh. Get a glimpse into Vittorio's extraordinary work, his role at Synthesia, and his vision for AI video here: synthesia.io/post/vittorio-…

English

121

17.2K

Vittorio Ferrari@VittoFerrariCV·23 Ağu

Check out CAD-Estate: a large dataset with 3D object and room layout annotations on RGB videos of complex multi-object scenes (101k objects in total!). github.com/google-researc… arxiv.org/abs/2306.09011 arxiv.org/abs/2306.09077 With @StefanPopovCV, @kmaninis, @MattNiessner

GIF

English

6.6K

Vittorio Ferrari 리트윗함

Emanuele Bugliarello@ebugliarello·23 Ağu

English

17.3K

Vittorio Ferrari@VittoFerrariCV·25 Tem

We released our new “Encyclopedic VQA” dataset, which contains visual questions about detailed properties of fine-grained categories (1M VQA triplets total!). These pose a hard challenge for large foundation models. arxiv.org/abs/2306.09224 github.com/google-researc…

English

8.6K

Vittorio Ferrari@VittoFerrariCV·19 Tem

Four papers accepted to #ICCV2023! 2/4 CAD-Estate: Large-scale CAD Model Annotation in RGB Videos >100k 3D objects annotated on RGB videos of complex scenes Dataset release coming soon! arxiv.org/abs/2306.09011 @StefanPopovCV, @kmaninis, @MattNiessner

GIF

English

117

21K

탐색

@BousselhamWalid @HildeKuehne @LluisCastrejon @howardzzh @andrefaraujo @JRRU @Synthesiaio @MattNiessner