Junting Pan

Our MathVision benchmark is accepted by NeurIPS DB Track, 2024! We show a notable performance gap between current LMMs and human performance on simple math problems with visual context. Dataset: huggingface.co/datasets/MathL… Paper: arxiv.org/pdf/2402.14804

This is something I wanted to study long since I ever read the original knowledge distillation paper in 2015. Finally we've done it - with @TaiMingLu we thoroughly study the necessity of distillation from a "stronger" teacher

Photography is deeply personal. It’s about people, relationships, and moments that matter — shaping how we remember the world and the people around us. So excited to finally share what we’ve been working on - a personalized photo generation and editing model designed for your own photography. The idea is simple: your photos should still feel like you - preserving your identity, your expression, your story, while giving you the freedom to shape the image around it, or reimagine it. What excites me most isn’t just the ability to generate something entirely new, but the chance to fix the small, real things — the missed moment, the person who wasn’t there, the expression that didn’t quite land — and finally arrive at the photo you had in your head all along.

Introducing Cambrian-S it’s a position, a dataset, a benchmark, and a model but above all, it represents our first steps toward exploring spatial supersensing in video. 🧶

@3scorciav Donde vas amigo?

Everyone/everything has an expiration date, even with an undetermined contract. Time to look forward & enjoy the end of (an era/) the journey 🏴󠁧󠁢󠁥󠁮󠁧󠁿📦🚚🤗🫂🍽️🍛

@raki_med Sorry, it's fixed now.

@junting9 Hello, interested! Can't dm.

The Foundation Model Team @🍎Apple AI/ML is looking for a Research Intern (flexible start date) to work on Multimodal LLMs and Vision-Language. Interested? DM me to learn more!

Last year at @Apple MLR, we published a number of interesting papers like AIM, AIMv2, and Scaling laws for: Sparsity, Native Multimodal Models, Data mixing. Today the team has open-sourced the training codebase we used for conducting this research! github.com/apple/ml-l3m

In this report we describe the 2025 Apple Foundation Models ("AFM"). We also introduce the new Foundation Models framework, which gives app developers direct access to the on-device AFM model. machinelearning.apple.com/research/apple…

Our computer vision textbook is now available for free online here: visionbook.mit.edu We are working on adding some interactive components like search and (beta) integration with LLMs. Hope this is useful and feel free to submit Github issues to help us improve the text!

🌟Thrilled to share that SAM 2 was awarded a Best Paper Honourable Mention Award at #ICLR2025, one of 6 papers recognized out of 11000+ submissions! 👏This project was the result of amazing work by an exceptional team at @AIatMeta FAIR: @vgabeur , @YuanTingHu1,@RonghangHu, @wrong_whp, Tengyu Ma, @HaithamKhedr,@raedle, Chloe Rolland, Laura Gustafson, @junting9, @KalyanVasudev, @alcinos26, @chaoyuaw, @inkynumbers, Piotr Dollar, @cfeichtenhofer. 🚀It was inspiring to hear from researchers at ICLR applying SAM to a diverse array of real-world challenges—from medicine and semiconductor manufacturing to robotic navigation, enterprise data annotation platforms, and video editing. If you're using SAM for an innovative application, please reach out, we'd love to hear about it!

@changxiao0731 @YueJiang_nj @BU_Tweets Congrats！

I am looking for strong PhD interns to join Apple MLR late 2024 or early 2025! Topics will be around training large-scale diffusion/flow matching models broadly speaking and you’ll be in the bay area (Cupertino/SF). Apply here: jobs.apple.com/en-us/details/…. [1/5]

Looking for a 2025 summer research intern, in the Foundation Model Team at Apple AI/ML, with the focus of Multimodal LLM / Vision-Language. Phd preferred. Apply through jobs.apple.com/en-us/details/… Also email me your resume to haoxuanyou@gmail.com! 😊

Nice to e-meet everyone at #AdobeMAX sneak! @mengweir --- Now I know 😎

@mengweir 🙋

@mengweir @Adobe @adobemax You are the best!

I am presenting at #AdobeMAX next week! Get a sneak peak to our latest research on image composition and relighting on Oct15th at MAX sneak session (5.30 to 7 pm EST). Online registration (free): max.adobe.com/max-online/

@Sagar_Vaze @PrannayKaul @RhydianWindsor @maxhbain @LiliMomeni @y_m_asano @Andrew__Brown__ @robmccr @imisra_ @alcinos26 @ashkamath20 @vgabeur @nikhilaravi @cfeichtenhofer Congrats Sagar!! 🥳 It was a pleasure to have spent the internship together!

Special shoutout to the Covid-cohort at VGG @PrannayKaul @RhydianWindsor @maxhbain @LiliMomeni @y_m_asano @Andrew__Brown__ @robmccr, as well as everyone at Meta for two awesome summers @imisra_ @alcinos26 @ashkamath20 @vgabeur @nikhilaravi @junting9 @cfeichtenhofer

I passed my PhD defense (i.e DPhil viva) earlier today. While I'm feeling quite melancholy about closing a long chapter at Oxford, I feel extremely lucky to have studied in such an amazing group @Oxford_VGG for the last few years. Excited for what's next!