Ryan Feng

(5/5) Why this is cool: FoCal allows us to extend invariance and robustness ideas to much more complex transforms and bigger models, all without specialized training or architectures. Let's chat more at tomorrow's ICML poster session! w/ @utksinghal @atulprakash & Stella Yu

(4/5) Our "vary & rank" approach: (1) Generate transformed versions of input, (2) Compute CLIP + Stable Diffusion energies (3) Select the most "canonical" view → Feed to any downstream model. Works for any task/model, no training required!

Q: How do we scale robustness/invariance to foundation models like CLIP? A: Test-time search! 🔍 Our new work FoCal finds canonical views to boost robustness to complex transforms (e.g. viewpoint): sutkarsh.github.io/projects/focal 📍 ICML Poster: Tue 11–1:30, E. Hall A-B (E-2203) 🧵 1/5

(4/4) We find that OARS significantly enhances attack success rates against state-of-the-art stateful defense models to as high as 100%. See the paper for more details: arxiv.org/abs/2303.06280

(3/4) The key insight with OARS is that stateful defense models implicitly leak information about their similarity detection procedures every time they take preventative action. OARS thus automatically adapts key attack parameters to evade detection.

(1/4) New work alert! "Stateful Defenses for Machine Learning Models Are Not Yet Secure Against Black-box Attacks" was presented this week at CCS 2023. With: @NealMangaokar, @AshishHoodaCS, Kassem Fawaz, @jhasomesh, and @atulprakash.

About 60 posters/demos were showcased during our Michigan #AI Symposium 2023 on Responsible #AI. Session Chairs: Gregory Croisdale @reGregably & @ryantfeng Check out the posters pitch. ⬇️ youtu.be/1qvddebZLEE

Thrilled to announce that about 60 posters/demos will be showcased during our Michigan #AI Symposium 2023-"Responsible #AI" on OCT. 17, check out the list. ⬇️ ai.engin.umich.edu/wp-content/upl…

Check out our new ICML 2023 paper with collaborators at Wisconsin below!

Attending my first conference today @IEEEEUROSP! Come see my presentation on “GRAPHITE: Generating Automatic Physical Examples for Machine-Learning Attacks on Computer Vision Systems” this Thursday, June 10th.

(3/3) Preprint: arxiv.org/abs/2002.07088

(2/3) GRAPHITE is the first automatic, hard-label, physical attack on machine learning systems, demonstrating attacks in a more practical setting in the real-world with limited info. GRAPHITE can also trade-off certain characteristics depending on attack or testing constraints.

(1/3) Excited to announce my first publication as first author! “GRAPHITE: Generating Automatic Physical Examples for Machine-Learning Attacks on Computer Vision Systems” has been accepted @IEEEEUROSP. With: @NealMangaokar, @jiefengchen1, @EarlenceF, @jhasomesh, @atulprakash.