Aryan Mikaeili

@PolaczekSagi We had (not so conclusive) experiments with WAN 2.1. With the temporal dimension, attention sharing transfers also a bit of the reference motion

@AryanMikaeili great work! I wonder how it can be used in video DiTs, where you have the temporal dimension as well. which details you can expect to extract from the ref video if you apply it over all axis (or maybe only the temporal one) 👀

Shared attention is a powerful way to transfer style in diffusion models: let tokens attend to a reference image, and the model can pick up stylistic cues. ⚠️ But in RoPE-based DiTs, this often breaks badly. Instead of transferring style, the model starts copying the reference content. In this work, Untwisting RoPE, we explore how positional bias and semantic understanding become twisted together in DiTs, and how frequency control can untwist them.

✨ The result is style-aligned generation without copying the reference content. More broadly, this paper shows that positional encodings are not just passive ordering; they actively shape how attention behaves. By analyzing RoPE’s frequency structure, we can untwist positional bias and semantics and get a simple and controllable way to steer attention without retraining or architectural changes. Joint work with @OPatashnik, @taiyasaki, @DanielCohenOr1, and @arash_mham. Project Page: untwisting-rope.github.io

🛠️ Our solution is to modulate RoPE by frequency. We attenuate the high-frequency components that over-enforce locality, and amplify the low-frequency ones that better support global semantic correspondence. We do this smoothly across the RoPE spectrum. This gives us a direct handle on the balance between positional bias and semantic alignment.

Tomorrow! 📢 Catch our SIGGRAPH presentation at 10:45 AM in the Deep Image Editing session (Room 118-120).

[1/6] Excited to share that our new work, Cora, has been accepted to SIGGRAPH! 🚀We improve fast image editing by leveraging semantic correspondences. 🖌️Cora also gives users flexibility in deciding what to keep or change from the input. webpage: cora-edit.github.io

@CoRa_ZoNN @papalcapa 😂😂😂😂

@papalcapa مرسیییی آریان نبود؟ :))))) شبیه بنجامین فرانکلینه :))

نامزدی دکتری ✅

@CoRa_ZoNN سید ید الله فوق ایدیهم خیره ایشالله

به طرز عجیبی دارم وزن می‌گیرم

If you see this tweet, you have to mention one of your favorite paintings The Return by Arnold Böcklin, 1887

If you like an ornament, part, or concept on an object, you likely want to generate more objects having the same concept or transfer that to another object. For this task, we introduce CLiC which learns a token "in context": arxiv.org/abs/2311.17083

#MohammadMehdiKarami is reportedly in immediate danger of execution by the Islamic Republic in a few hours. The world MUST ACT NOW. #MahsaAmini

واکنش مادر #محسن_شکاری به اعدام او در کوچه، کمر هر انسان با شرفی را می شکند. شما که در خصوص بازداشت، زندان و شکنجه فرزندتان از سوی جمهوری اسلامی به امید آزادی او سکوت کرده اید، ببینید و در مورد وضع آنها اطلاع رسانی کنید. #مهسا_امینی

#فاطمه_ناصر_رنجبر ورودی ۹۶ شریف چند هفته پیش دستگیر شده و به خاطر تعلل در پروندش اعتصاب غذا کرده. تعلل در پرونده دقیقا یعنی زمان خریدن برای آزار و اذیت فرد به "بهانه‌"ی قانونی. اگر اعتصاب غذا کرده که صداش به گوش ملت برسه بیاید صداش باشیم. #ریتوییت

در ضمن کیرم تو بیت علی (الکساندر) رهبری, که تا دو ماه پیش، روزی سه تا آهنگ‌ واسه وطن و میهن میساخت الان جیکش در نمیاد. علی جون شاشیدم تو مدل وطن پرستیت. ...... #زن_زندگى_آزادى #مهسا_امینی

صدق الله العلی العظیم #مهسا_امینی

عزیز دلمون، #محمد_نوری بالاخره آزاد شد.

Say her name! #MahsaAmini!