Armin Parchami

4.5K posts

Armin Parchami banner
Armin Parchami

Armin Parchami

@ArminPCM

👑✌️ جاوید شاه ✌️👑 RL, Eval, & Benchmarking

เข้าร่วม Kasım 2025
5.5K กำลังติดตาม1.6K ผู้ติดตาม
Armin Parchami รีทวีตแล้ว
zed
zed@zmkzmkz·
our softpick paper has been accepted into the findings of ACL 2026! even though we failed scaling it up, the negative results were well received and I feel like this paper has opened up more discussions on attention sink, which is cool! updated on arxiv: arxiv.org/abs/2504.20966
zed@zmkzmkz

EARLY PREPRINT: Softpick: No Attention Sink, No Massive Activations with Rectified Softmax Why do we use softmax in attention, even though we don’t really need non-zero probabilities that sum to one, causing attention sink and large hidden state activations? Let that sink in.

English
5
12
58
4.6K
Armin Parchami รีทวีตแล้ว
Yoav Gelberg
Yoav Gelberg@yoav_gelberg·
If you're at ICLR tomorrow and interested in long-context language modeling, positional embeddings, or length generalization in transformers, come chat about DroPE! Sat 10:30 AM-1:00 PM Pavilion 4, P4-#5112
Sakana AI@SakanaAILabs

Introducing DroPE: Extending the Context of Pretrained LLMs by Dropping Their Positional Embeddings pub.sakana.ai/DroPE/ We are releasing a new method called DroPE to extend the context length of pretrained LLMs without the massive compute costs usually associated with long-context fine-tuning. The core insight of this work challenges a fundamental assumption in Transformer architecture. We discovered that explicit positional embeddings like RoPE are critical for training convergence but eventually become the primary bottleneck preventing models from generalizing to longer sequences. Our solution is radically simple: We treat positional embeddings as a temporary training scaffold rather than a permanent architectural necessity. Real-world workflows like reviewing massive code diffs or analyzing legal contracts require context windows that break standard pretrained models. While models without positional embeddings (NoPE) generalize better to these unseen lengths, they are notoriously unstable to train from scratch. Here, we achieve the best of both worlds by using embeddings to ensure stability during pretraining and then dropping them to unlock length extrapolation during inference. Our approach unlocks seamless zero-shot context extension without any expensive long-context training. We demonstrated this on a range of off-the-shelf open-source LLMs. In our tests, recalibrating any model with DroPE requires less than 1% of the original pretraining budget, yet it significantly outperforms established methods on challenging benchmarks like LongBench and RULER. We have released the code and the full paper to encourage the community to rethink the role of positional encodings in modern LLMs. Paper: arxiv.org/abs/2512.12167 Code: github.com/SakanaAI/DroPE

English
0
7
67
7.8K
Armin Parchami รีทวีตแล้ว
Mayra Yazdari
Mayra Yazdari@MayraYazdari·
❌150 journalists❌ Not 1 asked about Iran’s January massacre! Let that sink in!! NONE OF THE 150 JOURNALISTS asked a single question about 40,000+ innocent ppl slaughtered in 2 days in #Iran !! And you talk about “DEMOCRACY”? Keep it!!
Reza Pahlavi@PahlaviReza

Whether or not Europe stands with us, whether or not your journalists do their jobs, whether or not your politicians demonstrate the courage to act, I will fight for my people and my country.

English
16
490
978
3.8K
Armin Parchami รีทวีตแล้ว
Ali Emami 👊🏼👊🏾👊 ⚡️👑⚡️👊🏿👊🏻👊🏼
150 European journalists, not a single one cared about the 40,000 Iranians who lost their lives, the 15 executions in the last two weeks, and the 14 more coming. Your hypocrisy and indifference in Europe hasn't gone unnoticed. #JavidShah‌‌‌‌‌
Reza Pahlavi@PahlaviReza

Whether or not Europe stands with us, whether or not your journalists do their jobs, whether or not your politicians demonstrate the courage to act, I will fight for my people and my country.

English
7
211
401
1.6K
Armin Parchami รีทวีตแล้ว
مانیکا گلر
مانیکا گلر@MonicaGellerOnX·
As an Iranian, it was heartbreaking for me to watch a press conference with over 150 journalists and not a single one showed interest in asking about what is happening in Iran. Not one question about the January massacre. Not one question about the pressure people are facing right now. At least 42,000 people have been brutally killed in the streets. The wounded have been hunted down. People have been executed simply for demanding their basic human rights and more are at risk. I believed journalists would seize such moments to seek the truth and be the voice of innocent people. But shockingly, not one of them asked. A nurse was killed in her own home simply for treating wounded protesters, right in front of her husband. And even after her death, the cruelty did not end. Her body was taken, sexually assaulted and tapped to send to her husband. Her husband was subjected to unimaginable trauma; so much so that he could not bear it and attempted to take his own life. This was said in the conference. And still no one asked. No one followed up. No one cared enough. This should have shaken the conscience of the world. But instead, there is silence. I ask the people of the free world: why? Even for a moment, put yourselves in our place. Try to understand what is happening to us. #IranMassacre
Reza Pahlavi@PahlaviReza

Whether or not Europe stands with us, whether or not your journalists do their jobs, whether or not your politicians demonstrate the courage to act, I will fight for my people and my country.

English
55
1.1K
2.8K
15.9K
Armin Parchami รีทวีตแล้ว
Mas Mas🇮🇷
Mas Mas🇮🇷@MasMas2171·
Does Europe really care about human rights and human lives — or only when it suits their narrow interests in the West? Europe lectures the world about democracy. In the Middle East? Deafening silence. Pure hypocrisy. Whether or not you support Reza Pahlavi, if you have a conscience you must oppose this evil terrorist regime. Even if you do not support him, listen to his words — the logic and facts are undeniable. This is a human rights issue above all else. He is fighting for the Iranian people. We cannot deny the Islamic Republic is suffocating its population with endless crimes. Europe should care. Every one of these is a subject European journalists could ask about, politicians could condemn, and human rights groups could protest right now: • Day 56 of Iran’s internet blackout after the regime massacred 50,000+ unarmed protesters on Jan 8-9. • Executions of political prisoners accelerating daily. • The Islamic Republic attacked more neighbors than Israel or any other nation. • Exports terrorism worldwide — including attacks inside Europe. • Iranians crushed by economic collapse, lost jobs, lost families. • War crimes: regime stormed hospitals, executed the wounded, tortured/raped/killed doctors and nurses. • Long-range ballistic missiles built by the regime that can reach European cities — a direct threat to Europe itself. Infinite reasons. Infinite crimes. Infinite questions they should be asking. Yet not one matters. The only questions they ask Reza Pahlavi? What his father did 50 years ago… or antisemitic attacks on Israel. Israel has every right to defend itself against a regime that has threatened its existence for 47 years and killed countless Americans, Europeans, Jews, and Christians. So here’s the real question no European journalist dares ask: Why doesn’t Europe want the Islamic Republic to fall? Why fear a free, secular Iran that would become a natural ally to the US, Israel, and the free world? What do they have to lose? Where does this cowardice come from — while America and even Donald Trump stand firm against the regime? This is the obvious picture: Europe doesn’t care about human rights. It only cares about its own interests. Shame on Europe. The Iranian people will free Iran — with or without you. #KingRezaPahlaviForIran
Reza Pahlavi@PahlaviReza

Whether or not Europe stands with us, whether or not your journalists do their jobs, whether or not your politicians demonstrate the courage to act, I will fight for my people and my country.

English
4
188
377
1.4K
Armin Parchami รีทวีตแล้ว
Armin Parchami
Armin Parchami@ArminPCM·
@DavidVance HRH Reza Pahlavi: "One member of parliament even told me they didn't think Iranians were ready for democracy" Reminding the so called MP: We sheltered Jews in Iran during the world war when you were burning them!
English
0
1
1
49
Armin Parchami รีทวีตแล้ว
Shivv 🇺🇸
Shivv 🇺🇸@sheewaass·
A German MP told Crown Prince Reza Pahlavi that Iranians are not ready for democracy!! Since when do Germany or Europe get to decide whether a nation is ready for democracy? :))) You all should have been left alone with hitler. US freed u all, the freedom you did not deserve!
Reza Pahlavi@PahlaviReza

Whether or not Europe stands with us, whether or not your journalists do their jobs, whether or not your politicians demonstrate the courage to act, I will fight for my people and my country.

English
7
143
322
1.6K
Armin Parchami รีทวีตแล้ว
Shivv 🇺🇸
Shivv 🇺🇸@sheewaass·
@FoxNews we need this news to be covered, PLEASE! The Islamic Regime has sentenced three more young men to death. Erfan, 17, Matin, 17, Ehsan, 19. This regime's war on the Iranian people is continuing at full speed. Be their voice if you have a platform!
Shivv 🇺🇸 tweet mediaShivv 🇺🇸 tweet mediaShivv 🇺🇸 tweet media
English
10
80
109
5.3K
Armin Parchami รีทวีตแล้ว
Tom Howlett
Tom Howlett@leantomato·
SlopCodeBench is a great framework for testing out different agent configurations and the impact they have on quality. I'm excited to try out the latest release!
Gabe Orlanski@GOrlanski

Very excited to announce the v1.0 of SlopCodeBench release: - Doubling the size of the dataset - @harborframework support - scb-check: a CLI that flags slop anti-patterns - Way more model results scbench.ai github.com/SprocketLab/sl… 🧵

English
0
1
3
115
Armin Parchami รีทวีตแล้ว
Alex Shaw
Alex Shaw@alexgshaw·
Can agents build off their prior work? Can they continually learn? Answering these questions requires feeding your agent a sequence of tasks, each building off the prior. Today we're releasing the first major addition to the Harbor task format: multi-step tasks. We've partnered with @GOrlanski to add SlopCodeBench to the Harbor Registry as the first benchmark taking advantage of multi-step tasks.
Alex Shaw tweet media
Gabe Orlanski@GOrlanski

Very excited to announce the v1.0 of SlopCodeBench release: - Doubling the size of the dataset - @harborframework support - scb-check: a CLI that flags slop anti-patterns - Way more model results scbench.ai github.com/SprocketLab/sl… 🧵

English
6
9
65
7.4K
Armin Parchami รีทวีตแล้ว
Michelle Maxwell ™
Michelle Maxwell ™@MichelleMaxwell·
It makes you wonder why doesn’t the EU want Iran to be free?
Neo@Realneo101

🚨PRINCE REZA PAHLAVI JUST WENT FULL NUCLEAR ON THE ENTIRE EU PRESS & PARLIAMENT! 🔥🧨 I want to speak DIRECTLY to the people of Europe. In the past two weeks I held TWO MAJOR press conferences — one in Stockholm, one in Berlin. Over 150 JOURNALISTS showed up. We spent MORE THAN TWO HOURS with them… And guess what? NOT ONE SINGLE of those 150 journalists asked about the 40,000 IRANIANS SLAUGHTERED on the streets of my country on January 8th and 9th! NOT ONE asked about the 19 political prisoners EXECUTED in the last two weeks. When I told them 20 more are currently sentenced to death — CRICKETS. Not a damn question. I stood right next to a grieving mother and father who lost their sons in that massacre and begged them to listen to their stories… NOT A SINGLE ONE of those 150 journalists asked them a thing. Let that sink in. My 40,000 BRAVE INNOCENT COMPATRIOTS who were butchered fighting for liberty? They don’t give a damn. They are too busy criticizing America and Israel for taking out the dictator who’s been slaughtering our people for 47 YEARS — instead of going after the regime that’s actually doing the killing! They’d rather dig up Iran’s history than talk about what’s happening RIGHT NOW or the free democratic Iran we’re fighting for. One EU parliament member even had the nerve to say Iranians aren’t ready for democracy. To that coward and to every fake journalist in the room I say this: Iranians aren’t just “ready” for democracy… 40,000 of them just DIED for it! And I will NOT let their blood be in vain. SO HEAR ME LOUD AND CLEAR: Whether Europe stands with us or not… Whether your journalists do their damn jobs or not… Whether your politicians grow a spine or not… I WILL FIGHT FOR MY PEOPLE AND MY COUNTRY. Even if we have to do this ALONE — we are fighting until IRAN IS FREE! 🇮🇷💪 #RezaPahlavi‌ForIran @PahlaviReza

English
172
1.1K
3.2K
27.9K