Spaceweasel
3.7K posts
Russian propagandist Ilya Remeslo is calling for Putin to face trial as a war criminal, insisting it be done "within the law." He argued the war is fueled only by Putin’s personal complexes and blamed him for "devastating Russia's economy." Remeslo predicts a total system collapse and expects Putin to be ousted this year. We can only dream that these words come true. The sooner, the better.
Anyone arguing that minor damage to a US aircraft, sustained while lollygagging over hostile airspace is an epoch altering event is arguing the US military is so strong that the mere damaging of one of its weapons is a great feat.
@teortaxesTex @numanderki @ripplebrain Israels economy is tied together by american assurance and security/military backup and economic aid/investment. From Bds to political isolation everything depends on americans. Not so ideal plan long-term and not to mention even policy like QME to keep them ahead won't last ♾️
JUST 🇮🇷🇺🇸: IAEA Director General Rafael Grossi says Iran's Nuclear program Will Never be Destroyed “You cannot unlearn what you've learned. Iran has the most sophisticated, fast and efficient machine that exists. They know how to make that.”
South Korea considers importing Russian oil, naphtha, Industry Ministry says reut.rs/3NNpXVo reut.rs/3NNpXVo
论文来了。名字叫 MSA，Memory Sparse Attention。 一句话说清楚它是什么： 让大模型原生拥有超长记忆。不是外挂检索，不是暴力扩窗口，而是把「记忆」直接长进了注意力机制里，端到端训练。 过去的方案为什么不行？ RAG 的本质是「开卷考试」。模型自己不记东西，全靠现场翻笔记。翻得准不准要看检索质量，翻得快不快要看数据量。一旦信息分散在几十份文档里、需要跨文档推理，就抓瞎了。 线性注意力和 KV 缓存的本质是「压缩记忆」。记是记了，但越压越糊，长了就丢。 MSA 的思路完全不同： → 不压缩，不外挂，而是让模型学会「挑重点看」 核心是一种可扩展的稀疏注意力架构，复杂度是线性的。记忆量翻 10 倍，计算成本不会指数爆炸。 → 模型知道「这段记忆来自哪、什么时候的」 用了一种叫 document-wise RoPE 的位置编码，让模型天然理解文档边界和时间顺序。 → 碎片化的信息也能串起来推理 Memory Interleaving 机制，让模型能在散落各处的记忆片段之间做多跳推理。不是只找到一条相关记录，而是把线索串成链。 结果呢？ · 从 16K 扩到 1 亿 token，精度衰减不到 9% · 4B 参数的 MSA 模型，在长上下文 benchmark 上打赢 235B 级别的顶级 RAG 系统 · 2 张 A800 就能跑 1 亿 token 推理。这不是实验室专属，这是创业公司买得起的成本。 说白了，以前的大模型是一个极度聪明但只有金鱼记忆的天才。MSA 想做的事情是，让它真正「记住」。 我们放 github 上了，算法的同学不容易，可以点颗星星支持一下。🌟👀🙏 github.com/EverMind-AI/MSA
Good morning Asia, Brent rising but also watch products as we consume products not crude. For Asia, Qatari gas is very key & for some like Pakistan, that is 100% of supply. For others, still a big challenge, such as India. Even if you are not shocked by supply, say Japan that gets gas from Australia mostly, price will be a shock. So net importer of energy will be hit. Yes, that includes coal because people will substitute and push up demand of coal when gas supply is down. Asia is in the eye of the storm. Buckle up.
hydrogen Powered Car, 1,500 km range with a 5-second refill… sounds illegal.
What Brett isn't telling you is that the power from the solar panel must be used instantly. If you want just 10 days of storage for a 400W solar panel you have to pay about $10,000 for batteries. The barrel of oil is its own battery. And if you have to put that panel in Southern England on land that would otherwise have been used for housing, you are going to pay $12,000 for the land. So: - Panel ($92) - Batteries ($10,000) - Land ($12,000) You can see why oil is still competitive.
China looks really silly now with all these high-speed train lines and metros with an incoming oil shock that will dwarf anything that came before.
I'm going to be even blunter than usual HORMUZ ISN’T GOING BACK TO FULL TRANSIT And whatever passed for stability in 2025 isn’t coming back. We’re not in a disruption. WE’RE IN A CIVILIZATIONAL RESET #Oil #EnergyCrisis #Hormuz #Geopolitics
Just spoke to @POTUS about our European allies’ unwillingness to provide assets to keep the Strait of Hormuz functioning, which benefits Europe far more than America. I have never heard him so angry in my life. I share that anger given what’s at stake. The arrogance of our allies to suggest that Iran with a nuclear weapon is of little concern and that military action to stop the ayatollah from acquiring a nuclear bomb is our problem not theirs is beyond offensive. The European approach to containing the ayatollah’s nuclear ambitions have proven to be a miserable failure. The repercussions of providing little assistance to keep the Strait of Hormuz functioning are going to be wide and deep for Europe and America. I consider myself very forward-leaning on supporting alliances, however at a time of real testing like this, it makes me second guess the value of these alliances. I am certain I am not the only senator who feels this way.
