
Robot (@arthurallshire)
skara
398 posts

@skara_io
cto • simulating reality for robots @bifrost_ai @sequoia @lux_capital

Robot (@arthurallshire)



some tentative thoughts on humanoid robotics 1) i'm not sure there is such a thing as asi for humanoid robotics, at least in a commercially valuable sense 2) once you have a robot that can take text instructions and turn them into decent management of a particular robot embodiment, you have captured most of the value 3) at that point, you can deploy it onto a production line, you can use it for unpacking and stocking shelves in a convenience store, perhaps it can be used in the home, etc... 4) at scale, like in a warehouse or on a factory floor, they can be coordinated using reasoning models, which receive telemetry and issue commands to individual robots and troubleshoot their behavior; 5) you can imagine further advances in robot operating models that create incremental value in particular industries, but the core of the value has already been captured 6) you can also imagine more general models that can operate multiple kinds of physical embodiments well, not just one; but i tend to think that this is mostly a cost improvement for operators 7) we should assume foundation models for robotics will follow a similar trend to llms, where the open source models trail the frontier by 9-24 months 8) this is true in part because there are well resourced players, like nvidia, that would train these models and have an incentive to open source them, to avoid concentration of their customer base 9) so, the companies that get the software advantage first have 9-24 months of lead time, but their models will saturate much more quickly than language model intelligence saturates 10) at that point, most of the value goes to whoever can produce the robots at scale and get them out at good gross margins, not to whoever produced the software 11) so, the winners look like the people that are good at building and running the factories and tooling them, plus the people that are good at training language models for discovery and operations that support this 12) my gut is that companies like figure and physical intelligence are on the wrong side of robotics on the long term; they are too invested in the software 13) tesla is maybe on the right side; chinese hardware companies are certainly on the right side; as these companies specialize in building at scale 14) there will also be many niche uses of robotics that both require further capability unlocks to be fully valuable and are vlm-shaped, like very small air gapped drones for war 15) but, i suspect this is not the majority of the economic value for humanoid robots and the majority of the value saturates on intelligence


every university should have one of these in their robotics department

boston dynamics uses mjlab btw :)





小西天,看着像视频,但其实是我们在现场实地拍摄 3,811 张 206 GB 的照片后建模的。FUNES 把《黑神话:悟空》里「既见未来,为何不拜」满天神佛的原型,来自自山西临汾隰县的小西天,做成了一个可漫游的 3DGS 数字存档。 完全实地拍摄,每天清晨一开门就冲上山去,趁着没人的时候拍。然后通过 Gaussian Splatting 重建,没有手工建模,尽量保留真实悬塑和圆塑的极其密集的金色空间、细节和光感。不同的材质在这里交织成了无法分辨的一个天国世界。这种半空中的小塑像是「悬塑」,它们大多出现在十六世纪到十七世纪。 在现场如果要看清小西天的所有细节,我想大概需要三天时间。但是有了模型,我们可以在屏幕前慢慢看。在相当长的时间里,学术界并没有特别重视小西天这样的悬塑——因为在只有学术图录的年代,平面印刷无法展示出悬塑的震撼。而随着技术的进步,我们终于可以在远方一窥明代悬塑的璀璨。 重轻特意为这个模型做了配乐,大家可以打开慢慢欣赏。 推荐电脑访问:funes.world/apps/the-hangi…

Atlas hauling a 50 lb mini-fridge - Practiced the maneuver for millions of hours in a virtual environment. - Focused the training policy on full-body engagement rather than just hand-grasping, allowing the robot to leverage its entire frame for the lift.


Do we really need massive curated 3D scene data for interactive world generation? #SAM3D, #WorldGen say yes. We say no. I-Scene learns better spatial knowlesge using only 25K randomly composed instances. 🔑 Key insight: We reprogram the instance generator to infer support, proximity, and symmetry from purely geometric cues for generating interactive scenes. 🧠 Scene-context attention 👁️ View-centric space 🧱 Random composition beats expensive curation 🌐 luling06.github.io/I-Scene-projec… 💻 github.com/LuLing06/I-Sce… 🧵 Details below [1/6]

