Nick Sharp

613 posts

Nick Sharp banner
Nick Sharp

Nick Sharp

@nmwsharp

3D geometry researcher: graphics, vision, 3D ML, etc | Senior Research Scientist @NVIDIA | running, hockey, baking, & cheesy sci fi | opinions my own | he/him

Seattle, WA 参加日 Mayıs 2018
319 フォロー中6.1K フォロワー
固定されたツイート
Nick Sharp
Nick Sharp@nmwsharp·
Giant new v1.2 release of Polyscope! Adds support for tet & hex meshes, transparency, ground shadows, slice planes, variable-size points, setting camera views, and more. Try Polyscope for easy 3D visualization in C++ & Python: polyscope.run Thread of new features! 1/n
English
5
49
331
0
Nick Sharp
Nick Sharp@nmwsharp·
Visual reconstruction started with meshes, then NeRFs, and now Gaussian Splats. We went through the same with physical reduced order models: from classic tet meshes, to neural fields, and ultimately a careful particle-based method that gets the best of all worlds. Check it out!
Donglai Xiang@DonglaiXiang

Excited to share FreeForm☁️: Reduced-Order Deformable Simulation from Particle-Based Skinning Eigenmodes at #CVPR2026 FreeForm enables fast elastodynamic simulation for robotics and beyond, directly on messy data (no mesh needed)!

English
0
3
25
2.9K
Nick Sharp
Nick Sharp@nmwsharp·
This summer I'll be speaking at LOGML, a program on geometry & learning in London! Come find out how the discrete structure of 3D data meets the tools and techniques of ML 🚀 Applications to the program are still open for a few more days, check it out!
LOGML Summer School@LogmlSchool

📣 Participant Applications Open: LOGML’26, Imperial College London (13–17 July) A week on geometry/topology + ML talks, tutorials, projects & networking. 👩‍🎓 Students/PhD/Postdocs 💰 Limited fee waivers & travel support 🗓 Deadline: 1 May 2026 🔗 Apply: forms.gle/RjxJHCdKVJF41V…

English
2
2
20
2.5K
Nick Sharp がリツイート
Tianchang Shen
Tianchang Shen@TianchangS·
Seeing how realistic video generation has become, I always imagined a model that continuously constructs a 3D world as you move through previously unseen environments. Today, I’m excited that we’ve made it real! Lyra 2 turns images into explorable 3D worlds—and the environment generated along your trajectory can be exported as 3D Gaussian Splatting and meshes, making it directly usable for real-time rendering and physics simulations.
Xuanchi Ren@xuanchi13

We scaled up Lyra to generate explorable 3D worlds! 🚀 Introducing Lyra 2.0 — turning a single image into a 3D world you can walk through, look back, and even drop a robot into 🤖 Code and Model available today! 🌐 Website: research.nvidia.com/labs/sil/proje… (1/N)

English
4
8
65
7.1K
Nick Sharp がリツイート
Xuanchi Ren
Xuanchi Ren@xuanchi13·
We scaled up Lyra to generate explorable 3D worlds! 🚀 Introducing Lyra 2.0 — turning a single image into a 3D world you can walk through, look back, and even drop a robot into 🤖 Code and Model available today! 🌐 Website: research.nvidia.com/labs/sil/proje… (1/N)
English
29
123
877
1.1M
Lily Goli
Lily Goli@lily_goli·
Come see Aditya’s poster today at #3DV in the afternoon poster session! And if you’re not here, no worries; Aditya’s thread is a nice summary. HiT gives great insight on how you can use cross-attention to your advantage for learning hierarchies with variable tree structures.
Aditya Vora@anvorain

HiT: Hierarchical Transformers for Unsupervised 3D Shape Abstraction - Project: aditya-vora.github.io/HiT/ - Paper: arxiv.org/abs/2510.27088 - Code: github.com/aditya-vora/HiT We will present HiT at @3DVconf Poster 5-27. Join us if you are around!

English
1
3
25
2.4K
Nick Sharp
Nick Sharp@nmwsharp·
@toshi2k2 @yang_yuezhi @CVPR Hi Prakhar, your paper looks very cool! To be clear our paper here is specifically focused on the geometric task of *convex decomposition* rather than semantic 3D segmentation; it's almost more of an acceleration structure. Looking forward to chatting more at CVPR!
English
0
0
0
88
Yuezhi Yang
Yuezhi Yang@yang_yuezhi·
Excited to share our new work at CVPR 2026: Learning Convex Decomposition via Feature Fields. We introduce the first feedforward openworld model that generates high-quality convex decomposition for any 3D shapes in seconds, enabling faster simulation. 🔗research.nvidia.com/labs/sil/proje…
English
4
34
197
35.8K
Nick Sharp
Nick Sharp@nmwsharp·
Computing a convex decomposition of a shape is a classically-hard geometry problem, yet essential for fast physics simulators. Yuezhi found a way to accelerate it by training a large model!
Yuezhi Yang@yang_yuezhi

Excited to share our new work at CVPR 2026: Learning Convex Decomposition via Feature Fields. We introduce the first feedforward openworld model that generates high-quality convex decomposition for any 3D shapes in seconds, enabling faster simulation. 🔗research.nvidia.com/labs/sil/proje…

English
1
13
110
10.2K
Nick Sharp
Nick Sharp@nmwsharp·
@yongyuanxi Too long for a tweet :) All of the above pretty much! Personally I think most about tasks where we want to analyze or generate the real physical world around us in some way; fabrication is a great one. But this involves a stack of tools from basic data to high-level reasoning.
English
1
0
7
519
Towaki Takikawa / 瀧川永遠希
@nmwsharp What do we mean exactly when we say “spatial learning”? (design for real world objects and systems? virtual spaces? navigating the world? or some abstract system like an LLM that is meant to be a primitive for compute?)
English
1
0
6
852
Nick Sharp
Nick Sharp@nmwsharp·
Totally agree. Spatial learning needs to be built with a base of tech that is scalable, efficient, precise, and controllable. 3D representations are exactly that. The best coding models are the ones that use tools the best. Care to guess what will distinguish the best 3D AI?
Ben Mildenhall@BenMildenhall

We don't expect LLMs to multiply numbers or sort lists directly within their output token stream. Instead, we ask them emit code and execute it in a separate runtime. Why predict the opposite outcome for simulating interactive worlds? worldlabs.ai/blog/3d-as-code

English
1
3
42
7.6K
Nick Sharp
Nick Sharp@nmwsharp·
@MenyJanos "IDEs" here is meant as more of an abbreviated blanket term for "code tooling", and I'd say that's gone into overdrive lately rather than disappearing. For me at least, LLM coding is filled with new interfaces, MCPs, review tools, etc, and my compiler is working harder than ever.
English
1
0
1
84
Janos
Janos@MenyJanos·
@nmwsharp It does seem like LLMs are killing IDEs though ..
English
1
0
0
65
Nick Sharp
Nick Sharp@nmwsharp·
Great read if you work in 3D. We're firmly in the middle of the "3D AI era"---why was this change so fast for text & pixels, but still so tricky for 3D? Representations are harder, and data doesn't exist. Yet in fields beyond vision, 3D is much more than means-to-an-end! (1/2)
Vincent Sitzmann@vincesitzmann

In my recent blog post, I argue that "vision" is only well-defined as part of perception-action loops, and that the conventional view of computer vision - mapping imagery to intermediate representations (3D, flow, segmentation...) is about to go away. vincentsitzmann.com/blog/bitter_le…

English
1
3
81
13.1K
Nick Sharp
Nick Sharp@nmwsharp·
@MattNiessner LLMs both help and hurt in this sense. In some ways they very much help us communicate clearly more efficiently. But also, they make it easy to disguise ill-posed ideas under a veneer of confident polish, which takes significant effort to detect.
English
0
0
2
338
Nick Sharp
Nick Sharp@nmwsharp·
@MattNiessner I disagree; the most important role of a paper is not any numerical score it achieves, but its ability to coherently communicate a new idea, so the reader can build something even better atop it. Clear presentation is hugely important. Papers are not high-score leaderboards!
English
2
0
6
377
Matthias Niessner
Matthias Niessner@MattNiessner·
Historically, academia used presentation quality as a proxy for scientific merit. Now that AI is eliminating polish overhead, everyone is confused, often stuck in debates whether we should allow LLMs. On the bright side, we are finally forced to evaluate the actual research content rather than extrapolating value from the text and visuals.
English
22
19
237
36.1K
Nick Sharp
Nick Sharp@nmwsharp·
@fchollet We considered this for discrete structured shape grammars, and identified key properties to make them act manifold-like under SGD. The "jump continuity" we discuss is this same cliff landscape---if you can make the cliffs smaller, descent works better! x.com/jackzzhang/sta…
Jack Zhang@jackzzhang

Can we apply gradient descent to discrete changes? In our new #SIGGRAPHAsia paper, we show that gradient descent can work on shape grammars, as in CAD and procedural modeling, but only if the grammars are designed correctly!

English
0
3
54
5.9K
François Chollet
François Chollet@fchollet·
Gradient descent is a powerful tool for optimization spaces that verify the manifold hypothesis, but the space of reasoning is discrete and combinatorial. GD fails in cliff-like landscapes where a single discrete change (a logical step) alters the entire outcome. Unless...???
English
97
47
940
118.3K
Nick Sharp
Nick Sharp@nmwsharp·
In engineering and art, geometry is often represented not as meshes or points, but as domain-specific structured *grammars*. In this work led by @milin_k_ and @jackzzhang, we investigated how to optimize these grammars ML-style with SGD. 4 simple rules make a huge difference!
Jack Zhang@jackzzhang

Can we apply gradient descent to discrete changes? In our new #SIGGRAPHAsia paper, we show that gradient descent can work on shape grammars, as in CAD and procedural modeling, but only if the grammars are designed correctly!

English
4
44
375
30.5K
Nick Sharp がリツイート
rishit dagli
rishit dagli@rishit_dagli·
📢want to produce realistic dynamic 3d worlds (with >100 splats) my new NVIDIA internship project, VoMP, is the first feed forward approach to convert input surface geometry to volumetric sim-ready assets by assigning real world physics materials 🌐Project: research.nvidia.com/labs/sil/proje… 📜Paper: arxiv.org/abs/2510.22975
English
2
19
96
10.5K
Nick Sharp
Nick Sharp@nmwsharp·
@swiftlysingh The majority of our interns are in PhD programs, but there can be opportunities for students at other stages as well so please apply!
English
0
0
1
460
Pushpinder Pal Singh
Pushpinder Pal Singh@swiftlysingh·
@nmwsharp This looks like a fantastic opportunity! Are you considering applications from Master's students?
English
1
0
0
582