Sam 𝕏u

27 posts

Sam 𝕏u

Sam 𝕏u

@SamXu03799145

#vibufacturing, Autodesk, SFU, CMU

Katılım Temmuz 2022
311 Takip Edilen209 Takipçiler
Sam 𝕏u
Sam 𝕏u@SamXu03799145·
Major breakthrough in CAD Generation! We’ve just cracked a long-standing barrier: CAD models with hundreds of faces can be compressed into only a few thousand tokens — and an LLM generates the entire topology + primitive. Who’s ready for CAD-GPT? research.autodesk.com/publications/a…
English
0
0
5
682
Sam 𝕏u
Sam 𝕏u@SamXu03799145·
We are seeking a passionate and talented student with experience in 3D generation, Transformer, and Diffusion Models. In particular, if you are interested in CAD generation such as our prev work BrepGen → brepgen.github.io , please consider applying!
English
0
0
1
704
Vivian Liu
Vivian Liu@viv_lavida·
really happy to share that 3DALL-E, a research idea I began at @ADSKResearch as an intern is now in Autodesk Fusion 360 as Project Salvador (thank you to @jozilla, @JustinMatejka for realizing it in the product). You can generate images to use as blueprints for 3D models!
GIF
English
6
12
88
6.7K
Matthias Niessner
Matthias Niessner@MattNiessner·
Finally the 𝐌𝐞𝐬𝐡𝐆𝐏𝐓 code by @yawarnihal is online: github.com/audi/MeshGPT Also shoutout to the recent mesh generators such as MeshAnything, MeshXL, EdgeRunner, LLaMA-Mesh, and many more. It's a super exciting research area - meshes for the win!!!
Matthias Niessner@MattNiessner

(1/2) Check out 𝐌𝐞𝐬𝐡𝐆𝐏𝐓! MeshGPT generates triangle meshes by autoregressively sampling from a transformer model that produces tokens from a learned geometric vocabulary. As a result, we obtain clean and compact meshes :) nihalsid.github.io/mesh-gpt/ youtu.be/UV90O1_69_o

English
1
35
183
16.4K
Yuzhe Qin
Yuzhe Qin@QinYuzhe·
Through my years of PhD research and working with undergrad and master's students, I've realized that finding the sweet spot between guidance and freedom when advising others is a real challenge. But @xiaolonw has made it throughout my PhD journey. Over the past four years, his priceless advice has shaped my "value function" and steered my decision-making process. Thank you Xiaolong, and I'm forever grateful for your support!
Xiaolong Wang@xiaolonw

Two PhD students graduated two weeks ago: Yuzhe Qin @QinYuzhe (co-advised with Hao Su), and Yueh-Hua Wu @yh_kris. They are my first batch of robotics students. When I was a student, Alyosha told me: "Good students are your friends, you can learn from them." Yuzhe and Yueh-Hua helped me build a robotics lab when I only knew about computer vision. I have learned so much along the journey. Yuzhe is becoming a fancy CTO of his own robotics startup, DexMate. He single-handed all the robotics hardware and simulation setup in our lab for a long period of time. You probably don't need many people to do robotics, you only need one Yuzhe. He has been leading the direction of dexterous manipulation from when no one cares to now everyone is doing it. And he is naming his company after it. Yueh-Hua is joining Nvidia as a research scientist. Yueh-Hua also contributed to our initial efforts on dexterous manipulation, focusing on the Reinforcement Learning part. He later developed his own interests in offline RL, and using foundation models for control. He works on connecting 3D visual representation learning to control very ahead of time. I am sure Nvidia will be a good place to do all this research.

English
17
2
129
14.8K
Sam 𝕏u retweetledi
Autodesk
Autodesk@autodesk·
Autodesk Research Project Bernini is new experimental generative AI that can quickly generate multiple functional 3D shapes from a variety of inputs including text, 2D images, or voxels. Watch for future updates as we continue to develop cutting-edge AI: bit.ly/4bqcVU3.
English
219
218
879
2.8M
Sam 𝕏u retweetledi
AK
AK@_akhaliq·
Make-A-Shape a Ten-Million-scale 3D Shape Model paper page: huggingface.co/papers/2401.11… shape model, known as Make-A-Shape, has been trained on 10 million diverse 3D shapes. It exhibits the capability to unconditionally generate a wide range of 3D shapes, featuring intricate geometric details, plausible structures, nontrivial topologies, and clean surfaces
AK tweet media
English
1
70
384
35.7K
Sam 𝕏u retweetledi
AK
AK@_akhaliq·
Sketch-A-Shape: Zero-Shot Sketch-to-3D Shape Generation paper page: huggingface.co/papers/2307.03… Significant progress has recently been made in creative applications of large pre-trained models for downstream tasks in 3D vision, such as text-to-shape generation. This motivates our investigation of how these pre-trained models can be used effectively to generate 3D shapes from sketches, which has largely remained an open challenge due to the limited sketch-shape paired datasets and the varying level of abstraction in the sketches. We discover that conditioning a 3D generative model on the features (obtained from a frozen large pre-trained vision model) of synthetic renderings during training enables us to effectively generate 3D shapes from sketches at inference time. This suggests that the large pre-trained vision model features carry semantic signals that are resilient to domain shifts, i.e., allowing us to use only RGB renderings, but generalizing to sketches at inference time. We conduct a comprehensive set of experiments investigating different design factors and demonstrate the effectiveness of our straightforward approach for generation of multiple 3D shapes per each input sketch regardless of their level of abstraction without requiring any paired datasets during training.
AK tweet media
English
1
82
362
87.8K
Sam 𝕏u retweetledi
Chin-Yi Cheng
Chin-Yi Cheng@chinyich·
Is there a high-level yet precise way for designers to control generative models? Can we generate layouts by simply sketching several guidelines? Please check our paper at ICML--PLay: Parametrically Conditioned Layout Generation using Latent Diffusion. arxiv.org/abs/2301.11529
GIF
English
2
6
19
2.7K
Sam 𝕏u
Sam 𝕏u@SamXu03799145·
In particular, we demonstrate that our learned codebooks indeed capture the various CAD features from different hierarchy.
Sam 𝕏u tweet mediaSam 𝕏u tweet media
English
1
0
2
1.1K
Sam 𝕏u
Sam 𝕏u@SamXu03799145·
In our latest #ICML2023 paper "Hierarchical Neural Coding for Controllable CAD Model Generation" hnc-cad.github.io, we learn the design intent from different CAD hierarchies in a self-supervised manner, and demonstrate its application on multiple tasks e.g. autocomplete.
English
1
3
20
3.7K
Sam 𝕏u retweetledi
Yasutaka Furukawa
Yasutaka Furukawa@YasutakaFuruka1·
MVDiffusion: How to take a pre-trained text2image model for a perspective view (e.g., Stable Diffusion) and retrain to generate multiple consistent views (e.g., a panorama). Project site: mvdiffusion.github.io. Hugging Face demo: tinyurl.com/MVDiffusion. Code out in a month.
English
5
36
192
33.4K
Sam 𝕏u retweetledi
Yasutaka Furukawa
Yasutaka Furukawa@YasutakaFuruka1·
State-of-the-art Floorplan Generation directly in vector space via continuous and discrete denoising. This afternoon poster at 127 (now 4:30pm - 6:30pm) #CVPR2023 done by @amin_shabani and @sepidshs
GIF
English
0
4
29
3.6K