Qingnan Fan

78 posts

Qingnan Fan banner
Qingnan Fan

Qingnan Fan

@FanQingnan

Current: Lead Researcher at VIVO. Previous: Senior researcher at Tencent; Postdoc at Stanford. Research interest: computational photography; 3DV; embodied ai

Hangzhou Katılım Ocak 2014
477 Takip Edilen447 Takipçiler
Qingnan Fan
Qingnan Fan@FanQingnan·
The physics-aware simulator is the foundation towards embodied ai in real world. iGibson, Sapien, and now Genesis, cannot wait to give it a try!
Zhou Xian@zhou_xian_

Everything you love about generative models — now powered by real physics! Announcing the Genesis project — after a 24-month large-scale research collaboration involving over 20 research labs — a generative physics engine able to generate 4D dynamical worlds powered by a physics simulation platform designed for general-purpose robotics and physical AI applications. Genesis's physics engine is developed in pure Python, while being 10-80x faster than existing GPU-accelerated stacks like Isaac Gym and MJX. It delivers a simulation speed ~430,000 faster than in real-time, and takes only 26 seconds to train a robotic locomotion policy transferrable to the real world on a single RTX4090 (see tutorial: genesis-world.readthedocs.io/en/latest/user…). The Genesis physics engine and simulation platform is fully open source at github.com/Genesis-Embodi…. We'll gradually roll out access to our generative framework in the near future. Genesis implements a unified simulation framework all from scratch, integrating a wide spectrum of state-of-the-art physics solvers, allowing simulation of the whole physical world in a virtual realm with the highest realism. We aim to build a universal data engine that leverages an upper-level generative framework to autonomously create physical worlds, together with various modes of data, including environments, camera motions, robotic task proposals, reward functions, robot policies, character motions, fully interactive 3D scenes, open-world articulated assets, and more, aiming towards fully automated data generation for robotics, physical AI and other applications. Open Source Code: github.com/Genesis-Embodi… Project webpage: genesis-embodied-ai.github.io Documentation: genesis-world.readthedocs.io 1/n

English
0
0
1
364
Qingnan Fan
Qingnan Fan@FanQingnan·
SLAM3R is a real-time, pose-free, high-quality dense scene reconstruction system. Simple, effective, and easy to deploy. Welcome to try it. It is a joint work with Shuzhe Wang (Dust3r first author) @riverakid1 Siyan Dong, Baoquan Chen, etc. Page: github.com/PKU-VCL-3DV/SL…
Shuzhe Wang@riverakid1

🚀 Excited to introduce SLAM3R, a simple and effective dense scene reconstruction system for monocular RGB videos. On top of DUSt3r, SLAM3R provides: ✅ Real-time performance ✅ High-quality reconstruction ✅ Pose-free estimation Code available: github.com/PKU-VCL-3DV/SL…

English
0
0
1
407
Qingnan Fan
Qingnan Fan@FanQingnan·
In the future, the game story will be generated by AI in real-time. However, the major technical challenge here lies in ANIMATION: how to generate high-quality and diverse animations, including facial and body expressions, for any characters given any AI-generated script.
Matt Wolfe@mreflow

Last night, Jensen Huang of NVIDIA gave his very first live keynote in 4-years. The most show-stopping moment from the event was when he showed off the real-time AI in video games. A human speaks, the NPC responds, in real time and the dialogue was generated with AI on the fly.

English
0
0
0
389
Qingnan Fan retweetledi
AK
AK@_akhaliq·
Learning Agile Soccer Skills for a Bipedal Robot with Deep Reinforcement Learning investigated the application of Deep Reinforcement Learning (Deep RL) for low-cost, miniature humanoid hardware in a dynamic environment, showing the method can synthesize sophisticated and safe movement skills making up complex behavioral strategies in a simplified one-versus-one (1v1) soccer game abs: arxiv.org/abs/2304.13653 project page: sites.google.com/view/op3-soccer
English
36
303
1.2K
293.2K
Qingnan Fan retweetledi
Chelsea Finn
Chelsea Finn@chelseabfinn·
We introduce a system for fine-grained robotic manipulation! 🤖 What’s new? * We can control cheap robots to do surprisingly dexterous tasks * New technique that allows robots to learn fine motor skills A short thread 🧵
English
14
190
955
263.5K
Qingnan Fan
Qingnan Fan@FanQingnan·
@bramble_game This is physics animation since I see that character jumping changes accordingly when the lotus leaf deforms?
English
0
0
0
0
Qingnan Fan
Qingnan Fan@FanQingnan·
@Michael_J_Black Well, agreed and disagreed. Even for clearly written papers, some reviewers still give a couple of pointless judgments and strongly reject it. I don't believe in this case others won't understand the paper.
English
0
0
1
0
Michael Black
Michael Black@Michael_J_Black·
To be clear: One has to get to stage 5 to write a really good and successful rebuttal.
English
10
3
160
0
Michael Black
Michael Black@Michael_J_Black·
The 5 stages of rebuttal grief. (1) Denial The reviewers totally misunderstood my paper. The review process is broken. R1 was clearly a student who has never reviewed before. R2 doesn’t know what they are talking about. R3 hates me.
English
13
153
870
0
Tolga Birdal
Tolga Birdal@tolga_birdal·
@FanQingnan @CVPR @mikacuy @MinhyukSung The standard datasets like ShapeNet are not so suitable for training, as they lack the extrusion decompositions. However a basic chair can be generated by a simple sketch-extrusion operation and can be decomposed by Point2Cyl. Chairs of more complicated topology can be harder.
English
1
0
1
0
Tolga Birdal
Tolga Birdal@tolga_birdal·
Point2Cyl [arxiv.org/abs/2112.09329] has a unique place within our efforts to reverse engineer the world, enabling us to decompose point clouds into editable 3D CAD models in a format directly consumable by existing CAD modelers. Our work will appear at #CVPR2022. @CVPR 1/6
Tolga Birdal tweet media
English
5
24
201
0
Qingnan Fan
Qingnan Fan@FanQingnan·
Overleaf is down to ... celebrate the Chinese new year in 20 mins? No! I need to fight until the deadline comes..
English
0
0
2
0
Qingnan Fan
Qingnan Fan@FanQingnan·
I do like the open review system, where you can comment for each reviewer independently in more detail.
Kosta Derpanis@CSProfKGD

#KostasThoughts #CVPR2022: If you receive (significantly) more than the standard three reviews, shouldn't you receive additional space in the rebuttal 🤔

English
1
0
8
0
Qingnan Fan retweetledi
Aaron Hertzmann
Aaron Hertzmann@AaronHertzmann·
We've just moved the date that @siggraph technical paper reviews will be released to authors, to be compatible with @eccvconf. So, you can submit to SIGGRAPH this Thursday, and, on March 6, if your reviews aren't good, you can withdraw and resubmit to ECCV the next day.
English
2
10
60
0