
grade eterna
474 posts

grade eterna
@gradeeterna
Visual Artist | Photographer | Gaussian Splatting | VFX
London Katılım Mayıs 2022
275 Takip Edilen3.1K Takipçiler

Testing my DJI Osmo 360 rig for gaussian splatting.
Mason’s Avenue, London.
14 million splats total. Trained with LichtFeld Studio and gsplat, edited in Houdini GSOPs, camera animation in Unity and rendered with Deckard Render.
#gaussiansplatting #3DGS
English

A few gaussian splats from the BAFTAs I worked on with @harrynelder.
Trained with LichtFeld Studio @janusch_patas.
English
grade eterna retweetledi
grade eterna retweetledi

"Thinking / Shapes" ft. Félicia Atkinson, @SatsukiShibano and @YoshioOjima
neural radiance field / gaussian splat video by @gradeeterna
text by @YoshioOjima
English
grade eterna retweetledi


I'm back on twitter cuz the #GaussianSplatting community seems to be pretty great here and I'm making a video all about Gaussian Splats.
So hit me with the coolest things happening in the splat space right now!
English


A short tutorial on how to train directly on 360 equirectangular images in LichtFeld Studio with 3DGUT @janusch_patas
Conversion scripts for Metashape Standard and Pro versions here: github.com/gradeeterna/me…
English

@janusch_patas Forgot to mention, this needs a very recent version of LichtFeld to work. If your imported camera poses or pointcloud don't look right, then you will need to update or download the latest nightly build for Windows here - github.com/MrNeRF/LichtFe…
English

@DuckbillStudio I have compared the same datasets processed in different ways, and equi is definitely a bit rougher than the others. I'm sure the poses are fine, so it needs looking into. You can apparently get past the 4080px limit by training headless with max-width 0, so will try this soon
English

チュートリアルの手順と共有されているスクリプトを使って、Metashape StandardとLichtFeld Studioの組み合わせで、360度画像を直接アライメント→3DGSのトレーニングができました。
各アプリの動作環境を持っているなら非常に簡単。

grade eterna@gradeeterna
A short tutorial on how to train directly on 360 equirectangular images in LichtFeld Studio with 3DGUT @janusch_patas Conversion scripts for Metashape Standard and Pro versions here: github.com/gradeeterna/me…
日本語

I saw that @lileaLab just shared some similar scripts and a great write-up here, so check that out too! x.com/lileaLab/statu…
龍 lilea@lileaLab
LichtFeld Studio、全天球画像(Equirectangular)のまま3DGSできるではないか! 透視投影分割不要! 1. Metashapeで全天球画像アライメント 2. transforms.json作成 3.全天球画像とtransforms.jsonをLichtFeld Studioへ 360度カメラのワークフローがだいぶシンプルになるわ。
English

@Azadux The old Insta360 Sphere for Mavic Air 2 was pretty good for NeRFs, so can't wait to try this!
English

代々木公園のケツァルコアトゥル像で、
360度動画撮影比較テスト。
フォトグラメトリと3DGSでどんな違いが出るかな。
DJI OSMO 360
vs
Insta360 X5
vs
Insta360 One RS 1-Inch

龍 lilea@lileaLab
なんか生えてきた。 この流れはDJI Osmo 360との比較検証もやらんとね!? 10bit D-Log Mに期待。 明日の日中にでも撮り比べてみよう。 Osmo 360、Insta360 X5、Insta360 One RS 1-Inch
日本語

@Hjjjhhgtyu99 @insta360 @NVIDIAAIDev I just rendered with a fisheye cam as it’s an option with 3DGUT, and wasn’t really possible before with regular 3DGS
English

@gradeeterna @insta360 @NVIDIAAIDev Is the fisheye effect simulated or is it "artefacts" from the footage ?
Yet stunning
English

Another 3DGUT scene trained on @insta360 X5 fisheyes, testing the PureVideo mode for low light. It did some weird stuff to the highlights, but still pretty good for how dark it was in there.
Barbican Centre, London.
@NVIDIAAIDev #NVIDIA3DGUT #NVIDIASweepstakes #3DGS
English

@TaviusKoktavy @insta360 @NVIDIAAIDev Thanks! Nah, I just rendered with a fisheye cam because it’s possible to with 3DGUT and thought it was fitting for the last few scenes.
English

@gradeeterna @insta360 @NVIDIAAIDev Nice test of an edge case. Is the fisheye-esque render a side effect of the 3DGUT, or is your render camera just a super low angle?
English

@lileaLab It's a shame the X5 Log only works in 5.7K and is still 8-bit. Qoocam 3 Ultra can shoot K-Log in 10-bit, but still has a similar processed look. Look forward to trying the DJI 360 with D-Log M!
English

Insta360 X5の動画画質検証の続報。
Log撮影すればディテールがぷるぷるに加工されてしまうの回避できた!
One RS 1-Inchと同様な表現になったわ。
通常動画だとフォトグラメトリのテクスチャも3DGSもぷるぷるになってしまったから、Log撮影が安定かな。


龍 lilea@lileaLab
Insta360 X5、ディテール酷くないか!? iPhoneのカメラアプリで撮影した時と同じような加工が。 Insta360 Studioから書き出す際に加工が入る。 フォトグラメトリや3DGSで使う際は要注意か。 Logで撮影すれば加工回避できるだろうか。
日本語



