Simon Lajboschitz retweetledi

🚀 WIP A 360° 4D Gaussian Splatting video player with a novel approach
My solution: SPAG-4D (Spherical Pixel-Aligned Gaussians for 4D)
🔬 Technical approach:
• Bijective pixel-to-Gaussian mapping - each pixel in equirectangular frame maps directly to a Gaussian
• AI depth estimation converts 360° frames to 3D point clouds
• No iterative optimization needed - milliseconds per frame vs minutes
📦 Temporal compression format:
• Base PLY + quantized position/color deltas
• Int16 position deltas + Int8 color deltas
• 51x compression: 8.1GB → 156MB for 241 frames
⚡ Browser playback:
• NPZ parsing with flate decompression
• Frame reconstruction from deltas in JS
• 500K+ Gaussians at 60fps
🎮 Unity plugin:
• Compute shader reconstruction on GPU
• Custom splat rendering shader (BiRP + URP)
• TemporalNpzLoader for streaming playback
#GaussianSplatting #4DGS #3DGS #unity3d #ComputerVision
English












