felixkit

How to Create a Three.js Component with Rollup #threejs #npm #nodejs #js link.medium.com/R9j7jP3frQb

@RadianceFields @SonyElectronics Thanks for the information and the great work 👍

@felixkit @SonyElectronics It’s a 14mm G Master!

The move into hyper-real 3D capture for corporations and consumers is rapidly approaching. @SonyElectronics was kind enough to lend me an Alpha 9 III kit to test out some capture workflows and the full frame global shutter camera just crushes it! For me the biggest surprise was the upgrade to the Sony CFexpress Type A card, which never hit its memory buffer. This really let me capture large areas, quickly and accurately, without worrying about the data I was collecting. I was sent the camera for free, but this post was not sponsored in any way. For my expanded thoughts, see the article below! Article👇 radiancefields.com/sony-a9-iii-an…

Just published: Camera Alignment and Gaussian Splatting Training #3DGS #GaussianSplatting #threejs #r3f link.medium.com/zp9XOlBIZNb

@__factice__ How many photos did you take, camera and lens, capture positions? Please share more details 😁

@jon_barron Download the dataset, the camera is Sony a7. Can I ask which lens are using, did not find out from Exif?

Our freshly minted ICCV2023 paper: The nice anti-aliasing of mip-NeRF 360, but with most of the speed of Instant NGP. Error rate reductions of 8%-77% compared to either prior technique, and 24x faster than the most accurate NeRF baseline we tried. jonbarron.info/zipnerf/

@janusch_patas @3pointedit Did you mean with "Osmo Action GPS Bluetooth Remote Controller", you can start and stop the recording both with 4 cameras?

@3pointedit These are Dji Osmo Action 4. I got a remote control that can sync them. But I am not sure how precise this is - i.e. what the time difference in ms is. I can do some experiments to see how it looks like. Thanks for the input :)

The Gaussian Pole in Action Here is the first capture I made on my initial attempt using standard camera settings. From a single 360-degree orbit around the bike, I extracted 452 images from the five DJI Osmo Action 4 cameras. For ease of viewing and sharing, I rendered the output with luma. While the overall result isn't bad, the details could be sharper. I'll need to tweak the camera settings. Nonetheless, I'm quite pleased with this first effort, and there's significant potential to enhance the quality further with camera setting adjustments.

@janusch_patas Did you have compared DJI Osmo Action 4 with GoPro and Insta360 action camera? Recently I try to find action camsra for Gaussian Splatting, 4-6 cameras for large scene capture.

First Impressions of the DJI Combo Action 4 Cameras in the Gaussian Pole Setup Overall, I am quite satisfied with the hardware. The image quality is excellent, the pricing is reasonable, and the cameras are mostly user-friendly. However, the following drawbacks are particularly relevant when using multiple cameras: • Data Management: Downloading data from multiple devices and processing numerous videos can be tedious. • API Limitations: There is no API available, which restricts use cases to those supported directly by the vendor or through third parties. Here, GoPro might have an advantage. • App Connectivity: The Mimo app only allows connection to one camera at a time. • Remote Control: While there is a remote control option for up to 16 cameras, it requires extra hardware. Managing all cameras via an app would be far more convenient. • Operational Mode: The remote control defaults to single camera mode upon power-up and must be manually switched to multi-camera mode. Pairing issues sometimes require resetting the remote control. • Power Management: The wake-up feature only functions in single mode if a camera is asleep. In multi-camera mode, capturing is essentially the only operation; individual or all cameras cannot be put to sleep or woken up manually if one goes offline. • Synchronization: While camera syncing is possible, the timecode feature is obscure and poorly documented. It necessitates connecting each camera individually via the app for reliable operation, which is cumbersome. The internal clocks also seem to drift quickly after multiple power cycles. A simultaneous sync feature like GoPro's QR-code system would be beneficial. Despite these challenges, once set up, the multi-camera system operates reliably. However, many aspects of the setup process are cumbersome. For professional use, it might be worth considering the more expensive GoPros which is programmable. As I gain more experience with the Gaussian Pole setup - and I plan to modify its architecture - I will provide further updates. What are you interested in seeing next? • More detailed reviews of individual features? • Tips and tricks for optimizing multi-camera workflows? • Behind-the-scenes of my modifications to the Gaussian Pole?

@janusch_patas Camera yaw and pitch are also very important, and different level of height.

What is the best pattern to scan a big hall in one pass? Something like on the image? Imagine that there is stuff standing in the hall. It is not empty but has no walls. It is necessary to scan the inner part to capture all details.

Installing Gaussian Splatting on Windows is not easy. The main issue is that the official source code supports Visual Studio 2019 for Windows. link.medium.com/KECbKvzgMMb

@willeastcott @playcanvas Beautiful demo, I'll try it later. Thanks for your response 😁

@felixkit @playcanvas The PLY was generated from your gallery images and dropped into the VR Starter Kit in the PlayCanvas Editor. That's all. 😀 It took a few minutes once I had the PLY with 0 lines of code.

3D Gaussian Splatting in VR on Apple Vision Pro. 🥽 Gallery PLY from @felixkit rendered by @playcanvas.

The article provides a detailed guide on how to install Inria’s Gaussian Splatting source code on a Windows machine using the Windows Subsystem for Linux (WSL). link.medium.com/0dEu2L3S5Lb

I just published Create a React Three Fiber project link.medium.com/AxbH0nZQVKb

Chinese Translation of "Gaussian Splatting Brings Art Exhibitions Online with Yulei" 高斯散射技术将艺术展览搬到网上 link.medium.com/P0R0ghce7Hb

@tinotibaldo The application have English version, which select language at landing screen. For audios, there is one have subtitle, the other two have not.

@felixkit 我的中文水平还不够好。 你可以添加字幕吗🥹

Lonely Island Exhibition VR 🥽 current-exhibition.com/lonelyislandvr/ Runs smoothly on Oculus and PICO. Haven't tested with Apple Vision because don't have it. 🤑 Powered by #threejs #r3f #nextjs

In this article, I introduce process of capturing images for Gaussian Splatting. Your feedback and insights on how I can improve this article are greatly appreciated. Capture Images for Gaussian Splatting @heyulei/capture-images-for-gaussian-splatting-81d081bbc826" target="_blank" rel="nofollow noopener">medium.com/@heyulei/captu… #3DGS #threejs #r3f #nerf