PHORIA

We're thrilled to announce that our #MixedReality experience Spatial Fusion has been recognised in @TheWebbyAwards! 🏆 Vote for Spatial Fusion: vote.webbyawards.com/PublicVoting#/… #Webby #WebbyAwards #Metaverse #MetaQuest #SpatialFusion #PeoplesVoice #Immersive #WebXR

Spatial ASMR 📸: Apple Vision Pro

ついに3D Gaussian Splattingで作ったデータが物質化した。これはまだプロトタイプ。研究していくっ

Bye XR devs! Almost 2 years ago, I had the privilege to join Meta's Reality Labs during a focus year for MR. Since then priorities changed and budgets have shifted, which sadly affected my contract as well. Therefore, starting in January, I am open to new projects, ideas and challenges! It is crazy to think of what we achieved in these 2 short years. I had the chance to create new and update old Oculus GitHub samples, completely rework the MR developer documentation, found and fixed numerous bugs and potential developer friction, attended a dozen or so hackathons, presented my work at and contributed to Meta Connect 2024 and 2025, shipped new features in the XR SDK and most recently worked on AI tooling for Unity developers. I am sad to abandon my work in progress, that I was extremely excited about, and not be able to interact with developers so closely anymore. However, my mind is buzzing with ideas and I was able to gain a wealth of experience by working alongside the most amazing colleagues I could ever wish for. I will take some time to reflect on this over the holidays and write down my thoughts soon. Merry Christmas 🥽

🚀 Introducing UniRelight, a general-purpose relighting framework powered by video diffusion models. 🌟UniRelight jointly models the distribution of scene intrinsics and illumination, enabling high-quality relighting and intrinsic decomposition from a single image or video.

ByteDance’s Pico headsets got a GREAT new feature: you can screen record your perspective in full 3D using the MV-HEVC spatial video format! My Pico user friends have been sending me their clips that are completely viewable on Vision Pro. And editable on Final Cut Pro 11 😳

When I see user generated content apps like @FigminXR, I am almost URGED to imagine integrating XR into some sort of home schooling curriculum I mean LOOK AT THIS! The future generations have a great thing cooking for them

DroneSplat: 3D Gaussian Splatting for Robust 3D Reconstruction from In-the-Wild Drone Imagery Abstract: Drones have become essential tools for reconstructing wild scenes due to their outstanding maneuverability. Recent advances in radiance field methods have achieved remarkable rendering quality, providing a new avenue for 3D reconstruction from drone imagery. However, dynamic distractors in wild environments challenge the static scene assumption in radiance fields, while limited view constraints hinder the accurate capture of underlying scene geometry. To address these challenges, we introduce DroneSplat, a novel framework designed for robust 3D reconstruction from in-the-wild drone imagery. Our method adaptively adjusts masking thresholds by integrating local-global segmentation heuristics with statistical approaches, enabling precise identification and elimination of dynamic distractors in static scenes. We enhance 3D Gaussian Splatting with multi-view stereo predictions and a voxel-guided optimization strategy, supporting high-quality rendering under limited view constraints. For comprehensive evaluation, we provide a drone-captured 3D reconstruction dataset encompassing both dynamic and static scenes. Extensive experiments demonstrate that DroneSplat outperforms both 3DGS and NeRF baselines in handling in-the-wild drone imagery.

this is officially one of my favorite new apps: Sceno on Apple Vision Pro! i couldn’t stop smiling while reliving memories exactly where they happened. you can browse past photos in immersive panoramas and explore new locations. i highly recommend it!

If you haven't experienced Julaymba at one of our international presentations, now's the time to explore the Daintree Rainforest from your living room: bit.ly/4cRMEhL #MetaQuest #Meta #VR #MixedReality #App #ImmersiveExperience #VirtualReality #Tech #MetaQuest3

We’re beyond excited to share that Julaymba, our award-winning Mixed Reality experience, is now available as an app on the Meta Quest Store! Download now: bit.ly/4dQrYHW #Julaymba #MetaQuest #MetaQuest3 #VR #XR #MixedReality #ImmersiveExperience #Tech #Meta #NewVR

Our debut app for the Apple Vision Pro, 'REWILD,' is available for download! Immerse yourself in ocean rewilding, encounter endangered wildlife up close, & take meaningful actions to advocate for our planet. Download: apple.co/467zpI7 #AppleVisionPro #SpatialComputing

Don’t miss the chance to immerse yourself in the powerful story of Julaymba at St Kilda Film Festival. 📅 Join us at the Alex Theatre (1/135 Fitzroy St, St Kilda) on June 15-16. Learn more about Julaymba: bit.ly/3KmeeYB #stkildafilmfest #immersiveexperience #melbourne

@xrtoday have awarded Julaymba 'Best XR Experience' at the #XRAwards24! This is such an honour. A huge congratulations to the entire Julaymba production team! #XR #FirstNations #ImmersiveStorytelling #Studio

This new AI converts a single photo into an immersive scene! It works like magic and looks great on Apple Vision Pro and Meta Quest. Congrats @cinemersivelabs for this breakthrough! Demo links are below.

Seamless non-repetitive texture painting. This is awesome: "[SIGGRAPH '24] Diffusion Texture Painting" Paper (pdf): drive.google.com/file/d/1mPy_hU… Project: research.nvidia.com/labs/toronto-a…

Create a 3D model from a single image, set of images or a text prompt in < 1 minute 😮‍💨 This new AI paper called CAT3D shows us that it’ll keep getting easier to produce 3D models from 2D images — whether it’s a sparser real world 3D scan (a few photos instead of hundreds) or your favorite 2D image generator like Midjourney (just an image). How does this magic work? “This architecture is similar to video diffusion models, but with camera pose embeddings for each image instead of time embeddings. The generated views are passed into a robust 3D reconstruction pipeline to create the 3D representation (Zip-NeRF or 3DGS)”

This is insane!🔥 This is a 720p (2D) video I shot of my kids 15 years ago! I used AI to upscale it, depth-map it, & used the depth map to convert it to 3D SBS, & then converted that to Spatial Video for Apple Vision Pro (MV-HEVC). My son is currently a senior in high school, and my daughter is a sophomore in college. This video has complete spatial depth when viewed in the Apple Vision Pro. Obviously, you can't appreciate that via this post. But it's like I'm there & I can see into this room. Talk about giving you the feels.🥹 This can be done with ANY video. 🤯 I'm working on refining the workflow, as it's a bit cumbersome. I plan to share it, but holy cow! I had to post this.

🚨 Apple Vision Pro has more than 1 million apps. Here are the top 10 new apps you haven't heard before: 1/ @seasons_app

I imagine that inventing a TV felt somewhat similar. 🤯 Gaussian splatting video in VR, now running at 2x2224x2160 @ 100 FPS. iPhone's Spatial Videos simply can't compare, temporal flickering is there to remind your brain you're in VR! 🧵on performance, details, and next steps:

We had an AI break-through! 🤯 We've auto-NeRFed 2D 360° images generated with Skybox AI into 3D explorable worlds, to include free roam and dynamic lighting! Think of all the possibilities! Hello game devs 🫡