learnxr.io

There were a lot of positive comments around VR/MR agentic workflows after our GDC talk, and also a few negative ones, which I completely understand, especially if you’re a senior developer who appreciates the craftsmanship that comes from writing your own code. I honestly recommend using a hybrid approach. You’re fully in control, but don’t let fear take over. Using these tools is the future, and this is just the beginning. To add to this, it took me 3-4 weeks to create last year’s demo for the Meta booth. This year, it took about 6-8 hours, honestly mind-blowing, especially when time is so precious. I can now do a lot more. Take advantage of this tech and multiply yourself by using it ;) I remember always saying, “I wish I could clone myself.” Well, this is how we can do it! 🚀

📢 GDC 2026 was epic this year! 🎉 Honestly, this event left me with so many great memories. I made incredible new friends, caught up with amazing existing ones, listened to developer feedback, and learned about a lot of exciting new games. It was also humbling to see so many people enjoy my part of the AI tools GDC talk. I truly appreciated all the positive feedback around our new MCP tools, and I also value hearing where we can improve, getting that kind of feedback in person is always incredibly helpful. Personally, I’m deeply excited about 2026 and beyond. I was moved to now be under @c_pruett leadership, and listening to his talk was truly inspiring. Hearing about where we’re heading with VR really energizes me. I can also confirm that we are heavily invested in VR this year, yes we’re also working on new hardware, just like he mentioned during his talk. Another area we’re heavily investing in is community and tools. On the community side, through Meta Horizon Start and the efforts I’ll personally be leading this year such as running the Meta Horizon Insiders program, and you will see me at a variety of events and supporting developers through hackathons. My biggest takeaway is this, this is the best moment to build for VR/MR. It may sound biased because I work at Meta, but it’s honestly not. I work very closely with our engineering teams, and I’ve seen firsthand how exponentially more productive you can be when using our AI tools. Because of that, I expect many developers to realize this and start building games at a much faster pace this year. I’ll be building as well. I’m excited to join this journey with all of you because I truly believe in XR and I know how talented this community is. Thank you ❤️ to everyone who came to GDC. I truly appreciate every single one of you building for Quest. 🙏🚀

Last year I built a full Unity VR/MR demo for our talk and the Meta booth, and it took me around 3–4 weeks to complete. This year, with only a week left before GDC, I was definitely feeling the pressure. Surprisingly, I ended up building a full VR game with AI in just one day. The tech stack 👇

📢 BIG NEWS! 🕶️ We’re launching GOAT and 2048 on Meta Ray-Ban Displays, ambient games for the in-between moments. No controllers. No friction. Just intuitive EMG + gestures, layered into your day. This is the future of play: human, lightweight, and present!

Hello Everyone!👋👓 I work fully remote in XR, so I’m usually indoors building prototypes. I’ve been testing the Oakley Meta Vanguard AI Glasses for a few weeks, and they’ve been surprisingly interesting. Excited to share why. 🎬 youtu.be/5VWwShXJm8g  ℹ️ I go over the reasons why I decided to buy these, and I show a variety of demos while using them during my new running routine. I also picked up the Garmin Forerunner 165, which integrates really well with Meta AI. Now I’m curious 💡 is this the kind of wearable you could see fitting into your running, biking, snowboarding, or other routines?

Hello everyone! 👋👓 Today, I’m continuing my AI Building Blocks series in Unity by adding Text-to-Speech features to our existing LLM prototype. This honestly makes the prototype feel more vivid. 🎥 Full video 👉 youtu.be/61VAC6oQHTQ This works by taking our LLM callback response and sending the generated text to ElevenLabs or OpenAI TTS using our Text-to-Speech agent, allowing us to turn AI responses into natural-sounding audio that works across multiple platforms.

AI makes building faster, which is amazing, but there’s still huge value in coding things from scratch. That’s where you develop deep thinking, logic, and truly lean coding pattern skills that level you up. Use AI to accelerate, not to skip understanding.

Athletic intelligence is about to hit different. AI in your glasses, hands-free capture, real-time help, open-ear audio… we’re entering the era where your gear actually thinks with you. This changes how athletes train. Mark this moment. 👀🔥

All, I recently released two YouTube videos as part of my new AI Building Blocks series, which explores how to leverage these features for VR/MR development. So far, I’ve covered the following topics: - VR/MR Project Setup with Building Blocks - Using Object Detection on-device and with cloud providers - Leveraging Large Language Models for conversational AI with text and images 📌 Here are the links to both videos: - Object Detection:  youtu.be/QIa6frPMcSQ - Large Language Models: youtu.be/Q8BFLkRYOy0 Coming up 🔜: I’ll cover TTS and STT, providing an overview of the SDK features and demonstrating how to integrate them into a custom tool I built during the LLMs video above.

Hello everyone! 👋👓 Today, I’ll show you how to use 𝐋𝐋𝐌𝐬 𝐢𝐧 𝐔𝐧𝐢𝐭𝐲 𝐰𝐢𝐭𝐡 𝐀𝐈 𝐁𝐮𝐢𝐥𝐝𝐢𝐧𝐠 𝐁𝐥𝐨𝐜𝐤𝐬, powered by AI features available in Meta SDKs v83 and later. 🎥 youtu.be/Q8BFLkRYOy0 In the last video, we configured object detection using both on-device and cloud inference for context-aware experiences. Now we’ll focus on conversational AI, using multimodal prompts, text, images, and video, to create more intelligent and interactive XR applications.

Matt, I can tell you personally that we are not getting out of VR 😉 I’ve been assigned to a team that is fully focused on VR programs and education. Hopefully, this helps answer your question.

Time to test DAT with the Ray-Ban glasses. I stayed away due to team priorities and a heavy focus on VR, but with the MIT Reality Hack hackathon coming up, I want to be familiar with the tools. 𝑰 𝒘𝒐𝒏’𝒕 𝒃𝒆 𝒕𝒉𝒆𝒓𝒆 𝒊𝒏 𝒑𝒆𝒓𝒔𝒐𝒏, 𝒃𝒖𝒕 𝑰’𝒍𝒍 𝒃𝒆 𝒐𝒏 𝑴𝑰𝑻’𝒔 𝑫𝒊𝒔𝒄𝒐𝒓𝒅 𝒂𝒏𝒔𝒘𝒆𝒓𝒊𝒏𝒈 𝒒𝒖𝒆𝒔𝒕𝒊𝒐𝒏𝒔.

📌 The project shown in today’s video is available from GitHub: github.com/dilmerv/AIBuil…

📢 Big news, everyone! 👓✨ Today, I’m excited to share that I’m starting a new video series focused on AI features for mixed reality and virtual reality projects. 🎥 Watch the full video: youtu.be/QIa6frPMcSQ  This series includes Object Detection, Large Language Models (LLMs), Text-to-Speech (TTS), and Speech-to-Text (STT). I’ll also explore how to run these features in different modes such as on-device, in the cloud, and from a local server.  🤖 AI Building Blocks were recently released with Meta XR Core SDK v83+ and Meta XR MR Utility Kit v83+ (including Passthrough Camera Access support).

Hello Everyone & Great News! 🎉 📣 Today, we're launching Meta Spatial Simulator (Beta) ! This new tool will make your Android development for Meta Quest much easier, and no more need to take your headset on and off every time. - Instantly test 2D panel apps and see how your apps scale when launched in a simulated Meta Quest headset environment. - Avoid the hassle of repeatedly taking your headset on and off, battery issues, and physical boundaries. - Develop anywhere: at home, in meeting rooms, or on the go. - Save valuable dev time and eliminate workflow bottlenecks. ℹ️ This is part of the Meta Horizon Android Studio Plugin. Login with your Meta Account and download the simulator by clicking on “Virtual Devices” 💡If you have additional questions let me know!

Hello Everyone! 👋 We recently released a new video on Spatial Anchors, which essentially allows you to pin virtual objects to real-world locations. This means that when you return to an app or put your headset on again, everything stays in the same spot. 🎥 Full Video: youtube.com/watch?v=WxtmZL…   The video covers best practices for anchor placement, how to achieve content stability with world locking, and how to enable persistence and sharing using enhanced spatial services. 📚A summary of 𝐡𝐨𝐰 𝐭𝐡𝐢𝐬 𝐰𝐨𝐫𝐤𝐬: - 𝐍𝐨 𝐆𝐏𝐒: Meta headsets localize using visual cues like edges, corners, and textures. - 𝐃𝐢𝐬𝐭𝐢𝐧𝐜𝐭 𝐟𝐞𝐚𝐭𝐮𝐫𝐞𝐬 𝐫𝐞𝐪𝐮𝐢𝐫𝐞𝐝: Anchors work best near unique objects (frames, lamps, textured walls). Plain areas reduce stability. - 𝐀𝐜𝐜𝐮𝐫𝐚𝐜𝐲 𝐫𝐚𝐧𝐠𝐞: Each anchor is reliable within ~3 meters. Use multiple anchors for large spaces. - 𝐖𝐨𝐫𝐥𝐝 𝐥𝐨𝐜𝐤𝐢𝐧𝐠: MRUK keeps content stable without manually attaching every object to an anchor. - 𝐏𝐞𝐫𝐬𝐢𝐬𝐭𝐞𝐧𝐜𝐞: Anchors are local by default and reset after a session. Enable enhanced spatial services to save, restore, and share anchors across users. 💡 𝐖𝐡𝐲 𝐢𝐭 𝐦𝐚𝐭𝐭𝐞𝐫𝐬: Understanding spatial anchors helps you build stable mixed reality experiences and guide users on placement and sharing.

I believe that this week I tested 80+ games and apps for the Meta Horizon Start Developer Competition. Last night, I reviewed a few more, and I just have to say, we have incredible talent in XR today. The amount of innovation and creativity is absolutely inspiring. I saw amazing apps and games built with Unreal, Unity, Android, and WebXR, and it’s so cool to be able to support all development paths, not just Unity. We’re getting very close to announcing the winners! 🚀

It was pretty inspiring to spend the last few days at #UnitedXR along some incredible & talented colleagues @brown_lantern @jasteinerman I met great devs and saw so many XR friends who honestly I consider at this point in my career as family!

I just received some high-quality swag from @unity as part of being a Unity Insider. If you’ve followed my updates, you know I badly needed a backpack after mine was stolen in Barcelona. Well, Unity surprised me today with this! Thank you, it’s been a pleasure creating Unity dev content for nearly a decade.

✨ Reflecting on how much my life has changed this year. I’m about to hit one year at Meta as a Developer Advocate, and so much has happened. I’ve spoken at dozens of events (MIT, GDC, Unity Unite, Meta Connect, Harvard, Stanford, and many more), supported dozens of hackathons, and prototyped demos showcased at major industry events. But the most meaningful part has been going from making YouTube dev videos to helping developers one-on-one and watching their ideas come to life. Honestly, I can’t wait to see what the rest of the year brings, and what we can build together next year to help even more of you turn ideas and dreams into reality. 🚀