Mark Billinghurst

@twi_mar Really nice work! Are you going to make the code available?

Remember Richard Bolt’s iconic 1980 "Put-That-There" demo? 🗣️👉 youtube.com/watch?v=RyBEUy… It was a landmark moment for human-computer interaction, proving that computers would get to understand ambiguous, multimodal commands in context. (It turns out he was half a century ahead of his time) Yet, in modern computing 🖥️, we are still largely trapped in the old paradigm—manually dragging and juggling windows around. To truly build the future of spatial computing, we have to move past direct manipulation and transition into context awareness + intent-driven spaces. No better partner for that than Large Language Models (LLMs) attached directly to an XR sensor stack. In the research led by Riccardo Bovo during his time in our team we dived into bringing "Put-That-There" into the spatial computing era. (I guess it was the natural sequel to embardiment.github.io) Check out how such systems could transform any physical room into an intelligent workspace like in the video below: seamlessly blending verbal requests with non-verbal cues like pointing, gestures or head-gaze. Using AI to immediately resolve ambiguous demonstrative pronouns. A first step to "put that there" in the real world. Learn more on the paper: arxiv.org/abs/2511.02378 by @riccardobovoHCI, @dannox75, @PFallingfrog, @_ejgonz_ , @twi_mar "Revisiting put-that-there, context aware window interactions via LLMs", Workshops @ismarconf

I just gave a short presentation about eye-tracking and XR. The slides are here.. slideshare.net/slideshow/the-…

Your eyes know more about VR comfort than you might think. When you adjust luminance, shift colour temperature, or apply peripheral occlusion in VR — what actually happens to your body? Our paper introduces the Ocular Command Center framework to find out. [1/8]

Paper spotlight: @kaikaikaikai419 (ECL PhD) presents HeadZoom (ISMAR 2025) — hands-free zoom + pan for 2D content via head motion. Parallel Zoom reduced head movement + felt lower effort in a user study. ieeexplore.ieee.org/document/11220… #XR #HCI #Accessibility #ISMAR2025

Full 3MT talk is live: Andreia — biofeedback & haptics to interrupt the emotional loop. 🥇 1st Place at the @ABI_bioeng Research Forum. Your body is already running it. Her research is about intercepting it. Watch: youtu.be/Ickb2neXMg0 Read it: #pub/valente2024modulating" target="_blank" rel="nofollow noopener">andreia-valente.com/#pub/valente20… #VR

Tamil's SealMates replaced video tiles with a collective seal avatar — animated by group engagement. When the team was in sync, the seal moved. When they weren't, it stilled. Teams felt more connected. Watch: youtu.be/ZEsxjqZvQCw @ABI_bioeng dl.acm.org/doi/epdf/10.11…

@twi_mar Great work!

Hear me out, what if digital interaction was so natural by now, that we would want to bring the precision of the mouse 🐁 to our lives? (🔊sound on!) I already think of a world where AI prompts about the world are just a click🖱️away.

Teaching about Interaction Design for XR today at the IEEE VR 2026 conference. See the slides here: slideshare.net/slideshow/ieee… #interactiondesign #XR #augmentedreality #virtualreality

TBI rehabilitation is one of the hardest problems in neurorehab. Riku's People's Choice-winning 3MT talk asks: what if empathy itself could be designed into the recovery environment? What surprised you most? youtu.be/OameG04ALdA

#TBI rehabilitation is one of the hardest problems in neurorehab. Riku's People's Choice-winning #3MT talk asks: what if empathy itself could be designed into the recovery environment? What surprised you most? youtu.be/OameG04ALdA #VR #rehab

@ipoupyrev @TMobile @nvidia Congrats! I'm glad things are going so well for you..

Big news! We’re announcing a new partnership with @TMobile and @nvidia to bring Physical AI to the edge. AI is starting to move beyond digital workflows into the physical systems that run factories, infrastructure, and cities. That shift needs a different kind of tech stack where intelligence runs close to where data is generated and decisions are made. With T-Mobile and NVIDIA, we’re deploying Newton, our Physical AI foundation model, on distributed edge infrastructure powered by RTX PRO 6000 Blackwell GPUs. This brings real-time understanding of sensor data directly to the source, whether that’s a production line or a city block. How it works: 🔹 T-Mobile is turning its network into a platform for distributed AI 🔹 NVIDIA provides the accelerated compute for real-time inference 🔹 @PhysicalAI is building the model that can interpret and reason over the physical world Together, this new stack enables AI to move beyond observation into real-world impact — shifting systems from reactive monitoring to real-time understanding and control. As intelligence becomes embedded across infrastructure and environments, the result is not just more intelligent systems, but a new class of systems that can continuously learn, improve, and act at global scale. We’re excited to be among the first deploying on this. Learn more here: blogs.nvidia.com/blog/telecom-a… Book a demo to explore Newton use cases at #NVIDIAGTC: archetypeai.io/put-physical-a…

My lastest keynote at the AWE Asia 2026 conference - the Emergence of Empathic XR: slideshare.net/slideshow/the-…

@PhysicalAI Congrats! That's great news..

AI goes into the real world 🌎 Today, we're starting a new chapter of Archetype as we celebrate our $35M Series A. The physical world generates vast amounts of sensor and video data every day but most of it goes unused. After years of AI living behind screens — in dashboards, apps, and digital abstractions — intelligence is finally stepping into the physical world. We're bringing the Archetype platform to more customers and evolving Newton from a powerful foundation model into an intelligence layer for the physical world—one that perceives, understands, and reasons across real-world systems, enabling hundreds of intelligent applications. And this is just the beginning. This funding round, led by IAG Capital Partners and Hitachi Ventures, with participation from Bezos Expeditions, Venrock, Amazon Industrial Innovation Fund, Samsung, E12, Systemiq Capital, HLV, and others, enables us to scale physical intelligence globally and continue advancing Newton as the premier foundation model for the real world. Thank you to our team, partners, investors, and all of you for following our journey to making the world truly intelligent. Onwards! 🚀

@philiprosedale Australia is pretty good - New Zealand as well

What country is most likely to do what actually made America great: Enticing immigrants to come and seek their fortune in a land of opportunity, strong personal freedoms, tolerance, and great education?

Are you in Auckland - join our October 22nd AR/VR Meetup: Rapid AR/VR Development with DelightEX Create AR/VR experiences with no programming. Fast, fun and easy! meetup.com/auckland-xr/ev… #Meetup via @Meetup

I gave the keynote speech at the Neuro-XR workshop at the ISMAR 2025 conference. If you are interested in neurophysiological signals, and Affective Computing in Extended Reality, you might enjoy this. Slides are here: slideshare.net/slideshow/neur… #AugmentedReality #virtualreality

@plopesresearch That’s amazing - well done

#CHI2026 breaking records with 6.7k paper submissions! It's a lot of papers (last year was ~5k, now we are closing in on ~7k!). I know we all can be grumpy about things in HCI but the field is definitely growing and very much engaging with new ideas! I find it really inspiring.

@XCypherpunk @prettydangniche Since at least 1968 - so over 50 years :)

@prettydangniche VR has been around for about 35 years. It's not "very young" at all.

VR is very young. Build the fundamentals before building the oasis. Make UI. Make omnidirectional treadmills. Build communities. Figure out what works. Leverage the tech. Innovate. Don't build the product that will exist in 30 years, build a product to shape the next 30 years.

@OscarFalmer Thanks - that's an awesome resource!

👓 Smartglasses Supersheet: Now 40+ Glasses | 20+ Tech Specs 📌 What's New • Everysight Maverick 2026 added (got eye tracking) • Enterprise models added: Vuzix Z100, DigiLens ARGO • Columns: Controller, Eye Tracking, HQ Location 🔗#gid=0" target="_blank" rel="nofollow noopener">docs.google.com/spreadsheets/d…

@tom_krikorian If it were me I’d do a demo anyway to get the display and band sizing right - once you have a good size then just buy from whomever :)

I asked Best Buy again, this time through the online chat, and they told me we can only buy after the demo. And look at what I just found on DoorDash 🫠 This is not how you launch a product… I’ll only have myself to blame if I come back empty-handed, but honestly I’m sure I’m not the only one making the trip for this.