Mark Billinghurst
1.8K posts

Mark Billinghurst
@marknb00
Augmented Reality Pioneer, Professor, Interface Designer/Researcher, Researching Empathic Computing and Collaborative Systems.
Auckland, New Zealand Katılım Ekim 2009
434 Takip Edilen5.4K Takipçiler

I met the last man in Europe who still makes kaleidoscopes by hand. He’s spent 40+ years at the same bench.
When you look inside a kaleidoscope, the instrument does not need modifications for the picture to change. The toy changes based on how the light is reflected.
Physical AI is similar. A machine is already full of signals, vibrations, currents, temperature, and motion. The challenge many industries face is knowing how to interpret the data they already.
With Newton, we can take raw physical signals from machines and turn that data into a new colorful view, much like a kaleidoscope.




English
Mark Billinghurst retweetledi

Anthropic pays $750,000+ a year for engineers who know how to build LLMs from scratch.
Stanford just released the exact lecture that teaches it - 1 hour 44 minutes, free, straight from CS229.
Bookmark and watch it this weekend.
It'll teach you more about how ChatGPT & Claude actually work than most people at top AI companies learn in their entire careers.
Rahul@sairahul1
English

@twi_mar Really nice work! Are you going to make the code available?
English

Remember Richard Bolt’s iconic 1980 "Put-That-There" demo? 🗣️👉
youtube.com/watch?v=RyBEUy… It was a landmark moment for human-computer interaction, proving that computers would get to understand ambiguous, multimodal commands in context. (It turns out he was half a century ahead of his time)
Yet, in modern computing 🖥️, we are still largely trapped in the old paradigm—manually dragging and juggling windows around. To truly build the future of spatial computing, we have to move past direct manipulation and transition into context awareness + intent-driven spaces.
No better partner for that than Large Language Models (LLMs) attached directly to an XR sensor stack. In the research led by Riccardo Bovo during his time in our team we dived into bringing "Put-That-There" into the spatial computing era. (I guess it was the natural sequel to embardiment.github.io)
Check out how such systems could transform any physical room into an intelligent workspace like in the video below: seamlessly blending verbal requests with non-verbal cues like pointing, gestures or head-gaze. Using AI to immediately resolve ambiguous demonstrative pronouns. A first step to "put that there" in the real world.
Learn more on the paper: arxiv.org/abs/2511.02378 by
@riccardobovoHCI, @dannox75, @PFallingfrog, @_ejgonz_ , @twi_mar "Revisiting put-that-there, context aware window interactions via LLMs", Workshops @ismarconf

YouTube
English

I just gave a short presentation about eye-tracking and XR. The slides are here..
slideshare.net/slideshow/the-…
English
Mark Billinghurst retweetledi
Mark Billinghurst retweetledi

Paper spotlight: @kaikaikaikai419 (ECL PhD) presents HeadZoom (ISMAR 2025) — hands-free zoom + pan for 2D content via head motion.
Parallel Zoom reduced head movement + felt lower effort in a user study.
ieeexplore.ieee.org/document/11220…
#XR #HCI #Accessibility #ISMAR2025

English
Mark Billinghurst retweetledi

Full 3MT talk is live: Andreia — biofeedback & haptics to interrupt the emotional loop. 🥇 1st Place at the @ABI_bioeng Research Forum.
Your body is already running it. Her research is about intercepting it.
Watch: youtu.be/Ickb2neXMg0
Read it: #pub/valente2024modulating" target="_blank" rel="nofollow noopener">andreia-valente.com/#pub/valente20…
#VR

YouTube
English
Mark Billinghurst retweetledi

Tamil's SealMates replaced video tiles with a collective seal avatar — animated by group engagement. When the team was in sync, the seal moved. When they weren't, it stilled.
Teams felt more connected.
Watch: youtu.be/ZEsxjqZvQCw @ABI_bioeng
dl.acm.org/doi/epdf/10.11…

YouTube

English

Teaching about Interaction Design for XR today at the IEEE VR 2026 conference. See the slides here: slideshare.net/slideshow/ieee…
#interactiondesign #XR #augmentedreality #virtualreality
English
Mark Billinghurst retweetledi

TBI rehabilitation is one of the hardest problems in neurorehab.
Riku's People's Choice-winning 3MT talk asks: what if empathy itself could be designed into the recovery environment?
What surprised you most? youtu.be/OameG04ALdA

YouTube

English
Mark Billinghurst retweetledi

#TBI rehabilitation is one of the hardest problems in neurorehab.
Riku's People's Choice-winning #3MT talk asks: what if empathy itself could be designed into the recovery environment?
What surprised you most?
youtu.be/OameG04ALdA
#VR #rehab

YouTube

English

Big news! We’re announcing a new partnership with @TMobile and @nvidia to bring Physical AI to the edge.
AI is starting to move beyond digital workflows into the physical systems that run factories, infrastructure, and cities. That shift needs a different kind of tech stack where intelligence runs close to where data is generated and decisions are made.
With T-Mobile and NVIDIA, we’re deploying Newton, our Physical AI foundation model, on distributed edge infrastructure powered by RTX PRO 6000 Blackwell GPUs. This brings real-time understanding of sensor data directly to the source, whether that’s a production line or a city block. How it works:
🔹 T-Mobile is turning its network into a platform for distributed AI
🔹 NVIDIA provides the accelerated compute for real-time inference
🔹 @PhysicalAI is building the model that can interpret and reason over the physical world
Together, this new stack enables AI to move beyond observation into real-world impact — shifting systems from reactive monitoring to real-time understanding and control. As intelligence becomes embedded across infrastructure and environments, the result is not just more intelligent systems, but a new class of systems that can continuously learn, improve, and act at global scale.
We’re excited to be among the first deploying on this. Learn more here: blogs.nvidia.com/blog/telecom-a…
Book a demo to explore Newton use cases at #NVIDIAGTC: archetypeai.io/put-physical-a…
English

My lastest keynote at the AWE Asia 2026 conference - the Emergence of Empathic XR: slideshare.net/slideshow/the-…
English

AI goes into the real world 🌎 Today, we're starting a new chapter of Archetype as we celebrate our $35M Series A.
The physical world generates vast amounts of sensor and video data every day but most of it goes unused. After years of AI living behind screens — in dashboards, apps, and digital abstractions — intelligence is finally stepping into the physical world.
We're bringing the Archetype platform to more customers and evolving Newton from a powerful foundation model into an intelligence layer for the physical world—one that perceives, understands, and reasons across real-world systems, enabling hundreds of intelligent applications.
And this is just the beginning.
This funding round, led by IAG Capital Partners and Hitachi Ventures, with participation from Bezos Expeditions, Venrock, Amazon Industrial Innovation Fund, Samsung, E12, Systemiq Capital, HLV, and others, enables us to scale physical intelligence globally and continue advancing Newton as the premier foundation model for the real world.
Thank you to our team, partners, investors, and all of you for following our journey to making the world truly intelligent.
Onwards! 🚀
English

@philiprosedale Australia is pretty good - New Zealand as well
English

Are you in Auckland - join our October 22nd AR/VR Meetup: Rapid AR/VR Development with DelightEX
Create AR/VR experiences with no programming. Fast, fun and easy!
meetup.com/auckland-xr/ev… #Meetup via @Meetup

English

I gave the keynote speech at the Neuro-XR workshop at the ISMAR 2025 conference. If you are interested in neurophysiological signals, and Affective Computing in Extended Reality, you might enjoy this.
Slides are here: slideshare.net/slideshow/neur…
#AugmentedReality #virtualreality
English


