🏀 I built this PoC using a single 2D broadcast video: applied pitch detection, player positioning, and movement tracking to reconstruct the play in 3D and map it onto a real basketball court in XR.
made an iPhone app + widget with @nithineluva
an investigation into alternative timekeeping. every scribble marks 24 hours, and the red dot plots the present moment
spontaneous napkin sketch -> skipped figma -> gemini, claude, gpt, cursor
@alexanderchen haha just a mock for now - but i think a multi-cam setup + LiDar would give you everything you need for volumetric video / 4D Gaussian Splatting / etc
I built my own omni assistant using Gemini 1.5 Flash to guide me through Super Mario 64.
Gemini can see what I do on my screen and communicate with me in real time via voice, and thanks to the long 1M context, it has a memory of everything we do together.
Incredible.