Daehwa Kim

What if the XR glasses could place a microphone on your fingertip without actually attaching anything to your hand? In our recent #CHI2026 work, SoundBubble captures subtle interaction sounds inside a small acoustic “bubble” around the finger, enabling a range of new interaction techniques.

@yolohao Force feedback is all you need 😎

@talking_kim usb wizard!

Graph-as-Policy (GaP) creates computation graphs (like ROS) for more modular and interpretable robot execution, yet generalizable to various tasks. This is my first collaboration at UC Berkeley AUTOLAB as a visiting researcher. Shout out to lead authors Eric and Shuangyu, and I am glad I could contribute to this!

Check out @SCSatCMU’s wonderful feature on our recent project, SoundBubble!

Last but not least, I’ll be chairing the “Inferring Human State” session at #CHI2026. There are many exciting projects from amazing authors on sensing-based human pose estimation and psychological state inference. Join us in Room 127 at 9:00 AM.

@RefreshSource Thanks Sosuke!! How cool would gaze-responsive listening sound be!

傑作だ。 Clément AderによるThéâtrophone以来の聴覚拡張だ。 Gaze-orchestrated dynamic windowsだ。 Mindless attractorだ。 x.com/talking_kim/st…

@vaguelinkage @rsnous Yes! Many conference meeting room mics (usually ceiling-mounted) work in the way you mentioned to amplify the speaker's voice. Rather than focusing on speech, our work extracts sounds from your fingertips and this reveals useful and interesting information for interactive apps.

@talking_kim @rsnous Are there microphones that do this from the the other direction, pointed at you? i.e. lock on to the lips to get isolated voice?

What if the XR glasses could place a microphone on your fingertip without actually attaching anything to your hand? In our recent #CHI2026 work, SoundBubble captures subtle interaction sounds inside a small acoustic “bubble” around the finger, enabling a range of new interaction techniques.

@oldestasian Oh what I didn’t know there is a Wikipedia page for it. merges to Chris’ vision

@talking_kim Ok now you can get added to the scratch input Wikipedia page

And you can watch the full video here! youtu.be/UDyzusbP8C8

For more details, check out the paper and source code: * paper: daehwakim.com/soundbubble/ * code: github.com/FIGLAB/SoundBu…

@YueJiang_nj Hehe thanks!

@talking_kim @CarnegieMellon @cmuhcii @LeRobotHF Wow soooo cool

At @CarnegieMellon @cmuhcii parties, we vibe with robot DJs :P @LeRobotHF

🔋 What if wearables never needed batteries? Power-over-Skin research project by @oldestasian, @talking_kim & @hciprof from @CarnegieMellon uses intra-body RF energy to power battery-free wearables—even head-to-toe and through clothing. In the demo, a controller ring built with our XIAO nRF52840 runs sensing & BLE on just 61–1500 µW, showing what ultra-low-power MCUs can unlock for always-on wearables. Watch the video by the Future Interfaces Group 👇 tinyurl.com/2y3fc96b

Good Old-Fashioned Engineering Can Close the 100,000-Year “Data Gap” in Robotics. Science Robotics Editorial: science.org/doi/10.1126/sc…

📣 The Student Volunteer lottery for #UIST2025 is now open! Be part of the team that brings UIST to life and make valuable connections with fellow students and leading researchers. 🔗 Application details: #student-volunteer" target="_blank" rel="nofollow noopener">uist.acm.org/2025/cfp/#stud… 🗓️ Deadline: August 24, 2025 (AoE)

@gnouc_ @acm_chi thanks! there's also a fun story behind this work. you can check out this page :D daehwakim.com/dotlidar

@talking_kim @acm_chi really cool work!

Yes, your iPhone already has a projector—using invisible light! 📱✨ In my latest research at @acm_chi, we repurpose its LiDAR dot pattern as a visual marker, enabling paired AR experiences without any online communication or pre-registration.

Research is done in amazing collaboration with @nneonneo @hciprof ✨ You can find more details from our recently published paper at #CHI2025. Here are the preprint, full video, and code: figlab.com/research/2025/…

This localization enables on-the-go shared AR without pre-registration!