Chen Liang

27 posts

Chen Liang

Chen Liang

@ChenLiangCS

PhD at UMich CSE. I design and develop systems to make interactions more accessible

Katılım Nisan 2021
407 Takip Edilen361 Takipçiler
Chen Liang
Chen Liang@ChenLiangCS·
Introducing HandProxy, a speech-controlled virtual proxy hand that interprets the user’s natural speech input and performs hand interactions in XR on the user's behalf. Accepted in #IMWUT 2025 (1/n) Paper: bit.ly/4fjdEJN Demo Video: bit.ly/40KXtPy
English
7
6
24
2.7K
Chen Liang
Chen Liang@ChenLiangCS·
We envision HandProxy will expand the design of existing speech interfaces in XR, and hope this can be implemented on the system level to provide a uniform, cross-application input solution for accessible control and input automation of hand interactions. (7/n)
English
0
0
0
141
Chen Liang
Chen Liang@ChenLiangCS·
A user study on various hand interaction tasks showed a 91.8% command execution accuracy, with an average of 1.09 attempts per speech command. HandProxy was able to interpret diverse commands users issued during tasks, and users found it flexible, effective, and easy to use (6/n)
English
0
0
0
94
Chen Liang
Chen Liang@ChenLiangCS·
To do so, HandProxy continuously captures speech input and uses LLM to decompose it into a list of hand control primitives. They are used to calculate the 3D hand joints for the hand movement, and joint data is streamed to the virtual environment for hand control (5/n)
English
0
0
0
81
Chen Liang
Chen Liang@ChenLiangCS·
Users can issue various commands, such as gesture (pinch, grab the cube), timing (stop, undo), movement (move up, twist left), or high-level interaction goals (reduce the volume, increase brightness) where HandProxy interprets and decomposes it into detailed hand controls (4/n)
English
0
0
0
74
Chen Liang
Chen Liang@ChenLiangCS·
HandProxy introduces a virtual hand as an interaction proxy. It expands the affordance of speech interfaces to support expressive hand interactions. Users can initiate hand interactions through natural speech, and the system interprets and decomposes it to hand movements (3/n)
Chen Liang tweet media
English
0
0
0
111
Chen Liang
Chen Liang@ChenLiangCS·
Hand interactions are widely used in XR but are not always feasible, e.g., due to (situational) impairments, environmental constraints. Speech can be used as an alternative, but is often limited to initiating basic gestures and system controls (2/n)
Chen Liang tweet media
English
0
0
1
106
jaylin herskovitz
jaylin herskovitz@jayhersk·
I’m so happy to share that I’ll be joining @TuftsUniversity @TuftsCS as an Assistant Professor in January 2026! 🥳 I’ll be recruiting PhD students this upcoming cycle, so keep an eye out for more info if you’re interested in accessibility, AI, and HCI! (1/2)
jaylin herskovitz tweet media
English
36
16
299
20.2K
Chen Liang retweetledi
Tzu-Sheng Kuo 郭子生
Tzu-Sheng Kuo 郭子生@tzushengkuo·
Serving as the Student Volunteer Co-Chair at @ACM_CHI has been an incredible experience! A huge thank you to the 200 student volunteers who worked tirelessly behind the scenes to help make the conference a success. Looking forward to seeing you all next year in Barcelona!
Tzu-Sheng Kuo 郭子生 tweet media
English
3
3
46
2K
Chen Liang retweetledi
Michigan Engineering
Michigan Engineering@UMengineering·
NEW: “New phone case provides workaround for inaccessible touchscreens” Touchscreens are everywhere but not built for everyone. A new device could help bridge that gap, helping users access ticket kiosks, restaurant menus and more. Click image for story bit.ly/45PC5bk
English
0
5
10
2.3K
Chen Liang
Chen Liang@ChenLiangCS·
With more related research (TouchA11y, TakeMyHand) contributing to the growing space of touchscreen accessibility, we hope BrushLens could provide an additional perspective to bring independence and agency for users to interact with diverse inaccessible touchscreens. 5/6
English
1
0
3
323
Chen Liang
Chen Liang@ChenLiangCS·
Excited to share our #UIST2023 paper BrushLens: Hardware Interaction Proxies for Accessible Touchscreen Interface Actuation - a phone case with actuators to locate and tap buttons for users. 30s: bit.ly/3sYcTSf Vid: bit.ly/3Zh88zh Paper: bit.ly/3Pii9aU
GIF
English
1
13
42
10.8K
Chen Liang
Chen Liang@ChenLiangCS·
I'm honored to receive recognition for my dedication and passion in teaching. Thank you CSE and my advisor @AnhongGuo for the support and guidance!
Computer Science and Engineering at Michigan@UMichCSE

We're thrilled to announce the Outstanding GSI and IA Award winners for 22-23! myumi.ch/w78QJ Sending our heartfelt congratulations and thanks to these exceptional student teachers! Your enthusiasm, expertise, and dedication have had a lasting impact on CSE students

English
0
3
26
2.7K