@pablovelagomez1 @rerundotio Glad you find our ARFlow useful! Can’t wait to see what you have done 🙂
English
Cake Lab (WPI)
53 posts
Cake Lab (WPI)
@wpicakelab
The Cake Lab is a computer science research group @WPI. Our 20+ faculty and graduate assistants are passionate about systems, networking, and security.
Worcester, MA Katılım Şubat 2021
53 Takip Edilen74 Takipçiler
Streaming iPhone data in real-time directly to @rerundotio 🚀
The collection process is one of the most frustrating parts of building imitation-learning datasets. I’ve got a little army of sensors—📱 iPhone, iPad, Quest 3—but getting them temporally aligned, spatially aligned, AND seeing real-time feedback while recording is tough.
I stumbled on a great library from @wpicakelab called ARFlow. It’s a thin client built on Unity’s ARFoundation that connects over gRPC to a server running Rerun for live data logging. I forked it to:
- Log the SLAM translation poses, and
- Upgrade rerun to v0.23 for my use case.
So far, it works well, but there are still a few hitches:
1. Right now, it’s solid on iPhone and iPad; my Quest 3 client is still slow and not super reliable.
2. I’m using an older ARFlow branch focused on real-time streaming only—no spatial or temporal sync yet. Unity builds for iOS keep failing. 🛠️
3. Nothing is saved locally to the client, so packet loss is a risk on shaky networks.
There’s huge potential in tapping the ubiquitous sensors we carry around every day, and ARFlow is a big step toward making that easy
Pablo Vela@pablovelagomez1
As part of the robot training pipeline, I needed the egocentric perspective. I'm building a streaming pipeline using @rerundotio and a Quest3 to fill that need. So far, I've focused on the third-person (exocentric) view, so a friend and I built a simple Unity app that takes the Quest 3 passthrough camera and streams it directly to a rerun instance. This is going to be the critical component for scale. Along with this, it should be easy enough to get camera pose data + hand tracking data This builds on top of the awesome ARFlow project, so with some more work, I should be able to extend it to work with any heterogeneous device (ARKit/ARCore/AndroidXR?) Once I have a more stable version, I'll release more info on it soon!
English
Cake Lab (WPI) retweetledi
We've open-sourced our work on depth estimation in Mobile AR! 🎉 Check out our comprehensive codebase for training, evaluation, and analysis here: [github.com/cake-lab/Mobil…]. Feel free to share your thoughts with us! #DepthEstimation #AR
Ashkan@GanjAshkan
🚀 Fresh from #HotMobile2024 & excited! Our recent work tackles depth estimation in Mobile AR, highlighting challenges, proposing possible solutions, & reviewing recent works. 🔍 Curious? Check our paper: [rb.gy/lr9r0a]. Stay tuned for more! #DepthEstimation #AR.
English
Cake Lab (WPI) retweetledi
👇👇👇check out the challenges of metric depth for mobile #AR and some ideas of how to make it better! Great efforts by @GanjAshkan to lead this project and @yiqin_zhao
This @wpicakelab paper is in collaboration with Hang Su @nvidia research.
Ashkan@GanjAshkan
🚀 Fresh from #HotMobile2024 & excited! Our recent work tackles depth estimation in Mobile AR, highlighting challenges, proposing possible solutions, & reviewing recent works. 🔍 Curious? Check our paper: [rb.gy/lr9r0a]. Stay tuned for more! #DepthEstimation #AR.
English
Cake Lab (WPI) retweetledi
#AR researchers, check out our most recent effort ARFlow, that saved us countless of hours writing platform-specific code and debugging AR system performance!
We have open sourced the project and we invite you to use and benefit from it! Contributions are welcome too!
👇👇👇
Yiqin Zhao | 赵一勤@yiqin_zhao
We will be presenting our new system demo ARFlow at @ACMHotMobile this week. ARFlow is a high performance AR data collection, streaming, and visualization system. It is designed to lower the barrier for #AR researchers to evaluate ideas in hours instead of weeks or months.
English
English
2023 lab dinner 🌶️
wish everyone a great year and hope to celebrate with more fellow lab members next time!
English
Cake Lab (WPI) retweetledi
I am very excited to share that I have received the NSF CAREER award 😊 "Toward a Specialized Edge for Augmented Reality" nsf.gov/awardsearch/sh…
Many thanks to my students @yiqin_zhao, collaborators, mentors @pshenoy, friends, family, WPI, and all panel reviewers!
English
Cake Lab (WPI) retweetledi
Cake Lab (WPI) retweetledi
Faculty openings in programming languages, software engineering, mobile health and more. Please apply if interested. Happy to answer questions!
Sunghoon Ivan Lee@ivanlee_umass
UMass Amherst CS has 7 tenure-track & 2 non-TT openings this year. I am chairing the committee for the Mobile Health position. DM me if you have questions. cics.umass.edu/jobs @csfacultyjobs
English
Cake Lab (WPI) retweetledi
If you are attending @acmmm2022 I invite you to check out our work on privacy-preserving reflection!
Happy to chat!!!
@yiqin_zhao @sheng_wei
English
Cake Lab (WPI) retweetledi
Thank you for your service also to the proceedings, finance chairs and publicity team for ensuring the success of #IC2E2022. @ Javid Taheri, Shashikant Ilager, Everton Cavalcante, Vincenzo De Maio, Tuan Tran, @ThaleiaDimitra
English
Cake Lab (WPI) retweetledi
Thank you to our program chairs @dbermbach @ckrintz, the industry chairs @punwitter Christian Klein and Sri Venugopal and the workshops chairs @lauritzthamsen @gtbelinda for putting together an exceptional program for #IC2E2022. Congratulations to all the authors and presenters.
English
Cake Lab (WPI) retweetledi
Now that #IC2E2022 is over, we would like to thank everyone who joined us in person at the beautiful Pacific Grove, CA. We hoped you enjoyed the conference and can't wait to see you again next year. Special thanks to this year's general chairs @BrandicIvona and Harumi Kuno.
English
Cake Lab (WPI) retweetledi
Only one week until our International Workshop on #Testing #Distributed #IoT #Systems (TDIS) takes place again with @IC2Econf. We are looking forward to a program with two invited keynote talks and five workshop paper presentations: tdis22.diselab.berlin💻🔬🎚️📡💥
English
Congrats to Dr. Sam Ogden who graduated in June 29 and joined California State Monterey bay as an Assistant Professor! Advisor: Prof. Tian Guo @gtbelinda “CSUMB is the closest California State University campus to the beach.” All the best Dr. Ogden!
English
Cake Lab (WPI) retweetledi
Super exited to attend #UbiComp2022 at Atlanta next week. I will present LitAR st the Immersive System session in Sept 13 10:40 AM. Looking forward to seeing everyone!
Yiqin Zhao | 赵一勤@yiqin_zhao
🔥🔥🔥 Excited to share our latest work on providing visually coherent lighting for mobile #AR, accepted to @ubicomp (IMWUT) 2022! We present LitAR, a lighting reconstruction framework. This has been a great collaboration between @KuaishouVideos. yiqinzhao.me/project/litar/
English
👏 👏 👏 congrats @yiqin_zhao and looking forward to the full presentation! 🙌 and we will present this work at Ubicomp 2022 to be held for in Atlanta. Come see us!!!
Yiqin Zhao | 赵一勤@yiqin_zhao
🔥🔥🔥 Excited to share our latest work on providing visually coherent lighting for mobile #AR, accepted to @ubicomp (IMWUT) 2022! We present LitAR, a lighting reconstruction framework. This has been a great collaboration between @KuaishouVideos. yiqinzhao.me/project/litar/
English
Cake Lab (WPI) retweetledi
🥳Excited to introduce our work on privacy-preserving reflection rendering, accepted @acmmm2022. What is reflection-based privacy in #AR? Just like physical reflection, we show that reflective virtual objects can also contain sensitive info as #lighting techniques improve (1/3)
English
Cake Lab (WPI) retweetledi
Reminder to submit your tutorial proposals by June 22nd! @lauritzthamsen @gtbelinda
conferences.computer.org/IC2E/2022/call…
IC2E 2025@IC2Econf
You now have until June 22 to submit a tutorial proposal. Join us in sunny California, we are looking forward to hosting you!
English