For a Metaverse-style project I modeled the CS lab I worked at and integrated Meta Avatars so we could experience the lab as a digital twin. I designed various calibration methods to sync the VR headsets with the real room so we could demo virtual avatars mixed with real people at the same location with the modality of a digital twin and IoT devices that sync between the real and virtual world. This was done with Meta Quest headsets and both the Oculus Integration package and MRTK 2 for interactions.
View MetaTwin: Synchronizing Physical and Virtual Spaces for Seamless World
Model of the MI Lab main room:
Additionally, for a similar project, I modeled a computer lab at the ATEC building at UTD and implemented a different networking solution and interactions using Unity’s openxr package.
View Side by Side with Actual Lab
Academic Publications
Peer-reviewed symposium and journal publications covering this work
MetaTwin: Synchronizing Physical and Virtual Spaces for Seamless World
MetaTwin explores real-time bidirectional synchronization between physical IoT sensor arrays and interactive virtual reality representations. We demonstrate latency-compensated spatial state replication, spatial telepresence, and user feedback modalities connecting real-world robotics with virtual counterparts.