Video Conferencing with Predictive Generation and Collaborative Computation across Mobile Headsets
Jin, Yili Duan, Xize Hu, Kaiyuan Wang, Fangxin Liu, Xue Liu, Jiangchuan
Jin, Yili
Duan, Xize
Hu, Kaiyuan
Wang, Fangxin
Liu, Xue
Liu, Jiangchuan
Supervisor
Department
Machine Learning
Embargo End Date
Type
Journal article
Date
2025
License
Language
English
Collections
Research Projects
Organizational Units
Journal Issue
Abstract
Virtual Reality (VR) has emerged as a transformative platform for remote collaboration, but its adoption for video conferencing is hindered by challenges related to facial expression reconstruction and computational resource constraints, especially on economical mobile VR headsets. This paper introduces a novel system for VR video conferencing that addresses these challenges through two key modules: Predictive Generation and Collaborative Computation. Predictive Generation leverages multimodal inputs, including voice, head motion, and eye blinks, to synthesize realistic facial animations with low latency, eliminating the need for high-precision hardware. Collaborative Computation enhances computational efficiency by employing a game-theoretic framework for resource sharing among users. Experimental evaluations demonstrate that our system delivers immersive and realistic VR video conferencing experiences with superior facial expression reconstruction and efficient resource utilization. Our approach makes VR video conferencing more accessible and practical for a broader audience across mobile headsets. © 2002-2012 IEEE.
Citation
Y. Jin, X. Duan, K. Hu, F. Wang, X. Liu and J. Liu, "Video Conferencing with Predictive Generation and Collaborative Computation across Mobile Headsets," in IEEE Transactions on Mobile Computing, doi: 10.1109/TMC.2025.3582284
Source
IEEE Transactions on Mobile Computing
Conference
Keywords
Mobile VR Headset, Video Conferencing, Virtual Reality
Subjects
Source
Publisher
IEEE