Conference paper Open Access

Real-time Upper Body Reconstruction and Streaming for Mixed Reality Applications

Dimitrios Laskos; Konstantinos Moustakas

In view of the challenges of real-time 3D reconstruction and transmission, the research on tele-immersion systems has been quite intense. We present an end-to-end, real-time 3D reconstruction system of the human body’s upper part in mixed reality applications, implemented with the use of a single depth camera on the capture side, whereas no special setup is required. Our system captures the scene, extracts the user’s point cloud and by quantizing it, achieves real-time mesh generation and streaming. This system, together with the appropriate virtual (VR) or augmented (AR) reality equipment, creates a sense of a more direct, face-to-face communication, as if both users were in the same environment. 

© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including eprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Files (3.8 MB)
Name Size
Real-time Upper Body Reconstruction and Streaming for Mixed Reality Applications.pdf
3.8 MB Download
All versions This version
Views 2222
Downloads 1212
Data volume 45.6 MB45.6 MB
Unique views 1313
Unique downloads 99


Cite as