VirtualCube: An Immersive 3D Video Communication System

@article{Zhang2022VirtualCubeAI,
  title={VirtualCube: An Immersive 3D Video Communication System},
  author={Yizhong Zhang and Jiaolong Yang and Zhen Liu and Ruicheng Wang and Guojun Chen and Xin Tong and Baining Guo},
  journal={IEEE Transactions on Visualization and Computer Graphics},
  year={2022},
  volume={28},
  pages={2146-2156}
}
The VirtualCube system is a 3D video conference system that attempts to overcome some limitations of conventional technologies. The key ingredient is VirtualCube, an abstract representation of a real-world cubicle instrumented with RGBD cameras for capturing the user's 3D geometry and texture. We design VirtualCube so that the task of data capturing is standardized and significantly simplified, and everything can be built using off-the-shelf hardware. We use VirtualCubes as the basic building… 

Figures and Tables from this paper

References

SHOWING 1-10 OF 93 REFERENCES
Blue-c: a spatially immersive display and 3D video portal for telepresence
We present blue-c, a new generation immersive projection and 3D video acquisition environment for virtual design and collaboration. It combines simultaneous acquisition of multiple live video streams
Encumbrance-free telepresence system with real-time 3D capture and display using commodity depth cameras
  • Andrew Maimone, H. Fuchs
  • Computer Science
    2011 10th IEEE International Symposium on Mixed and Augmented Reality
  • 2011
TLDR
A proof-of-concept telepresence system that offers fully dynamic, real-time 3D scene capture and continuous-viewpoint, head-tracked stereo 3D display without requiring the user to wear any tracking or viewing apparatus is introduced.
Immersive 3D Telepresence
Cutting-edge work on 3D telepresence at a multinational research center provides insight into the technology's potential, as well as into its remaining challenges. The first Web extra at
Achieving eye contact in a one-to-many 3D video teleconferencing system
TLDR
A set of algorithms and an associated display system capable of producing correctly rendered eye contact between a three-dimensionally transmitted remote participant and a group of observers in a 3D teleconferencing system able to reproduce the effects of gaze, attention, and eye contact generally missing in traditional teleconferences.
An immersive 3D video-conferencing system using shared virtual team user environments
TLDR
A next generation system - a 3D videoconference providing immersive tele-presence and natural representation of all participants in a shared virtual meeting space to enhance quality of human-centred communication.
Holoportation: Virtual 3D Teleportation in Real-time
TLDR
This paper demonstrates high-quality, real-time 3D reconstructions of an entire space, including people, furniture and objects, using a set of new depth cameras, and allows users wearing virtual or augmented reality displays to see, hear and interact with remote participants in 3D, almost as if they were present in the same physical space.
3D TV: a scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes
TLDR
This is the first real-time end-to-end 3D TV system with enough views and resolution to provide a truly immersive 3D experience and presents the calibration and image alignment procedures that are necessary to achieve good image quality.
Immersive Group-to-Group Telepresence
TLDR
A novel immersive telepresence system that allows distributed groups of users to meet in a shared virtual 3D world based on two coupled projection-based multi-user setups that indicates the mutual understanding of pointing and tracing gestures independent of whether they were performed by local or remote participants.
VR facial animation via multiview image translation
TLDR
This work presents a bidirectional system that can animate avatar heads of both users' full likeness using consumer-friendly headset mounted cameras (HMC) and addresses two main challenges in doing this: unaccommodating camera views and the image-to-avatar domain gap.
Gaze correction for home video conferencing
TLDR
This work presents a gaze correction approach based on a single Kinect sensor that preserves both the integrity and expressiveness of the face as well as the fidelity of the scene as a whole, producing nearly artifact-free imagery.
...
1
2
3
4
5
...