Research Projects: VirtualizeMe
Tele-Immersion is a fully interactive, face-to-face, viewpoint corrected, stereoscopic, virtual environment, allowing users to naturally interact with each other and the digital environment surrounding them via realistic avatars. The focus of this project is extracting, modeling and communicating the avatar of a user needed for Tele-Immersion applications by introducing a stereo video stream based 3D reconstruction system. The combination of several 2.5 D reconstruction results (disparity maps) from different viewing angles results into a high resolution extraction of avatar models with real-time characteristics. The point cloud based avatars are communicated to a remote collaboration location using lossless point cloud compression algorithms.
- Knoblauch D., Kuester F. (2008). VirtualizeMe: Interactive Model Reconstruction From Stereo Video Streams. Accepted to VRST 2008, Bordeaux (France)
- 3D Reconstruction:
- Stereo video stream based disparity map calculations for 2.5D reconstruction
- Combination of several 2.5 D reconstructions from different viewing angles
- Refine composed point cloud (noise and oversampling removal)
- Point Cloud Streaming:
- Lossless point cloud compression
- Point cloud transmission with real-time characteristics
- Point Cloud Rendering:
- High fidelity avatar rendering based on received point cloud
There are different opportunities for undergraduate and graduate students to join our research in this project.
Please Contact Daniel Knoblauch (firstname.lastname@example.org) for any questions.
- Disparity Map Research (Computer Vision)
- Implementation and Evaluation of state of the art Disparity Map Algorithms for Tele-Immersion.
- Development of new Tele-Immersion specialized disparity map algorithm.
- Point Cloud Streaming Research (Computer Graphics/Visualization, Networking)
- Implementation and Evaluation of state of the art real-time point cloud compression and streaming algorithms.
- Implementation of a Tele-Immersion specialized point cloud compression and streaming infrastructure.