Research Projects: VirtualizeMe
Tele-Immersion is a fully interactive, face-to-face, viewpoint corrected, stereoscopic, virtual environment, allowing users to naturally interact with each other and the digital environment surrounding them via realistic avatars. The focus of this project is extracting, modeling and communicating the avatar of a user needed for Tele-Immersion applications by introducing a stereo video stream based 3D reconstruction system. The combination of several directional 3D reconstruction results (disparity maps) from different viewing angles results into a high resolution extraction of avatar models with real-time characteristics. The point cloud based avatars are communicated to a remote collaboration location using lossless point cloud compression algorithms.
- Knoblauch, D. and Kuester, F. (2009). Focused Volumetric Visual Hull with Color Extraction. Accepted to 5th International Symposium on Visual Computing (ISVC'09), Las Vegas (USA)
- Knoblauch, D. and Kuester, F. (2008). VirtualizeMe: Interactive Model Reconstruction From Stereo Video Streams. In ACM Symposium on Virtual Reality Software and Technology (VRST'08) Proceedings, Bordeaux (France)
- 3D Reconstruction:
- Stereo video stream based disparity map calculations for 2.5D reconstruction
- Combination of several 2.5 D reconstructions from different viewing angles
- Refine composed point cloud (noise and oversampling removal)
- Point Cloud Streaming:
- Lossless point cloud compression
- Point cloud transmission with real-time characteristics
- Point Cloud Rendering:
- High fidelity avatar rendering based on received point cloud
There are different opportunities for undergraduate and graduate students to join our research in this project.
Please Contact Daniel Knoblauch (email@example.com) for any questions.
Here some possible projects:
- Disparity Map Research (Computer Vision)
- Implementation and Evaluation of state of the art Disparity Map Algorithms for Tele-Immersion.
- Development of new Tele-Immersion specialized disparity map algorithm.
- Point Cloud Streaming Research (Computer Graphics/Visualization, Networking)
- Implementation and Evaluation of state of the art real-time point cloud compression and streaming algorithms.
- Implementation of a Tele-Immersion specialized point cloud compression and streaming infrastructure.
- Combination of Point Clouds from different view angles (Computer Graphics/Visualization)
This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by the author's copyright. This work may not be reposted without the explicit permission of the copyright holder.