EI2019 Short Course Description
SC11: 3D Video Processing Techniques for Immersive Environments CANCELLED
Sunday 13 January • 1:30 – 5:45 pm
Course Length: 4 hours
Course Level: Intermediate
Instructor: Yo-Sung Ho, Gwangju Institute of Science and Technology
Fee*: Member: $290 /
Non-member: $315 /
Student: $95
*after December 18, 2018, members / non-members prices increase by $50, student price increases by $20
With the emerging market of 3D imaging products, 3D video has become an active area of research and development in recent years. 3D video is the key to provide more realistic and immersive perceptual experiences than the existing 2D counterpart. There are many applications of 3D video, such as 3D movie and 3DTV, which are considered the main drive of the next-generation technical revolution. Stereoscopic display is the current mainstream technology for 3DTV, while auto-stereoscopic display is a more promising solution that requires more research endeavors to resolve the associated technical difficulties. This short course lecture covers the current state-of-the-art technologies for 3D contents generation. After defining the basic requirements for 3D realistic multimedia services, we cover various multi-modal immersive media processing technologies. Also addressed is the depth estimation problem for natural 3D scenes and several challenging issues of 3D video processing, such as camera calibration, image rectification, illumination compensation, and color correction. The course discusses MPEG activities for 3D video coding, including depth map estimation, prediction structure for multi-view video coding, multi-view video-plus-depth coding, and intermediate view synthesis for multi-view video display applications.
Learning Outcomes
- Understand the general trend of 3D video services.
- Describe the basic requirements for realistic 3D video services.
- Identify the main components of 3D video processing systems.
- Estimate camera parameters for camera calibration.
- Analyze the captured data for image rectification and illumination compensation.
- Apply image processing techniques for color correction and filtering.
- Estimate depth map information from stereoscopic and multi-view images.
- Synthesize intermediate views at virtual viewpoints.
- Review MPEG and JCT-3V activities for 3D video coding.
- Design a 3D video system to handle multi-view video-plus-depth data.
- Discuss various challenging problems related to 3D video services.
Intended Audience
Scientists, engineers, technicians, or managers who wish to learn more about 3D video and related processing techniques. Undergraduate training in engineering or science is assumed.
Y
o-Sung Ho has been developing video processing systems for digital TV and HDTV, first at Philips Labs in New York and later at ETRI in Korea. He is currently a professor at the school of electrical and computer engineering at Gwangju Institute of Science and Technology (GIST) in Korea, and also Director of Realistic Broadcasting Research Center at GIST. He has given several tutorial lectures at various international conferences, including the 3DTV Conference, the IEEE International Conference on Image Processing (ICIP), and the IEEE International Conference on Multimedia & Expo (ICME). He earned his PhD in electrical and computer engineering at the University of California, Santa Barbara. He has been an associate editor of IEEE Transactions on Circuits and Systems for Video Technology (T-CSVT).
Related EI Conferences