Conference 5–9 August 2012
Exhibition 7–9 August 2012
Los Angeles Convention Center

3D Capturing Using Multi-Camera Rigs, Real-Time Depth Estimation, and Depth-Based Content Creation for Multi-View and Light-Field Auto-Stereoscopic Displays

Los Angeles Convention Center, Concourse Foyer

The wide variety of commercially available and emerging 3D displays -- such as stereoscopic, multi-view, and light-field -- makes content creation for these displays challenging. This project presents a generic method for capturing and rendering live 3D footage for 3D displays. The system features several innovative components: a professional-grade multi-camera assistance and calibration system, a real-time depth estimator that produces convincing depth maps, a real-time and generic depth-image-based rendering (DIBR) engine that is suitable for generating imagery for a range of 3D displays, and the world's first front-projected 140-inch light-field, glasses-free 3D cinema display system.

The contribution of this system is two-fold:

• It demonstrates 3D image generation and display based on sparse multi-camera input.

• The system's generic multi-view-plus-depth (MVD) representation can serve as the future 3DTV format, in line with MPEG’s efforts in 3DTV.

The system is based on work performed in the MUSCADE European FP7 project, the objective of which is to define, develop, validate, and evaluate technological innovations in 3DTV capturing, data representation, compression, transmission, and rendering and display adaptations required for a technically efficient and commercially successful 3DTV broadcast system.

Peter Tamas Kovacs
Holografika Kft.

Frederik Zilly
Fraunhofer Heinrich Hertz Institute