Conference 5–9 August 2012
Exhibition 7–9 August 2012
Los Angeles Convention Center

Computational Plenoptic Imaging

Los Angeles Convention Center, Room 408B

A new generation of computational cameras is emerging, spawned by the introduction of the Lytro light-field camera to the consumer market and recent accomplishments in the speed at which light can be captured. By exploiting the co-design of camera optics and computational processing, these cameras capture unprecedented details of the plenoptic function: a ray-based model for light that includes the color spectrum as well as spatial, temporal, and directional variation. Although digital light sensors have greatly evolved in the last years, the visual information captured by conventional cameras has remained almost unchanged since the invention of the daguerreotype. All standard CCD and CMOS sensors integrate over the dimensions of the plenoptic function as they convert photons into electrons. In the process, all visual information is irreversibly lost, except for a two-dimensional, spatially varying subset: the common photograph.

This course reviews the plenoptic function and discusses approaches for optically encoding high-dimensional visual information that is then recovered computationally in post-processing. It begins with an overview of the plenoptic dimensions and shows how much of this visual information is irreversibly lost in conventional image acquisition. Then it discusses the state of the art in joint optical modulation and computation reconstruction for acquisition of high-dynamic-range imagery and spectral information. It unveils the secrets behind imaging techniques that have recently been featured in the news and outlines other aspects of light that are of interest for various applications before concluding with question, answers, and a short discussion.

COURSE SCHEDULE

9 am
Introduction and Overview
Wetzstein

9:10 am
High Dynamic Range Imaging
Heidrich

9:20 am
Spectral Imaging
Ihrke

9:30 am
Light Field Acquisition
Lanman

9:40 am
Insight the Lytro Camera
Akeley

10 am
Light Capture With a Trillion Frames Per Second
Raskar

10:20 am
Further Light Properties
Wetzstein

10:25 am
Summary and Q&A
All

Level

Introductory

Prerequisites

None.

Intended Audience

TAll researchers and students in fields related to computational imaging, including computer graphics and vision, computational photography, mathematics, and optics.

Instructor(s)

Gordon Wetzstein
MIT Media Lab

Ivo Ihrke
Universität des Saarlandes and Max-Planck-Institut für Informatik

Douglas Lanman
MIT Media Lab

Wolfgang Heidrich
The University of British Columbia

Ramesh Raskar
MIT Media Lab

Kurt Akeley
Lytro, Inc.