Non-rigid photometric stereo with colored light

Carlos Hernández*, George Vogiatzis, Gabriel J. Brostow, Bjorn Stenger, Roberto Cipolla

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference publication

Abstract

We present an algorithm and the associated capture methodology to acquire and track the detailed 3D shape, bends, and wrinkles of deforming surfaces. Moving 3D data has been difficult to obtain by methods that rely on known surface features, structured light, or silhouettes. Multispectral photometric stereo is an attractive alternative because it can recover a dense normal field from an un-textured surface. We show how to capture such data and register it over time to generate a single deforming surface. Experiments were performed on video sequences of untextured cloth, filmed under spatially separated red, green, and blue light sources. Our first finding is that using zero-depth-silhouettes as the initial boundary condition already produces rather smoothly varying per-frame reconstructions with high detail. Second, when these 3D reconstructions are augmented with 2D optical flow, one can register the first frame's reconstruction to every subsequent frame.

Original languageEnglish
Title of host publication2007 IEEE 11th International Conference on Computer Vision
PublisherIEEE
ISBN (Print)978-1-4244-1630-1
DOIs
Publication statusPublished - 26 Dec 2007
Event2007 IEEE 11th International Conference on Computer Vision, ICCV - Rio de Janeiro, Brazil
Duration: 14 Oct 200721 Oct 2007

Conference

Conference2007 IEEE 11th International Conference on Computer Vision, ICCV
CountryBrazil
CityRio de Janeiro
Period14/10/0721/10/07

Fingerprint Dive into the research topics of 'Non-rigid photometric stereo with colored light'. Together they form a unique fingerprint.

Cite this