Shadows in three-source photometric stereo

Carlos Hernández*, George Vogiatzis, Roberto Cipolla

*Corresponding author for this work

    Research output: Chapter in Book/Published conference outputConference publication

    Abstract

    Shadows are one of the most significant difficulties of the photometric stereo method. When four or more images are available, local surface orientation is overdetermined and the shadowed pixels can be discarded. In this paper we look at the challenging case when only three images under three different illuminations are available. In this case, when one of the three pixel intensity constraints is missing due to shadow, a 1 dof ambiguity per pixel arises. We show that using integrability one can resolve this ambiguity and use the remaining two constraints to reconstruct the geometry in the shadow regions. As the problem becomes ill-posed in the presence of noise, we describe a regularization scheme that improves the numerical performance of the algorithm while preserving data. We propose a simple MRF optimization scheme to identify and segment shadow regions in the image. Finally the paper describes how this theory applies in the framework of color photometric stereo where one is restricted to only three images. Experiments on synthetic and real image sequences are presented.

    Original languageEnglish
    Title of host publicationComputer Vision - ECCV 2008 - 10th European Conference on Computer Vision, Proceedings
    PublisherSpringer
    Pages290-303
    Number of pages14
    EditionPART 1
    ISBN (Print)3540886818, 9783540886815
    DOIs
    Publication statusPublished - 2008
    Event10th European Conference on Computer Vision, ECCV 2008 - Marseille, France
    Duration: 12 Oct 200818 Oct 2008

    Publication series

    NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    NumberPART 1
    Volume5302 LNCS
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Conference

    Conference10th European Conference on Computer Vision, ECCV 2008
    Country/TerritoryFrance
    CityMarseille
    Period12/10/0818/10/08

    Fingerprint

    Dive into the research topics of 'Shadows in three-source photometric stereo'. Together they form a unique fingerprint.

    Cite this