Overcoming shadows in 3-source photometric stereo

Carlos Hernández, George Vogiatzis, Roberto Cipolla

Research output: Contribution to journalArticle

Abstract

Light occlusions are one of the most significant difficulties of photometric stereo methods. When three or more images are available without occlusion, the local surface orientation is overdetermined so that shape can be computed and the shadowed pixels can be discarded. In this paper, we look at the challenging case when only two images are available without occlusion, leading to a one degree of freedom ambiguity per pixel in the local orientation. We show that, in the presence of noise, integrability alone cannot resolve this ambiguity and reconstruct the geometry in the shadowed regions. As the problem is ill-posed in the presence of noise, we describe two regularization schemes that improve the numerical performance of the algorithm while preserving the data. Finally, the paper describes how this theory applies in the framework of color photometric stereo where one is restricted to only three images and light occlusions are common. Experiments on synthetic and real image sequences are presented.
Original languageEnglish
Article number5601736
Pages (from-to)419-426
Number of pages8
JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
Volume33
Issue number2
DOIs
Publication statusPublished - Feb 2011

Fingerprint

Photometric Stereo
Occlusion
Pixels
Pixel
Color
Geometry
Image Sequence
Integrability
Resolve
Regularization
Experiments
Degree of freedom
Experiment
Ambiguity

Bibliographical note

© 2011 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

Keywords

  • color photometric stereo
  • ill-posed problem
  • image sequence
  • light occlusions
  • noise
  • regularization scheme
  • shadow

Cite this

@article{ad0f7d5bd8c546e89380ad17566bf1c9,
title = "Overcoming shadows in 3-source photometric stereo",
abstract = "Light occlusions are one of the most significant difficulties of photometric stereo methods. When three or more images are available without occlusion, the local surface orientation is overdetermined so that shape can be computed and the shadowed pixels can be discarded. In this paper, we look at the challenging case when only two images are available without occlusion, leading to a one degree of freedom ambiguity per pixel in the local orientation. We show that, in the presence of noise, integrability alone cannot resolve this ambiguity and reconstruct the geometry in the shadowed regions. As the problem is ill-posed in the presence of noise, we describe two regularization schemes that improve the numerical performance of the algorithm while preserving the data. Finally, the paper describes how this theory applies in the framework of color photometric stereo where one is restricted to only three images and light occlusions are common. Experiments on synthetic and real image sequences are presented.",
keywords = "color photometric stereo, ill-posed problem, image sequence, light occlusions, noise, regularization scheme, shadow",
author = "Carlos Hern{\'a}ndez and George Vogiatzis and Roberto Cipolla",
note = "{\circledC} 2011 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.",
year = "2011",
month = "2",
doi = "10.1109/TPAMI.2010.181",
language = "English",
volume = "33",
pages = "419--426",
journal = "IEEE Transactions on Pattern Analysis and Machine Intelligence",
issn = "0162-8828",
publisher = "IEEE",
number = "2",

}

Overcoming shadows in 3-source photometric stereo. / Hernández, Carlos; Vogiatzis, George; Cipolla, Roberto.

In: IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 33, No. 2, 5601736, 02.2011, p. 419-426.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Overcoming shadows in 3-source photometric stereo

AU - Hernández, Carlos

AU - Vogiatzis, George

AU - Cipolla, Roberto

N1 - © 2011 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

PY - 2011/2

Y1 - 2011/2

N2 - Light occlusions are one of the most significant difficulties of photometric stereo methods. When three or more images are available without occlusion, the local surface orientation is overdetermined so that shape can be computed and the shadowed pixels can be discarded. In this paper, we look at the challenging case when only two images are available without occlusion, leading to a one degree of freedom ambiguity per pixel in the local orientation. We show that, in the presence of noise, integrability alone cannot resolve this ambiguity and reconstruct the geometry in the shadowed regions. As the problem is ill-posed in the presence of noise, we describe two regularization schemes that improve the numerical performance of the algorithm while preserving the data. Finally, the paper describes how this theory applies in the framework of color photometric stereo where one is restricted to only three images and light occlusions are common. Experiments on synthetic and real image sequences are presented.

AB - Light occlusions are one of the most significant difficulties of photometric stereo methods. When three or more images are available without occlusion, the local surface orientation is overdetermined so that shape can be computed and the shadowed pixels can be discarded. In this paper, we look at the challenging case when only two images are available without occlusion, leading to a one degree of freedom ambiguity per pixel in the local orientation. We show that, in the presence of noise, integrability alone cannot resolve this ambiguity and reconstruct the geometry in the shadowed regions. As the problem is ill-posed in the presence of noise, we describe two regularization schemes that improve the numerical performance of the algorithm while preserving the data. Finally, the paper describes how this theory applies in the framework of color photometric stereo where one is restricted to only three images and light occlusions are common. Experiments on synthetic and real image sequences are presented.

KW - color photometric stereo

KW - ill-posed problem

KW - image sequence

KW - light occlusions

KW - noise

KW - regularization scheme

KW - shadow

UR - http://www.scopus.com/inward/record.url?scp=78650517072&partnerID=8YFLogxK

U2 - 10.1109/TPAMI.2010.181

DO - 10.1109/TPAMI.2010.181

M3 - Article

VL - 33

SP - 419

EP - 426

JO - IEEE Transactions on Pattern Analysis and Machine Intelligence

JF - IEEE Transactions on Pattern Analysis and Machine Intelligence

SN - 0162-8828

IS - 2

M1 - 5601736

ER -