Multiview photometric stereo

Carlos Hernández, George Vogiatzis, Roberto Cipolla

Research output: Contribution to journalArticle

Abstract

This paper addresses the problem of obtaining complete, detailed reconstructions of textureless shiny objects. We present an algorithm which uses silhouettes of the object, as well as images obtained under changing illumination conditions. In contrast with previous photometric stereo techniques, ours is not limited to a single viewpoint but produces accurate reconstructions in full 3D. A number of images of the object are obtained from multiple viewpoints, under varying lighting conditions. Starting from the silhouettes, the algorithm recovers camera motion and constructs the object's visual hull. This is then used to recover the illumination and initialize a multiview photometric stereo scheme to obtain a closed surface reconstruction. There are two main contributions in this paper: First, we describe a robust technique to estimate light directions and intensities and, second, we introduce a novel formulation of photometric stereo which combines multiple viewpoints and, hence, allows closed surface reconstructions. The algorithm has been implemented as a practical model acquisition system. Here, a quantitative evaluation of the algorithm on synthetic data is presented together with complete reconstructions of challenging real objects. Finally, we show experimentally how, even in the case of highly textured objects, this technique can greatly improve on correspondence-based multiview stereo results.
Original languageEnglish
Pages (from-to)548-554
Number of pages7
JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
Volume30
Issue number3
DOIs
Publication statusPublished - Mar 2008

Fingerprint

Photometric Stereo
Surface reconstruction
Lighting
Surface Reconstruction
Silhouette
Illumination
Closed
Quantitative Evaluation
Cameras
Synthetic Data
Object
Correspondence
Camera
Motion
Formulation
Estimate

Bibliographical note

© 2008 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

Keywords

  • closed surface reconstruction
  • multiview photometric stereo
  • object silhouettes
  • textureless shiny object reconstructions
  • visual hull

Cite this

Hernández, Carlos ; Vogiatzis, George ; Cipolla, Roberto. / Multiview photometric stereo. In: IEEE Transactions on Pattern Analysis and Machine Intelligence. 2008 ; Vol. 30, No. 3. pp. 548-554.
@article{79cd7226792a494d875569abe43f093a,
title = "Multiview photometric stereo",
abstract = "This paper addresses the problem of obtaining complete, detailed reconstructions of textureless shiny objects. We present an algorithm which uses silhouettes of the object, as well as images obtained under changing illumination conditions. In contrast with previous photometric stereo techniques, ours is not limited to a single viewpoint but produces accurate reconstructions in full 3D. A number of images of the object are obtained from multiple viewpoints, under varying lighting conditions. Starting from the silhouettes, the algorithm recovers camera motion and constructs the object's visual hull. This is then used to recover the illumination and initialize a multiview photometric stereo scheme to obtain a closed surface reconstruction. There are two main contributions in this paper: First, we describe a robust technique to estimate light directions and intensities and, second, we introduce a novel formulation of photometric stereo which combines multiple viewpoints and, hence, allows closed surface reconstructions. The algorithm has been implemented as a practical model acquisition system. Here, a quantitative evaluation of the algorithm on synthetic data is presented together with complete reconstructions of challenging real objects. Finally, we show experimentally how, even in the case of highly textured objects, this technique can greatly improve on correspondence-based multiview stereo results.",
keywords = "closed surface reconstruction, multiview photometric stereo, object silhouettes, textureless shiny object reconstructions, visual hull",
author = "Carlos Hern{\'a}ndez and George Vogiatzis and Roberto Cipolla",
note = "{\circledC} 2008 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.",
year = "2008",
month = "3",
doi = "10.1109/TPAMI.2007.70820",
language = "English",
volume = "30",
pages = "548--554",
journal = "IEEE Transactions on Pattern Analysis and Machine Intelligence",
issn = "0162-8828",
publisher = "IEEE",
number = "3",

}

Multiview photometric stereo. / Hernández, Carlos; Vogiatzis, George; Cipolla, Roberto.

In: IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 30, No. 3, 03.2008, p. 548-554.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Multiview photometric stereo

AU - Hernández, Carlos

AU - Vogiatzis, George

AU - Cipolla, Roberto

N1 - © 2008 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

PY - 2008/3

Y1 - 2008/3

N2 - This paper addresses the problem of obtaining complete, detailed reconstructions of textureless shiny objects. We present an algorithm which uses silhouettes of the object, as well as images obtained under changing illumination conditions. In contrast with previous photometric stereo techniques, ours is not limited to a single viewpoint but produces accurate reconstructions in full 3D. A number of images of the object are obtained from multiple viewpoints, under varying lighting conditions. Starting from the silhouettes, the algorithm recovers camera motion and constructs the object's visual hull. This is then used to recover the illumination and initialize a multiview photometric stereo scheme to obtain a closed surface reconstruction. There are two main contributions in this paper: First, we describe a robust technique to estimate light directions and intensities and, second, we introduce a novel formulation of photometric stereo which combines multiple viewpoints and, hence, allows closed surface reconstructions. The algorithm has been implemented as a practical model acquisition system. Here, a quantitative evaluation of the algorithm on synthetic data is presented together with complete reconstructions of challenging real objects. Finally, we show experimentally how, even in the case of highly textured objects, this technique can greatly improve on correspondence-based multiview stereo results.

AB - This paper addresses the problem of obtaining complete, detailed reconstructions of textureless shiny objects. We present an algorithm which uses silhouettes of the object, as well as images obtained under changing illumination conditions. In contrast with previous photometric stereo techniques, ours is not limited to a single viewpoint but produces accurate reconstructions in full 3D. A number of images of the object are obtained from multiple viewpoints, under varying lighting conditions. Starting from the silhouettes, the algorithm recovers camera motion and constructs the object's visual hull. This is then used to recover the illumination and initialize a multiview photometric stereo scheme to obtain a closed surface reconstruction. There are two main contributions in this paper: First, we describe a robust technique to estimate light directions and intensities and, second, we introduce a novel formulation of photometric stereo which combines multiple viewpoints and, hence, allows closed surface reconstructions. The algorithm has been implemented as a practical model acquisition system. Here, a quantitative evaluation of the algorithm on synthetic data is presented together with complete reconstructions of challenging real objects. Finally, we show experimentally how, even in the case of highly textured objects, this technique can greatly improve on correspondence-based multiview stereo results.

KW - closed surface reconstruction

KW - multiview photometric stereo

KW - object silhouettes

KW - textureless shiny object reconstructions

KW - visual hull

UR - http://www.scopus.com/inward/record.url?scp=39549107333&partnerID=8YFLogxK

U2 - 10.1109/TPAMI.2007.70820

DO - 10.1109/TPAMI.2007.70820

M3 - Article

VL - 30

SP - 548

EP - 554

JO - IEEE Transactions on Pattern Analysis and Machine Intelligence

JF - IEEE Transactions on Pattern Analysis and Machine Intelligence

SN - 0162-8828

IS - 3

ER -