Multiple-view shape extraction from shading as local regression by analytic NN scheme

Mohamad Ivan Fanany, I. Kumazawa

Research output: Contribution to journalArticlepeer-review

4 Citations (Scopus)

Abstract

We introduce a multiple-view 3D-shape-reconstruction system. This system is able to fuse few-view and erroneous depth maps into a more complete and more accurate shape representation using a unique neural network (NN). The NN provides analytic mapping and learning of a polyhedron model to approximate the true shape of an object based on multiple-view depth maps. The depth maps are obtained by a widely used Tsai-Shah shape-from-shading (SFS) algorithm. They are considered as partial 3D shapes of the object to be reconstructed. The main insight of this work is that the NN minimizes the depth map error in one view using depth maps information from other views observed under nonfixed light source positions relative to the object. Theoretically, we formulate our problem as nonparametric (local) regression in depth space formed by multiple view observations. Experimentally, we obtain exact and stable results through hierarchical reconstruction and annealing reinforcement. We provide the implementation of the NN used in this paper at http://cc.1asphost.com/fanany/MV- SPRNN/mv-sprnn.html.

Original languageEnglish
Pages (from-to)959-975
Number of pages17
JournalMathematical and Computer Modelling
Volume40
Issue number9-10
DOIs
Publication statusPublished - 1 Jan 2004

Keywords

  • Local regression
  • Multiple view
  • Neural network
  • Shape-from-shading

Fingerprint Dive into the research topics of 'Multiple-view shape extraction from shading as local regression by analytic NN scheme'. Together they form a unique fingerprint.

Cite this