A New Variational Framework for Multiview Surface Reconstruction

@inproceedings{Semerjian2014ANV,
  title={A New Variational Framework for Multiview Surface Reconstruction},
  author={Ben Semerjian},
  booktitle={ECCV},
  year={2014}
}
The creation of surfaces from overlapping images taken from different vantages is a hard and important problem in computer vision. [] Key Method First, a strongly motivated variational framework is built from the ground up based on a limiting case of photo-consistency. The framework includes a powerful new edge preserving smoothness term and exploits the input images exhaustively, directly yielding high quality surfaces instead of dealing with issues (such as noise or misalignment) after the fact.

Figures from this paper

Combining Shape from Shading and Stereo: A Joint Variational Method for Estimating Depth, Illumination and Albedo
TLDR
This paper fuse a Lambertian SfS approach with a robust stereo model and supplement the resulting energy functional with a detail-preserving anisotropic second-order smoothness term, and extends the resulting model in such a way that it jointly estimates depth, albedo and illumination.
Combining Shape from Shading and Stereo: A Variational Approach for the Joint Estimation of Depth, Illumination and Albedo
TLDR
An approach that exploits shading information to improve upon the reconstruction quality of robust stereo methods and fuse a Lambertian SfS approach with a robust stereo model and supplement the resulting energy functional with a detail-preserving anisotropic second-order smoothness term is obtained.
Accurate, dense and shading-aware multi-view stereo reconstruction using metaheuritic optimization
TLDR
A robust multi-view stereo method based on metaheuristic optimization namely the Particle Swarm Optimization (PSO) in order to find the optimal depth, orientation, and surface roughness and shows a high completeness score and comparable accuracy to those of the current top performing algorithms.
Differential Photometric Consistency
TLDR
A novel trinocular differential photometric consistency is proposed that constrains the brightness gradients in three views so that the image gradient in one view is completely determined by the image gradients at corresponding points in the the other two views.
The Photogrammetric Reconstruction Task Solved by Bundle Adjustment Directly with Pixel Bundles
  • B. Wrobel
  • Computer Science
    PFG – Journal of Photogrammetry, Remote Sensing and Geoinformation Science
  • 2017
TLDR
A high-fidelity approach of both the functional and stochastic model of image evaluation is presented, and topographical reconstructions demonstrate the validity of the results with respect to the surface and the standard deviations of its heights.
Multiview Depth Parameterisation with Second Order Regularisation
TLDR
This paper investigates several parameterisations of the unknown depth and reveals that an inverse depth parameterisation is generally preferable, and points out its benefits w.r.t. the data and the smoothness term.
Robust Energy Minimization for BRDF-Invariant Shape from Light Fields
TLDR
This work presents a variational energy minimization framework for robust recovery of shape in multiview stereo with complex, unknown BRDFs and albedos that consistently achieves errors lower than Lambertian baselines and is more robust than prior BRDF-invariant reconstruction methods.
SR-MVS : multi-view stereo enhancement through super-resolution
TLDR
This thesis discusses a new way to improve the quality of 3D reconstructions performed starting from a set of images of the scene to be modelled and examines whether the increase in the resolution of these input images results in an improvement of the reconstructed model.
Scalable multi-view stereo using CMA-ES and distance transform-based depth map refinement
TLDR
This paper presents a simple and highly scalable method to reconstruct dense 3D point cloud from multi-view images by estimating per-pixel depth using an evolutionary computation technique – CMA-ES.
Polarimetric MultiView Stereo
TLDR
This paper proposes polarimetric multi-view stereo, which combines per-pixel photometric information from polarization with epipolar constraints from multiple views for 3D reconstruction, and proves there are exactly two types of ambiguities on estimating surface azimuth angles from polarization.
...
1
2
3
...

References

SHOWING 1-10 OF 41 REFERENCES
Anisotropic Range Image Integration
TLDR
This paper extends the state-of-the-art approach of Zach et al.(2007) in several ways, replacing the isotropic space-variant smoothing behaviour by an anisotropic (direction-dependent) one and using the more accurate closest signed distances instead of directional signed distances when converting range images into 3D signed distance fields.
Multiview Photometric Stereo
TLDR
An algorithm which uses silhouettes of the object, as well as images obtained under changing illumination conditions, and a novel formulation of photometric stereo which combines multiple viewpoints and, hence, allows closed surface reconstructions is presented.
Accurate, Dense, and Robust Multiview Stereopsis
TLDR
A novel algorithm for multiview stereopsis that outputs a dense set of small rectangular patches covering the surfaces visible in the images, which outperforms all others submitted so far for four out of the six data sets.
Continuous Global Optimization in Multiview 3D Reconstruction
TLDR
A robust energy model for multiview 3D reconstruction that fuses silhouette- and stereo-based image information that allows to cope with significant amounts of noise without manual pre-segmentation of the input images is introduced.
Large displacement optical flow
TLDR
This paper proposes a method that can combine the advantages of both matching strategies and provides dense and subpixel accurate estimates, making use of geometric constraints and all available image information.
Towards high-resolution large-scale multi-view stereo
TLDR
This paper proposes a multi-view stereo pipeline able to deal at the same time with very large scenes while still producing highly detailed reconstructions within very reasonable time, and shows the results to compare more than favorably with the current state-of-the-art.
Computer Vision - ECCV 2004
TLDR
This work presents an analytic solution to the problem of estimating multiple 2-D and 3-D motion models from two-view correspondences or optical flow and proposes a novel motion segmentation algorithm that outperforms existing algebraic methods in terms of efficiency and robustness.
Zippered polygon meshes from range images
TLDR
A method for combining a collection of range images into a single polygonal mesh that completely describes an object to the extent that it is visible from the outside is presented.
Continuous depth estimation for multi-view stereo
TLDR
This paper first integrates silhouette information and epipolar constraint into the variational method for continuous depth map estimation, and produces one of the most accurate results among the current algorithms for sparse MVS datasets according to the Middlebury benchmark.
Poisson surface reconstruction
TLDR
A spatially adaptive multiscale algorithm whose time and space complexities are proportional to the size of the reconstructed model, and which reduces to a well conditioned sparse linear system.
...
1
2
3
4
5
...