Second-Order Shape Optimization for Geometric Inverse Problems in Vision

  title={Second-Order Shape Optimization for Geometric Inverse Problems in Vision},
  author={Jonathan Balzer and Stefano Soatto},
  journal={2014 IEEE Conference on Computer Vision and Pattern Recognition},
  • J. Balzer, Stefano Soatto
  • Published 11 November 2013
  • Mathematics, Computer Science
  • 2014 IEEE Conference on Computer Vision and Pattern Recognition
We develop a method for optimization in shape spaces, i.e., sets of surfaces modulo re-parametrization. Unlike previously proposed gradient flows, we achieve superlinear convergence rates through an approximation of the shape Hessian, which is generally hard to compute and suffers from a series of degeneracies. Our analysis highlights the role of mean curvature motion in comparison with first-order schemes: instead of surface area, our approach penalizes deformation, either by its Dirichlet… 
Direct Optimization of T-Splines Based on Multiview Stereo
A multi-view stereo reconstruction method in which the surface is represented by CAD-compatible T-splines, formulating an energy functional that can be directly computed in terms of the T- Spline basis which is used in photo-consistency optimization.
Large-scale bounded distortion mappings
An efficient algorithm for computing large-scale bounded distortion maps of triangular and tetrahedral meshes whose differentials are orientation preserving and have bounded condition number is proposed.
Efficient minimal-surface regularization of perspective depth maps in variational stereo
A near real-time variational reconstruction algorithm free of the staircasing artifacts that affect depth-map and plane-sweeping approaches, made possible by exploiting the gauge ambiguity to design a novel representation of the regularizer that is linear in the parameters and hence amenable to be optimized with state-of-the-art primal-dual numerical schemes.
Probabilistic Models for Symmetric Object Detection in Images
This thesis presents two methods for parsing of facade images, where translation symmetry manifests in the structure of architectural elements like windows, doors and cornices, and uses Bayesian inference to handle a hierarchical model extending from the low-level geometry of reflection symmetry to dihedral symmetry groups.
Towards Space Carving with a Hand-Held Camera
The key of the method consists of recovering highly accurate camera poses from structure from motion based on a planar scene assumption, and modeling the structure on the planar background with implicitly smooth Bezier splines.
Defocus deblurring and superresolution for time-of-flight depth cameras
By directly working with raw sensor measurements but regularizing the recovered depth and amplitude images, this method is able to simultaneously deblur and super-resolve the output of ToF cameras and outperforms existing methods on both synthetic and real datasets.
A regularized fusion based 3D reconstruction framework: analyses, methods and applications
This thesis is focused on reducing the effects of error-prone depth information by employing a proposed 3D reconstruction framework capable of reducing accumulated noise, using a regularizing 3D integration system.
Controlled Visual Sensing and Exploration
Abstract : This project developed analytical and computational tools to design integrated sensor-control systems, where the controller is part of the sensor and designed so as to maximize


A Gauss-Newton Method for the Integration of Spatial Normal Fields in Shape Space
  • J. Balzer
  • Computer Science
    Journal of Mathematical Imaging and Vision
  • 2011
A novel approximation of the shape Hessian is proposed, which is not only rigorously justified but also leads to excellent numerical performance of the actual optimization.
An Integral Solution to Surface Evolution PDEs Via Geo-cuts
This work formulate an optimization problem directly based on an integral characterization of gradient flow as an infinitesimal move of the (whole) surface giving the largest energy decrease among all moves of equal size and shows that this problem can be efficiently solved using recent advances in algorithms for global hypersurface optimization.
Weighted Minimal Hypersurface Reconstruction
This work derives the Euler-Lagrange equation in arbitrary dimensional space without the need for any surface parameterization, generalizing existing proofs and opening up the possibility of solving problems involving minimal hypersurfaces in a dimension higher than three, which were previously impossible to solve in practice.
Weighted Minimal Surface Reconstruction
Many problems in computer vision can be formulated as a minimization problem for an energy functional. If this functional is given as an integral of a scalar-valued weight function over an unknown
ℓ1-Sparse reconstruction of sharp point set surfaces
An ℓ1-sparse method for the reconstruction of a piecewise smooth point set surface that consists mainly of smooth modes, with the residual of the objective function strongly concentrated near sharp features.
Continuous Global Optimization in Multiview 3D Reconstruction
A new global optimization method to the field of multiview 3D reconstruction is introduced to cast the problem of 3D shape reconstruction as one of minimizing a spatially continuous convex functional.
Discrete Willmore flow
The relevant gradient expressions including a linearization (approximation of the Hessian) are derived which are required for non-linear numerical solvers and demonstrate the utility of this approach for surface restoration, n-sided hole filling, and non-shrinking surface smoothing.
A Geometric Formulation of Gradient Descent for Variational Problems with Moving Surfaces
The manifold of admissible surfaces and a scalar product on its tangent spaces is introduced, which makes it possible to properly define gradients and gradient descent procedures for variational problems involving m-surfaces.
Multiview normal field integration using level set methods
This paper forms this multiview normal integration problem by an energy minimization framework and finds an optimal solution in a least square sense using a variational technique and shows that the resultant flow is composed of the well known mean curvature and flux maximizing flows.
Gradient Flows for Optimizing Triangular Mesh-based Surfaces: Applications to 3D Reconstruction Problems Dealing with Visibility
This article shows how to rigorously account for visibility in the surface optimization process, and presents different applications including 3D reconstruction from multiple views for which the visibility is fundamental.