Surround video: a multihead camera approach

@article{Nielsen2004SurroundVA,
  title={Surround video: a multihead camera approach},
  author={Frank Nielsen},
  journal={The Visual Computer},
  year={2004},
  volume={21},
  pages={92-103}
}
  • F. Nielsen
  • Published 1 February 2005
  • Computer Science
  • The Visual Computer
AbstractWe describe algorithms for creating, storing and viewing high-resolution immersive surround videos. Given a set of unit cameras designed to be almost aligned at a common nodal point, we first present a versatile process for stitching seamlessly synchronized streams of videos into a single surround video corresponding to the video of the multihead camera. We devise a general registration process onto raymaps based on minimizing a tailored objective function. We review and introduce new… 
Interactive omnidirectional video delivery: A bandwidth-effective approach
TLDR
This paper evaluates the relevance and optimality of a personalized transmission where quality is modulated in spherical or cylindrical regions depending on their likelihood to be viewed during a live user interaction and shows how tiling and predictive methods can improve on existing methods.
Online Correction of Camera Poses for the Surround-view System: A Sparse Direct Approach
TLDR
Experiments show that the sparse direct framework and proposed novel optimization scheme of a cascade structure can effectively eliminate the misalignment caused by cameras’ moderate pose changes in the surround-view system.
Online Camera Pose Optimization for the Surround-view System
TLDR
This paper proposes a camera pose optimization method, which consists of two models: Ground Model and Ground-Camera Model, both of which correct the camera poses by minimizing photometric errors between ground projections of adjacent cameras.
Evaluation of bandwidth performance for interactive spherical Video
TLDR
This paper evaluates the relevance and optimality of a personalized transmission where the panorama video is decomposed into tiles, which are transmitted at a quality modulated in the spherical regions depending on their likelihood to be visualized from the user interactions.
CLAIRVOYANCE: A Fast And Robust Precision Mosaicing System for Gigapixel Images
  • F. Nielsen, N. Yamashita
  • Computer Science
    IECON 2006 - 32nd Annual Conference on IEEE Industrial Electronics
  • 2006
In this paper, we present CLAIRVOYANCE: a fully automatic photomosaicing system for building ultra high-resolution composited images from image sequences captured by tailored in-house motorized
Local features, structure-from-motion and view synthesis in spherical video
TLDR
An interest point detector and feature descriptor that allows to robustly match local features between pairs of spherical images and use this as part of a structure-from-motion pipeline that allows us to estimate camera pose from a spherical video sequence is proposed.
Real-Time Spherical Videos from a Fast Rotating Camera
TLDR
A new framework for the acquisition of full spherical videos using a high-speed rotating linear or area sensor equipped with a fish-eye lens and the image processing workflows from the raw data to the full spherical frames is presented.
Panoramic Immersive Videos - 3D Production and Visualization Framework
TLDR
A framework for production of virtual panoramic immersive videos using 3D production software is presented and a desktop CAVE assembly is proposed in order to provide an immersive display.
Photometric alignment for surround view camera system
TLDR
A computationally efficient method to correct for the photometric misalignment, i.e., brightness and color mismatch, across different cameras is described and a seamlessly stitched 360 degree surround view is achieved.
Efficient Coding of 360° Videos Exploiting Inactive Regions in Projection Formats
TLDR
An efficient method for encoding common projection formats in 360° video coding is presented, in which inactive regions are exploited and the corresponding pixel values are neglected in rate-distortion optimization, residual transformation, as well as in-loop filtering.
...
1
2
3
...

References

SHOWING 1-10 OF 24 REFERENCES
Creating full view panoramic image mosaics and environment maps
TLDR
This paper presents a novel approach to creating full view panoramic mosaics from image sequences that does not require any controlled motions or constraints on how the images are taken (as long as there is no strong motion parallax).
Plenoptic path and its applications
  • F. Nielsen
  • Computer Science
    Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429)
  • 2003
TLDR
A method for acquiring, spatially filtering and viewing annotated videos captured with a full field of view multihead camera moving along a path and a tailored egomotion recovery algorithm used for calculating the trajectory path of the panoramic head are presented.
Polydioptric camera design and 3D motion estimation
TLDR
This framework suggests that large field-of-view multi-perspective (polydioptric) cameras are the optimal image sensors for 3D motion estimation.
360/spl times/360 mosaics
  • Y. Schechner, S. Nayar
  • Mathematics
    Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662)
  • 2000
TLDR
This paper presents two approaches to spherical mosaicing, one to rotate a 360 degree camera about a single axis to capture a sequence of 360 degree strips and the second to significantly enhance the resolution of the computed mosaic by capturing 360 degree slices rather than strips.
Plenoptic modeling: an image-based rendering system
TLDR
An image-based rendering system based on sampling, reconstructing, and resampling the plenoptic function is presented and a novel visible surface algorithm and a geometric invariant for cylindrical projections that is equivalent to the epipolar constraint defined for planar projections are introduced.
Sea of images
TLDR
A "sea of images," a practical approach to dense sampling, storage, and reconstruction of the plenoptic function in large, complex indoor environments, using a motorized cart to capture omnidirectional images every few inches on a eye-height plane throughout an environment.
QuickTime VR: an image-based approach to virtual environment navigation
TLDR
This paper presents a new approach which uses 360-degree cylindrical panoramic images to compose a virtual environment which includes viewing of an object from different directions and hit-testing through orientation-independent hot spots.
Non-metric calibration of wide-angle lenses and polycameras
  • R. Swaminathan, S. Nayar
  • Computer Science
    Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149)
  • 1999
TLDR
This paper proposes a method for recovering the distortion parameters without the use of any calibration objects, and applies it to a polycamera with four wide-angle cameras to create a high resolution 360 degree panorama in real-time.
Registration, calibration and blending in creating high quality panoramas
  • Y. Xiong, Ken Turkowski
  • Computer Science
    Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201)
  • 1998
TLDR
A combination of a gradient-based optimization method and a correlation-based linear search is found to be robust even in cases of drastic exposure differences and small amount of parallax, and the necessary human interface for initialization, feedback and manual options are explained.
Spherical Mosaics with Quaternions and Dense Correlation
TLDR
The experimental results demonstrate that the described global optimization strategy is superior to non-global aggregation of pair-wise correlation terms, and that it successfully generates high-quality mosaics despite significant error in initial rotation estimates.
...
1
2
3
...