Learn More
Reconstruction of 3D scene geometry is an important element for scene understanding, autonomous vehicle and robot navigation, image retrieval, and 3D television. We propose accounting for the inherent structure of the visual world when trying to solve the scene reconstruction problem. Consequently, we identify geometric scene categorization as the first(More)
We describe the goals of the ATTEST project, which started in March 2002 as part of the Information Society Technologies (IST) programme, sponsored by the European Commission. In the 2-year project, several industrial and academic partners cooperate towards a flexible, 2D-compatible and commercially feasible 3D-TV system for broadcast environments. An(More)
Recently, methods for estimating 3D scene geometry or absolute scene depth information from 2D image content have been proposed. However, general applicability of these methods in depth estimation may not be realizable, as inconsistencies may be introduced due to a large variety of possible pictorial content. We identify scene categorization as the first(More)
This paper describes a hardware system and the underlying algorithms that were developed for realtime stereoscopic videoconferencing with viewpoint adaptation within the European PANORAMA project. The goal was to achieve a true telepresence illusion for the remote partners. For this purpose, intermediate views at arbitrary positions must be synthesized from(More)
In this paper, we discuss the challenge of 3DTV and present our requirements for a novel three-dimensional video format. We will show that the ad-hoc stereoscopic video format does not provide the necessary flexibility towards user interactivity and non-stereo based 3D displays. In order to enable an evolutionary scenario from 2D towards 3DTV, we will(More)
A new method is presented for extracting the musical key from raw audio data. The method is based on the extraction of chromagrams using a new approach for tonal component selection taking into account auditory masking. The extracted chromagrams were used to train three key profiles for major and three key profiles for minor keys. The three trained key(More)
In this paper we present an algorithm for the synthesis of multi viewpoint images at non-intermediate positions, based on stereoscopic images. We consider the synthesis of images from virtual camera positions and the synthesis of images for scene reconstruction using stereo displays. The algorithm provides scene reconstruction without geometric distortion(More)
This paper describes a non-intrusive method to estimate the gaze direction of a person by using stereo cameras. First, facial features are tracked with an adapted particle filtering algorithm using factorized likelihoods to estimate the 3D head pose. Next the 3D gaze vector is calculated by estimating the eyeball center and the cornea center of both eyes.(More)
We present a method for improving the temporal stability of video object segmentation algorithms for 3D-TV applications. First, two quantitative measures to evaluate temporal stability without ground-truth are presented. Then, a pseudo-3D curve evolution method, which spatio-temporally stabilizes the estimated object segments is introduced. Temporal(More)