Optical outside-in tracking using unmodified mobile phones

  title={Optical outside-in tracking using unmodified mobile phones},
  author={Daniel Pustka and Jan-Patrick H{\"u}l{\ss} and Jochen Willneff and Frieder Pankratz and Manuel J. Huber and Gudrun Johanna Klinker},
  journal={2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)},
  • D. Pustka, J. Hülß, G. Klinker
  • Published 5 November 2012
  • Computer Science, Physics
  • 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
Marker-based optical outside-in tracking is a mature and robust technology used by many AR, VR and motion capture applications. However, in small environments the tracking cameras are often difficult to install. An example scenario are ergonomic studies in car manufacturing, where the motion of a worker needs to be tracked in small spaces such as the trunk of a car. In this paper, we describe how to extend the tracking volume in small, cluttered environments using small and flexible wireless… 
MoiréBoard: A Stable, Accurate and Low-cost Camera Tracking Method
This work presents MoiréBoard, a new 3-DOF camera position tracking method that leverages a seemingly irrelevant visual phenomenon, the moiré effect, and tracks devices at high accuracy, comparable to the state-of-the-art commercial VR tracking systems.
Sparse 3D reconstruction on a mobile phone with stereo camera for close-range optical tracking
  • Adrian Goral
  • Computer Science
    2015 IEEE International Instrumentation and Measurement Technology Conference (I2MTC) Proceedings
  • 2015
The accuracy of the prototype of optical tracking system running on unmodified HTC Evo 3D mobile phone with stereo camera turns out to be strongly dependent on the distance from the cameras.
Augmented Reality Binoculars
An augmented reality binocular system to allow long range high precision augmentation of live telescopic imagery with aerial and terrain based synthetic objects, vehicles, people and effects and a navigation algorithm that uses the two cameras in combination with an inertial measurement unit and global positioning system in an extended Kalman filter.
Application of Time-Delay Estimation to Mixed Reality Multisensor Tracking
By applying Time Delay Estimation on the tracking data, it is shown that the temporal offset between generic Mixed Reality spatial tracking sensors can be calibrated and integrated into the UBITRACK Mixed Reality tracking framework to provide facilities for calibration and real-time data alignment.
Evaluation of the Intel RealSense T265 for tracking natural human head motion
The performance of the T265 relative to these gold-standard methods is most accurate for slow to normal walking speeds in small- to medium-sized environments, and the suitability of this device for future scientific studies depends on the application.
Augmented Reality Scout: Joint Unaided-Eye and Telescopic-Zoom System for Immersive Team Training
The navigation algorithms using monocular cameras in combination with IMU and GPS in an Extended Kalman Filter (EKF) framework is presented to obtain robust and real-time pose estimation for precise augmentation and cooperative tracking.
München Fachgebiet Augmented Reality Augmented Reality for Augmented Reality
A recurring challenge when setting up any augmented reality system is the correct calibration and registration of the involved devices. Depending on the number of devices that are used, the number of
Frameworks Enabling Ubiquitous Mixed Reality Applications Across Dynamically Adaptable Device Configurations
This work identified a set of common questions that can be used to characterize and analyze Mixed Reality applications and uses these same questions to identify challenges as well as present solutions in the form of three frameworks tackling the fields of tracking and inference, interaction and visualization.
Multi-Touch Querying on Data Physicalizations in Immersive AR
This work introduces a novel style of hybrid virtual + physical visualization designed specifically to support interactive data exploration tasks and demonstrates that this solution can support three of the most common spatial data querying interactions used in scientific visualization (streamline seeding, dynamic cutting places, and world-in-miniature visualization).
Virtual Locomotion: A Survey
The design implications of VLTs in terms of strengths, weaknesses and applicability are discussed and taxonomies are proposed to either place similar techniques in meaningful categories or decompose them to their underlying design components.


Parallel Tracking and Mapping on a camera phone
An attempt to implement a keyframe-based SLAM system on a camera phone (specifically, the Apple iPhone 3G) is described and early results demonstrate a system capable of generating and augmenting small maps, albeit with reduced accuracy and robustness compared to SLAM on a PC.
Going out: robust model-based tracking for outdoor augmented reality
A model-based hybrid tracking system for outdoor augmented reality in urban environments enabling accurate, realtime overlays for a handheld device and the accuracy and robustness of the resulting system is demonstrated with comparisons to map-based ground truth data.
An Optical Tracking System for VR/AR-Applications
An optical tracking system is introduced for the use within Virtual and Augmented Reality applications which uses retroreflective markers which are attached to a special designed interaction device and a calibration algorithm which results in sub-pixel accuracy and is therefore well applicable withinAugmented Reality scenarios.
Going out : Robust Tracking for Outdoor Augmented Reality
This demonstration showcases a robust tracking technology for urban outdoor environments that dispenses with the conventional edge model, using instead a coarse textured 3D model and a back store of reference frames with automatic frame selection jump-starts the edge-based tracker after dynamic occlusions or failures.
Affordable Infrared-Optical Pose-Tracking for Virtual and Augmented Reality
In this paper, we describe the hardand software of a new low-cost infrared-optical pose-tracking system for room-sized virtual environments. The system consists of 4-8 shutter-synchronized
CCD‐Camera Based Optical Beacon Tracking for Virtual and Augmented Reality
A scheme for optical beacon tracking using two CCD‐cameras and LED beacons using a very high precision algorithm is introduced so that the tracking method is suitable for augmented reality applications.
An affordable optical head tracking system for desktop VR/AR systems
The presented head tracker is based on two low-cost, commodity FireWire cameras that track a simple 3D dot pattern and provides high accuracy, an update rate of 30 updates per second, a low computational load, and a moderate delay of 66 ms.
The calibration of wide-angle lens cameras using perspective and non-perspective projections in the context of real-time tracking applications
The introduction of a fourth radial lens distortion parameter allows the correction of lens distortion effects over the full sensor area of wide angle lenses, which increases the usable field of view of that specific camera and therefore the size of the trackable observed object volume.
SCAAT: incremental tracking with incomplete information
The introduction and exploration of the SCAAT approach to 3D tracking for virtual environments is introduced, which facilitates user motion prediction, multisensor data fusion, and in systems where the observations are only available sequentially it provides estimates at a higher rate and with lower latency than a multiple-constraint approach.
Simultaneous Object Pose and Velocity Computation Using a Single View from a Rolling Shutter Camera
Two complementary methods are derived, compensating for the rolling shutter deformations to deliver an accurate 3D pose and exploiting them to also estimate the full 3D velocity, which enable a CMOS low cost and low power camera into an innovative and powerful velocity sensor.