Semantic-aware label placement for augmented reality in street view

  title={Semantic-aware label placement for augmented reality in street view},
  author={Jianqing Jia and Semir Elezovikj and Heng Fan and Shuojin Yang and Jing Liu and Wei Guo and Chiu Chiang Tan and Haibin Ling},
  journal={The Visual Computer},
  pages={1 - 15}
In an augmented reality (AR) application, placing labels in a manner that is clear and readable without occluding the critical information from the real world can be a challenging problem. This paper introduces a label placement technique for AR used in street view scenarios. We propose a semantic-aware task-specific label placement method by identifying potentially important image regions through a novel feature map, which we refer to as guidance map. Given an input image, its saliency… 
Artificial intelligence (AI) in augmented reality (AR)-assisted manufacturing applications: a review
This research presents a novel and scalable approach called “SmartGlass” that automates the very labor-intensive and therefore time-heavy and expensive and expensive process of manually cataloging and displaying information in augmented reality (AR).
Mobile Augmented Reality: User Interfaces, Frameworks, and Intelligence
This article presents the first effort of surveying existing MAR frameworks and further discusses the latest studies on MAR through a top-down approach, summarising the development of emerging research fields, current state-of-the-art, and discuss the important open challenges and possible theoretical and technical directions.


Where to Place: A Real-Time Visual Saliency Based Label Placement for Augmented Reality Applications
A novel method for optimal placement of labels for AR by an objective function that minimizes both occlusion with visually salient regions in scenes of interest, and the temporal jitter for facilitating coherence in real-time AR applications is presented.
Image-Based Label Placement for Augmented Reality Browsers
This paper proposes an image-based label placement method, which combines identifying potentially important image regions and determining manual placement tendencies while labeling, and adds geometric constraints for placing labels in the optimization problem to obtain the final label layout.
Image-driven view management for augmented reality browsers
An image-based approach, which combines a visual saliency algorithm with edge analysis to identify potentially important image regions and geometric constraints for placing labels in Augmented Reality systems, is introduced.
Hedgehog labeling: View management techniques for external labels in 3D space
This work uses 3D geometric constraints to achieve label placement that fulfills the desired objectives, but also behaves consistently over time as the viewpoint changes, and overcomes the lack of temporal coherence.
Real-Time Video Annotations for Augmented Reality
This work presents a new approach to determine and track areas with less visual interest based on feature density and to automatically compute label layout from this information, which works in under 5ms per frame and provides flexible constraints for controlling label placement behaviour to the application designer.
Estimating Visibility of Annotations for View Management in Spatial Augmented Reality Based on Machine-Learning Techniques
A view management method for spatial AR, VisLP, that places labels and linkage lines based on the estimation of the visibility that reflects human’s subjective mental workload in reading information and objective measures of reading correctness in various projection conditions is proposed.
Evaluating label placement for augmented reality view management
  • Ronald T. Azuma, C. Furmanski
  • Computer Science
    The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings.
  • 2003
Moves of objective readability from the user study demonstrated that in practice, human subjects were able to read labels fastest with the algorithms that most quickly prevented overlap, even if placement wasn't ideal.
Density-based label placement
This work introduces a versatile density-based approach to label placement that aims to put labels in uncluttered areas of an underlying 2D visualization and supports prioritized label placement, user-defined label-to-label and label- to-feature margins, obstacle-constrained labeling, and arbitrarily shaped labels.
Evaluation of labelling layout method for image-driven view management in augmented reality
An image-driven view management method to superimpose 2D labels to the objects under indoor environments such as sculpture and toy by minimizing penalty function is studied and the proposed method represents the best results in terms of avoiding occlusion and efficiency.
An empirical evaluation of labelling method in augmented reality
The quantitative measurement of clutter indicates the change induced by labels on real scene, therefore contributing the label design on view management in future.