Creating Augmented and Virtual Reality Applications: Current Practices, Challenges, and Opportunities

@article{Ashtari2020CreatingAA,
  title={Creating Augmented and Virtual Reality Applications: Current Practices, Challenges, and Opportunities},
  author={Narges Ashtari and Andrea Bunt and Joanna McGrenere and Michael Nebeling and Parmit K. Chilana},
  journal={Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems},
  year={2020}
}
Augmented Reality (AR) and Virtual Reality (VR) devices are becoming easier to access and use, but the barrier to entry for creating AR/VR applications remains high. Although the recent spike in HCI research on novel AR/VR tools is promising, we lack insights into how AR/VR creators use today's state-of-the-art authoring tools as well as the types of challenges that they face. We interviewed 21 AR/VR creators, which we grouped into hobbyists, domain experts, and professional designers. Despite… 

Tables from this paper

Current Practices, Challenges, and Design Implications for Collaborative AR/VR Application Development
TLDR
It is found that AR/VR application creators fulfill four roles: concept developers, interaction designers, content authors, and technical developers, which means one person often incorporates multiple roles and faces a variety of challenges during the design process from the initial contextual analysis to the deployment.
Designers, the Stage Is Yours! Medium-Fidelity Prototyping of Augmented & Virtual Reality Interfaces with 360theater
TLDR
360theater is presented, a new method and a tool for rapid prototyping of AR/VR experiences, which takes dioramas into the virtual realm by enhancing 360° video capture with 3D geometry and simulating spatial interactions via Wizard of Oz.
Authoring With Virtual Reality Nuggets—Lessons Learned
TLDR
This paper builds up on existing work and investigates the VR nugget concept and introduces structured authoring processes based on VR nuggets that show how standalone, combinable, and reusable VR software can serve as a meta-level guide for various VR applications and involve educators as domain experts.
Elements of XR Prototyping: Characterizing the Role and Use of Prototypes in Augmented and Virtual Reality Design
TLDR
An interview study with 17 practitioners from different industry sectors working on professional XR projects establishes the design practices in industry, from early project stages to the final product and highlights key issues for future XR tools research.
Comparing Desktop vs. Mobile Interaction for the Creation of Pervasive Augmented Reality Experiences
TLDR
Although the AR interface was generally considered more intuitive, the desktop platform shows promise in several aspects, such as remote configuration, lower required effort, and overall better scalability.
Pattern-Based Augmented Reality Authoring Using Different Degrees of Immersion: A Learning Nugget Approach
TLDR
This work presents a novel authoring approach for creating mobile AR applications to provide authors with small, ready-to-use AR applications that can be executed and tested directly as a starting point and proposes to use patterns from application domains to further facilitate the authoring process.
Immersive Video Sketching: Low-Fidelity Extended Reality Prototyping for Everyone
TLDR
Immersive Video Sketching is introduced, a low-cost prototyping method for early-phase XR design that can be easily employed by novice and non-expert designers and can help non-experts to grasp the immersive nature of XR environments easily.
Paper Trail: An Immersive Authoring System for Augmented Reality Instructional Experiences
TLDR
Paper Trail is presented, an immersive authoring system designed to explore how to enable instructors to create AR educational experiences, leaving paper at the core of the interaction and enhancing it with various forms of digital media, animations for dynamic illustrations, and clipping masks to guide learning.
PoVRPoint: Authoring Presentations in Mobile Virtual Reality
TLDR
The results indicate that the wide field of view afforded by VR results in significantly faster target slide identification times compared to a tablet-only interface for visually salient targets; and the three-dimensional view in VR enables significantly faster object reordering in the presence of occlusion compared to two baseline interfaces.
A Review on Augmented Reality Authoring Toolkits for Education
Creating pedagogically sound, interactive Augmented Reality (AR) experiences supporting situated and experiential learning remains a challenge to teachers without programming skills. To integrate AR
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 59 REFERENCES
Designer's augmented reality toolkit, ten years later: implications for new media authoring tools
TLDR
Reflections from in-depth interviews with DART developers and other AR experts provide insights on how to successfully engage non-technologists with new media and the challenges they face during authoring, the unique requirements of new mediaAuthoring, and how modern tools are still not meeting the needs of this type of author.
The Trouble with Augmented Reality/Virtual Reality Authoring Tools
TLDR
Two new tools are designed with support for rapid prototyping of new AR/VR content and gesture-based interactions geared towards designers without technical knowledge in gesture recognition, 3D modeling, and programming.
XD-AR
TLDR
How the taxonomy of AR system components can guide the design of future AR platforms and applications and how cross-device interaction challenges could be addressed are discussed.
ProtoAR: Rapid Physical-Digital Prototyping of Mobile Augmented Reality Applications
TLDR
ProtoAR is presented, which supplements rapid physical prototyping using paper and Play-Doh with new mobile cross-device multi-layer authoring and interactive capture tools to generate mobile screens and AR overlays from paper sketches, and quasi-3D content from 360-degree captures of clay models.
360proto: Making Interactive Virtual Reality & Augmented Reality Prototypes from Paper
TLDR
Through five student design jams with a total of 86 participants and their own design space explorations, it is demonstrated that the approach with 360proto is useful to create relatively complex AR/VR applications.
DART: a toolkit for rapid design exploration of augmented reality experiences
TLDR
DART allows designers to specify complex relationships between the physical and virtual worlds, and supports 3D animatic actors (informal, sketch-based content) in addition to more polished content.
Augmented Reality Design Heuristics: Designing for Dynamic Interactions
TLDR
Through a robust and iterative process, a set of Design Heuristics for AR were developed for multidimensional augmented environments with the aim of advancing AR design methods for human factors, ergonomics, and user experience practitioners within the expanding AR community.
A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays
TLDR
Usability challenges facing consumers adopting Virtual Reality (VR) head-mounted displays (HMDs) are identified in a survey of 108 VR HMD users, and it is shown that augmenting VR with a view of reality significantly corrected the performance impairment of typing in VR.
Immersive authoring of Tangible Augmented Reality content: A user study
A Survey of Augmented Reality
TLDR
This survey summarizes almost 50 years of research and development in the field of Augmented Reality AR and provides an overview of the common definitions of AR, and shows how AR fits into taxonomies of other related technologies.
...
1
2
3
4
5
...