• Corpus ID: 39164517

Fusing Self-Reported and Sensor Data from Mixed-Reality Training

  title={Fusing Self-Reported and Sensor Data from Mixed-Reality Training},
  author={Trevor Richardson and Stephen B Gilbert and Joseph Holub and Frederick Thompson and Anastacia MacAllister and Rafael Radkowski and Eliot Winer and Paul Davies and Scott Terry},
Military and industrial use of smaller, more accurate sensors are allowing increasing amounts of data to be acquired at diminishing costs during training. [] Key Method Participants’ head position and orientation were tracked using an infrared tracking system. User interaction in the form of interface button presses was recorded and time stamped on each step of the assembly. A trained observer took notes on task performance during the study through a set of camera views that recorded the work area. Finally…

Figures from this paper

Realistic training in VR using physical manipulation
We propose an interaction method for mixed reality with a direct application on training applications. It is based on the combination of two key ideas: providing real user embodiment within virtual
Evaluating the Microsoft HoloLens through an augmented reality assembly application
To assess the Microsoft HoloLens’ potential for delivering AR assembly instructions, the cross-platform Unity 3D game engine was used to build a proof of concept application and showed that while the HoloLens is a promising system, there are still areas that require improvement, such as tracking accuracy, before the device is ready for deployment in a factory assembly setting.
Ethnographic study of a commercially available augmented reality HMD app for industry work instruction
Ethnicographic research of an industry task that includes the context of the industry procedure, pain-points with current methods and a user experience study of an HMD-delivered AR application for delivering work instructions to support engineers performing the procedure is presented.
Using Augmented Reality in the Corporate Environment: A Proposed Study Protocol
  • Kristine M. Larson
  • Computer Science
    2019 Eighth International Conference on Educational Innovation through Technology (EITT)
  • 2019
This paper presents a proposed study protocol on an Augmented Reality training to deliver just-in-time training in the corporate environment using a marker-based system to enhanceTraining in the context of the Human Capital Management industry.
Overcoming the limitations of commodity augmented reality head mounted displays for use in product assembly
An application was developed that guides a user through the assembly of a mock aircraft wing using AR on a Microsoft HoloLens, and solutions to address limitations of the HoloLens for broad use were provided.
Measuring the Performance Impact of Using the Microsoft HoloLens 1 to Provide Guided Assembly Work Instructions
The authors recommend using the HoloLens for complex guided assembly instructions with minor changes, such as allowing the user to toggle the AR instructions on and off at will, to help manufacturing stakeholders understand the benefits of different AR technologies for manual assembly tasks.
Using Visual Intelligence to Automate Maintenance Task Guidance and Monitoring on a Head-mounted Display
An Augmented Reality Visual Intelligence (ARVI) framework, which combines visual perception with cognitive task reasoning to monitor user performance and provide contextualised guidance for maintenance tasks, is presented.
Developing and Evaluating an Augmented Reality Interface to Assist the Joint Tactical Air Controller by Applying Human Performance Models
A 3D augmented reality head mounted display (DARSADS-SVS HMD) interface to support the Joint Tactical Air Controller (JTAC) was developed, developed to harness computational cognitive models of SA-supporting visual scanning, display layout, 3D frame-of-reference transformations, clutter, legibility and working memory.
Using an Industry-ready AR HMD on a Real Maintenance Task: AR Benefits Performance on Certain Task Steps More Than Others
This paper presents a novel evaluation of an industry-ready HMD for delivering AR work instructions in a real-life, industrial procedure for novice users. A user study was performed to examine the
Don't be caught unaware! Enhancing Situational Awareness in Oil & Gas Industry through Augmented Reality
A scenario using Microsoft HoloLens to demonstrate potential use case for Offshore Installation Manager using AR to enhance SA and the preliminary framework using AR provides insights into SA that can be used to inform intervention, such as training programs and enhance overall User Experience for Oil and Gas workers.


WearIT@work: Toward Real-World Industrial Wearable Computing
The wearIT@work project is a 4 1/2-year effort financed by the European Union and aimed at facilitating real-life industrial deployment of wearable technology, and is the largest civilian wearable-computing effort worldwide.
Research Methods in Human-Computer Interaction
Research Methods in Human-Computer Interaction is a thoroughly comprehensive guide to performing research and is essential reading for both quantitative and qualitative methods.
A Review of Mobile HCI Research Methods
It is argued that the bias towards building systems and a lack of research for understanding design and use limits the development of cumulative knowledge on mobile human computer interaction, which inhibits future development of the research field as a whole.
Coming at Things Differently
The field of mixed methods (MM) research facilitates ‘‘coming at things differently.’’ Traditional forms of data gathering using one method for data collection may not be adequate for answering
Combining Qualitative and Quantitative Methods in Information Systems Research: A Case Study
No one approach to information systems research can provide the richness that information systems, as a discipline, needs for further advancement, so the desirability for a variety of approaches to studying information systems is found.
Triangulation and Mixed Methods Designs
This article discusses three innovative forms of data integration that rely on computational support: (a) the integration of geo-referencing technologies with qualitative software, (b) theintegration of multistream visual data in mixed methods research, and (c) the Integration of data from qualitative and quantitative methods.
Strategies for evaluating information visualization tools: multi-dimensional in-depth long-term case studies
An emerging research method called Multi-dimensional In-depth Long-term Case studies (MILCs) which seems well adapted to study the creative activities that users of information visualization systems engage in is described.
Research Design: Qualitative, Quantitative, and Mixed Methods Approaches
A Framework for Design Three Elements of Inquiry Alternative Knowledge Claims Strategies of Inquiry Research Methods Three Approaches to Research Criteria for Selecting an Approach Personal Experiences Audience Summary Writing Exercises Additional Readings.
The one number you need to grow.
By substituting a single question for the complex black box of the customer satisfaction survey, companies can actually put consumer survey results to use and focus employees on the task of stimulating growth.