The aligned rank transform for nonparametric factorial analyses using only anova procedures

@article{Wobbrock2011TheAR,
  title={The aligned rank transform for nonparametric factorial analyses using only anova procedures},
  author={Jacob O. Wobbrock and Leah Findlater and Darren Gergle and James J. Higgins},
  journal={Proceedings of the SIGCHI Conference on Human Factors in Computing Systems},
  year={2011}
}
Nonparametric data from multi-factor experiments arise often in human-computer interaction (HCI). Examples may include error counts, Likert responses, and preference tallies. But because multiple factors are involved, common nonparametric tests (e.g., Friedman) are inadequate, as they are unable to examine interaction effects. While some statistical techniques exist to handle such data, these techniques are not widely available and are complex. To address these concerns, we present the Aligned… Expand
An Aligned Rank Transform Procedure for Multifactor Contrast Tests
TLDR
A new algorithm for conducting contrasts within the ART paradigm is created and validated on 72,000 data sets, indicating that ART-C does not inflate Type I error rates, unlike contrasts based on ART, and that ARTC has more statistical power than a t-test, Mann-Whitney U test, Wilcoxon signed-rank test, and ART. Expand
The aligned rank transform and discrete variables: A warning
  • Haiko Luepsen
  • Mathematics, Computer Science
  • Commun. Stat. Simul. Comput.
  • 2017
TLDR
The aim of this study is to analyze the impact of discrete distributions on the error rate and it is shown that this scaling impact is restricted to the ART- as well as the combination of ART- and INT-method. Expand
A comparison of recent nonparametric methods for testing effects in two-by-two factorial designs
ABSTRACT The two-way two-levels crossed factorial design is a commonly used design by practitioners at the exploratory phase of industrial experiments. The F-test in the usual linear model forExpand
ff ects with Non-Normal Data Using the Aligned Rank Transform , ARTool and SAS ® University Edition
Most statistical techniques commonly used in horticultural research are parametric tests that are valid only for normal data with homogeneous variances. While parametric tests are robust when theExpand
Comparison of nonparametric analysis of variance methods: A vote for van der Waerden
  • Haiko Luepsen
  • Mathematics, Computer Science
  • Commun. Stat. Simul. Comput.
  • 2018
TLDR
The aim of this study is to identify a method that is applicable without too much testing for all the attributes of the plot and shows the overall best performance though there are some situations in which it is disappointing. Expand
Nonparametric analysis of interactions: a review and gap analysis
To improve a system, from a statistical process control approach, tools from the field of design and analysis of experiments might be used. Within this field, experimental and observational studiesExpand
Researcher-Centered Design of Statistics: Why Bayesian Statistics Better Fit the Culture and Incentives of HCI
TLDR
It is shown that Bayesian analysis yields more precise effects with each new study, facilitating knowledge accrual without traditional meta-analyses, and Bayesian methods can be adopted from the bottom up without the need for new incentives for replication or meta-analysis. Expand
The comparison of nonparametric statistical tests for interaction effects in factorial design
Department of Statistics, Faculty of Science, Kasetsart University, Bangkok, Thailand 10900 C H R O N I C L E A B S T R A C T Article history: Received October 9, 2018 Received in revised format:Expand
Anchoring Effects and Troublesome Asymmetric Transfer in Subjective Ratings
TLDR
Four analyses of NASA-TLX data from four previously published HCI papers are reported on, finding that asymmetric transfer is common, occurring in 42% of tests analysed and the data conforms to predictions of anchoring effects. Expand
Differences in Crowdsourced vs. Lab-based Mobile and Desktop Input Performance Data
TLDR
This study cautions against assuming that crowdsourced data for performance experiments will directly reflect lab-based data, particularly for mobile devices, and investigates variability in mobile device movement and orientation as experimenter control decreased. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 16 REFERENCES
Powerful and consistent analysis of likert-type rating scales
TLDR
New developments from the field of medical statistics that enable analyzing multiple factor designs nonparametrically are presented to the HCI audience and demonstrated by showing the errors in the parametric treatment of nonparametric data in experiments of the size typically reported in HCI research are demonstrated. Expand
Nonparametric Tests of Interaction in Experimental Design
Until recently the design of experiments in the behavioral and social sciences that focused on interaction effects demanded the use of the parametric analysis of variance. Yet, researchers have beenExpand
Rank Methods for Combination of Independent Experiments in Analysis of Variance
It is now coming to be generally agreed that in testing for shift in the two-sample problem, certain tests based on ranks have considerable advantage over the classical t-test. From the beginning,Expand
The ART test of interaction: a robust and powerful rank test of interaction in factorial models
Simulations are used to show that the ART (Aligned Ranks Transformation) procedure,when testing for interaction, is robust and almost as powerful as the F-test when the data satisfy the classicalExpand
THE ALIGNED RANK TRANSFORM PROCEDURE
TLDR
Simulation results suggest that the fix-up provides a valid procedure for analyzing multifactor designs when error distributions are symmetric or moderately skewed and appears to have power advantages over normal theory ANOVA when error distribution are heavy tailed. Expand
Rank Transformations as a Bridge between Parametric and Nonparametric Statistics
Abstract Many of the more useful and powerful nonparametric procedures may be presented in a unified manner by treating them as rank transformation procedures. Rank transformation procedures are onesExpand
Statistical analysis of repeated measures data using SAS procedures.
TLDR
This procedure implements random effects in the statistical model and permits modeling the covariance structure of the data, and can compute efficient estimates of fixed effects and valid standard errors of the estimates in the SAS System. Expand
Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes
TLDR
This work presents a "$1 recognizer" that is easy, cheap, and usable almost anywhere in about 100 lines of code, and discusses the effect that the number of templates or training examples has on recognition, the score falloff along recognizers' N-best lists, and results for individual gestures. Expand
A robust and powerful rank test of treatment effects in balanced incomplete block designs
This paper is concerned primarily with a Monte Carlo investigation into the small sample robustness and power of an aligned rank transformation statistic. The aligned rank transformation statisticExpand
A robust and powerful rank test of treatment effects in balanced incomplete block designs
This paper is concerned primarily with a Monte Carlo investigation into the small sample robustness and power of an aligned rank transformation statistic. The aligned rank transformation statisticExpand
...
1
2
...