Effective Analysis of Reaction Time Data

@article{Whelan2008EffectiveAO,
  title={Effective Analysis of Reaction Time Data},
  author={Robert A. Whelan},
  journal={The Psychological Record},
  year={2008},
  volume={58},
  pages={475-482}
}
  • R. Whelan
  • Published 22 June 2008
  • Psychology
  • The Psychological Record
Most analyses of reaction time (RT) data are conducted by using the statistical techniques with which psychologists are most familiar, such as analysis of variance on the sample mean. Unfortunately, these methods are usually inappropriate for RT data, because they have little power to detect genuine differences in RT between conditions. In addition, some statistical approaches can, under certain circumstances, result in findings that are artifacts of the analysis method itself. A corpus of… 

Analyzing Reaction Times Análisis de los tiempos de reacción

Reaction times (RTs) are an important source of information in experimental psychology. Classical methodological considerations pertaining to the statistical analysis of RT data are optimized for

A Literature Review on Reaction Time Kinds of Reaction Time Experiments

TLDR
The major literature conclusions that are applicable to undergraduate laboratories using my Reaction Time software are summarized and help you write a good report on your reaction time experiment.

Non-Gaussian Distributional Analyses of Reaction Times (RT): Improvements that Increase Efficacy of RT Tasks for Describing Cognitive Processes

TLDR
Current results conform to a large literature demonstrating a more nuanced understanding of cognition afforded by non-Gaussian analysis of RT, compelling neuropsychology to enlarge assessment technology beyond the limitations of paper-and-pencil instruments.

Análisis de los tiempos de reacción

Reaction times (RTs) are an important source of information in experimental psychology. Classical methodological considerations pertaining to the statistical analysis of RT data are optimized for

On the efficacy of procedures to normalize Ex-Gaussian distributions

TLDR
This paper presents different procedures to normalize data sampled from an Ex-Gaussian distribution in such a way that they are suitable for parametric tests based on the normality assumption.

A Theory of Reaction Time Distributions

We develop a general theory of reaction time ({RT}) distributions in psychological experiments, deriving from the distribution of the quotient of two normal random variables, that of the task

Comparing reaction time sequences from human participants and computational models

TLDR
This paper proposes a method, based on time series analysis, to filter the observed reaction times in order to separate the local speed effects, and shows that after such filtering the between-participant correlations increase as well as the average correlation between participant and model increases.

Combining Data-Oriented and Process-Oriented Approaches to Modeling Reaction Time Data

This paper combines two different approaches to modeling reaction time data from lexical decision experiments, viz. a dataoriented statistical analysis by means of a linear mixed effects model, and a

The visual reaction time distribution in the tasks with different demands on information processing

TLDR
The study supported the hypothesis on asymmetric distribution of RTs, specifically when measured in the both eye-hand visual simple and multiple-choice reaction tasks with two up to four choices.
...

References

SHOWING 1-10 OF 27 REFERENCES

Methods for dealing with reaction time outliers.

TLDR
It is concluded using quantitative examples that robust measures are much less affected by outliers and cutoffs than measures based on moments, and fitting explicit distribution functions as a way of recovering means and standard deviations is probably not worth routine use.

Effects of truncation on reaction time analysis.

TLDR
The authors report a promising maximum likelihood procedure for estimating properties of an untruncated distribution from a truncated sample and present in an appendix a set of procedures to control for truncation biases when testing hypotheses.

A warning about median reaction time.

  • J. Miller
  • Mathematics
    Journal of experimental psychology. Human perception and performance
  • 1988
TLDR
An important practical consequence of the bias in median reaction time is that sample medians must not be used to compare reaction times across experimental conditions when there are unequal numbers of trials in the conditions.

Group reaction time distributions and an analysis of distribution statistics.

TLDR
It is shown that this method of averaging is exact for certain distributions (i.e., the resulting distribution belongs to the same family as the individual distributions) and Monte Carlo studies and application of the method provide evidence that properties derived from the group reaction time distribution are much the same as average propertiesderived from the data of individual subjects.

Reaction Time Distribution Analysis of Neuropsychological Performance in an ADHD Sample

TLDR
Results of this study suggest that the greater number of abnormally long RTs of children with ADHD reflect attentional lapses on some but not all trials and demonstrate why slower RT is found when estimates of variability assume normal Gaussian distributions.

Analysis of Response Time Distributions

Response times are one of the most commonly collected dependent measures in empirical investigations of human cognition. Issues of response time analysis are becoming more important as models are

How many discoveries have been lost by ignoring modern statistical methods

Hundreds of articles in statistical journals have pointed out that standard analysis of variance, Pearson productmoment correlations, and least squares regression can be highly misleading and can

Word frequency, repetition, and lexicality effects in word recognition tasks: beyond measures of central tendency.

Response time (RT) distributions obtained from 3 word recognition experiments were analyzed by fitting an ex-Gaussian function to the empirical data to determine the main effects and interactive

Provenance of correlations in psychological data

TLDR
Spectral likelihood classification illustrates an extremely general framework for testing competing spectral hypotheses and is offered for use in measuring the specific character of fluctuations in designed experiments.

Understanding and using the implicit association test: I. An improved scoring algorithm.

TLDR
The best-performing measure incorporates data from the IAT's practice trials, uses a metric that is calibrated by each respondent's latency variability, and includes a latency penalty for errors, and strongly outperforms the earlier (conventional) procedure.