How Likely Is Simpson’s Paradox?

@article{Pavlides2009HowLI,
  title={How Likely Is Simpson’s Paradox?},
  author={Marios G. Pavlides and Michael D. Perlman},
  journal={The American Statistician},
  year={2009},
  volume={63},
  pages={226 - 233}
}
What proportion of all 2×2×2 contingency tables exhibit Simpson’s Paradox? An exact answer is obtained for large sample sizes and extended to 2×2×ℓ tables by Monte Carlo approximation. Conditional probabilities of the occurrence of Simpson’s Paradox are also derived. If the observed cell proportions satisfy a Simpson reversal, the posterior probability that the population parameters satisfy the same reversal is obtained. This Bayesian analysis is applied to the well-known Simpson reversal of… 
View on Taylor & Francis
stat.washington.edu
56 Citations
Highly Influential Citations
3
Background Citations
22
Methods Citations
2

56 Citations

A First Inquiry into Simpson's Paradox with Belief Functions
TLDR
This paper explores what happens if data are considered in the framework of belief functions instead of classical probability theory, and the co-occurrence of the paradox with both the probabilistic approach and belief function approach is studied.
How Likely is Simpson's Paradox in Path Models?
  • N. Kock
  • Economics
    Int. J. e Collab.
  • 2015
TLDR
It is suggested that Simpson's paradox is likely to occur in empirical studies, in the field of e-collaboration and other fields, frequently enough to be a source of concern.
The ubiquity of the Simpson’s Paradox
The Simpson’s Paradox is the phenomenon that appears in some datasets, where subgroups with a common trend (say, all negative trend) show the reverse trend when they are aggregated (say, positive…
Yule–Simpson’s paradox: the probabilistic versus the empirical conundrum
The current literature views Simpson’s paradox as a probabilistic conundrum by taking the premises (probabilities/parameters/ frequencies) as known. In such a context, it is shown that the paradox…
The quantification of Simpson’s paradox and other contributions to contingency table theory
The analysis of contingency tables is a powerful statistical tool used in experiments with categorical variables. This study improves parts of the theory underlying the use of contingency tables.…
Detecting Simpson's Paradox
TLDR
A method to discover Simpson’s paradox for the trend of the pair of continuous variables, which uses categorical variables to partition the whole data set into groups and finds the sign reversal between the coefficient correlations measured in the group relative to the original entire data.
Simpson's paradox
  • A. Alin
  • Mathematics, Environmental Science
  • 2010
Simpson's paradox occurs when an observed association between two variables is reversed after considering the third variable. Having two different conclusions makes this phenomenon paradoxical. In…
Judicious Judgment Meets Unsettling Updating: Dilation, Sure Loss and Simpson’s Paradox
TLDR
These findings show that unsettling updates reflect a collision between the rules' assumptions and the inexactness allowed by the model itself, highlighting the invaluable role of judicious judgment in handling low-resolution information, and the care the user must take when applying learning rules to update imprecise probabilities.
Simpson's Paradox and Causality
There are three types of questions associated with Simpson’s Paradox (SP): (i) why is SP paradoxical? (ii) what conditions generate it? and (iii) what should be done about SP? Pertaining to the first…
Simpson's paradox, moderation and the emergence of quadratic relationships in path models: an information systems illustration
While Simpson's paradox is well-known to statisticians, it seems to have been largely neglected in many applied fields of research, including the field of information systems. This is problematic…
...
...

References

SHOWING 1-10 OF 26 REFERENCES
On Simpson's Paradox and the Sure-Thing Principle
Abstract This paradox is the possibility of P(A|B) <P(A|B') even though P(A|B)≥P(A| B') both under the additional condition C and under the complement C' of that condition. Details are given on why…
The Asymptotic Proportion of Subdivisions of a 2×2 Table that Result in Simpson's Paradox
TLDR
The asymptotic proportion of the subdivisions of the original 2×2 table such that SP occurs is calculated and it is shown that this asymPTotic proportion is bounded above by 1/12.
Copositive matrices and Simpson's paradox
ASYMPTOTIC UPPER BOUNDS FOR THE PROPORTION OF SIMPSON SUBDIVISIONS OF A 2 × 2 TABLE
A sample of size N is characterized by two attributes, A and B. Assume that the corresponding 2 × 2 table of counts is subdivided into n 2 × 2 subtables according to the levels of an arbitrary and…
Computing Bayes Factors by Combining Simulation and Asymptotic Approximations
Abstract The Bayes factor is a ratio of two posterior normalizing constants, which may be difficult to compute. We compare several methods of estimating Bayes factors when it is possible to simulate…
Simpson's paradox in the Farey sequence.
We investigate the appearance of Simpson’s paradox in the Farey sequence of reduced fractions in the unit interval.
A Mathematician at the Ballpark: Odds and Probabilities for Baseball Fans
Preface. 1. Who's the Best Hitter? 2. But Which Team Are You Betting On? 3. Will You Win the Lottery? 4. What Would Pete Rose Do? 5. Will the Yankees Win if Steinbrenner is Gone? 6. How Long Should…
Bayes theory
This is a book about the theory of Bayesian inference at a rather sophisticated mathematical level. It is based on lectures given to students who already have had a course in measure-theoretic…
Confounding and Simpson's paradox
TLDR
A historical comparison of success rates in removing kidney stones showed success rates looked rather different when stone diameter was taken into account, an improvement over the use of open surgery.
NOTES ON THE THEORY OF ASSOCIATION OF ATTRIBUTES IN STATISTICS
THE simplest possible form of statistical classification is "division" (as the logicians term it) "by dichotomy," i.e. the sorting of the objects or individuals observed into one or other of two…
...
...