A Kernel Method for the Two-Sample-Problem

Abstract

We propose a framework for analyzing and comparing distributions, allowing us to design statistical tests to determine if two samples are drawn from different distributions. Our test statistic is the largest difference in expectations over functions in the unit ball of a reproducing kernel Hilbert space (RKHS). We present two tests based on large deviation bounds for the test statistic, while a third is based on the asymptotic distribution of this statistic. The test statistic can be computed in quadratic time, although efficient linear time approximations are available. Several classical metrics on distributions are recovered when the function space used to compute the difference in expectations is allowed to be more general (eg. a Banach space). We apply our two-sample tests to a variety of problems, including attribute matching for databases using the Hungarian marriage method, where they perform strongly. Excellent performance is also obtained when comparing distributions over graphs, for which these are the first such tests.

Extracted Key Phrases

8 Figures and Tables

Showing 1-10 of 72 references

Kdd cup

  • R Caruana, T Joachims
  • 2004
Highly Influential
10 Excerpts

Real analysis and probability

  • R M Dudley
  • 2002
Highly Influential
7 Excerpts

Two-sample test statistics for measuring discrepancies between two multivariate probability density functions using kernel-based density estimates

  • N Anderson, P Hall, D Titterington
  • 1994
Highly Influential
5 Excerpts

Approximation Theorems of Mathematical Statistics

  • R Serfling
  • 1980
Highly Influential
3 Excerpts

Statistical Inference

  • G Casella, R Berger
  • 2002
Highly Influential
1 Excerpt

Integral probability metrics and their generating classes of functions

  • A Müller
  • 1997
Highly Influential
3 Excerpts

Continuous Univariate Distributions

  • N L Johnson, S Kotz, N Balakrishnan
  • 1994
Highly Influential
1 Excerpt
Showing 1-10 of 332 extracted citations
050100'06'07'08'09'10'11'12'13'14'15'16'17
Citations per Year

591 Citations

Semantic Scholar estimates that this publication has received between 490 and 714 citations based on the available data.

See our FAQ for additional information.