Is there an association between survey characteristics and representativeness? A meta-analysis

  title={Is there an association between survey characteristics and representativeness? A meta-analysis},
  author={Carina Cornesse and M. Bo{\vs}njak},
  journal={Survey research methods},
How to achieve survey representativeness is a controversially debated issue in the field of survey methodology. Common questions include whether probability-based samples produce more representative data than nonprobability samples, whether the response rate determines the overall degree of survey representativeness, and which survey modes are effective in generating highly representative data. This meta-analysis contributes to this debate by synthesizing and analyzing the literature on two… Expand

Figures and Tables from this paper

A Validation of R-Indicators as a Measure of the Risk of Bias using Data from a Nonresponse Follow-Up Survey
Abstract R-indicators are increasingly used as nonresponse bias indicators. However, their effectiveness depends on the auxiliary data used in their estimation. Because of this, it is not alwaysExpand
Within-household selection of target-respondents impairs demographic representativeness of probabilistic samples: evidence from seven rounds of the European Social Survey
This paper examines the demographic representativeness of different types of probabilistic samples based on the results of seven rounds of the European Social Survey. Focusing on the distinctionExpand
Is There More Than the Answer to the Question? Device Use and Completion Time as Indicators for Selectivity Bias and Response Convenience in Online Surveys
The main objective of the German Emigration and Remigration Panel Study (GERPS) is to establish a longitudinal data set that provides information on life trajectories of international migrants.Expand
Going web or staying paper? The use of web-surveys among older people
It is concluded that a web-survey might be a feasible and good alternative in surveys targeting people in the retirement age range, however, without offering a paper-questionnaire, a small but important group will likely be missing with potential biased estimates as the result. Expand
What are we missing? The profile of non-respondents in the Finnish Gambling 2015 survey
Socio-economic position was associated with lower response rate which may cause bias while studying gambling behaviour of socio-economically vulnerable individuals, and additional auxiliary information through record linkage to administrative registers is offered. Expand
Sampling and fieldwork practices in Europe: Analysis of methodological documentation from 1,537 surveys in five cross-national projects, 1981-2017
This article addresses the comparability of sampling and fieldwork with an analysis of methodological data describing 1,537 national surveys from five major comparative cross-national survey projectsExpand
The design and implementation of mixed mode surveys
In an optimal design for mixed‐mode surveys, be it within a country or across countries, there are three phases that need attention: the design phase, estimating the potential mode measurement effect due to different modes and adjusting for any such bias. Expand
Sample Bias Related to Household Role
A bootstrap analysis reveals that population mean estimates of monthly payment instrument use that do not account for this type of sample misrepresentation are likely biased for instruments often used to make household purchases. Expand
Interventions to Increase the Reachability of Migrants in Germany With Health Interview Surveys: Mixed-Mode Feasibility Study.
The IMIRA survey appraised the usability of mixed-mode or mixed-method approaches among migrant groups with a probability sample in 2 German states and found that personal face-to-face contact was the most effective intervention to recruit participants. Expand
A national mixed-mode seroprevalence random population-based cohort on SARS-CoV-2 epidemic in France: the socio-epidemiological EpiCov study
The Epicov study is one of the largest national random population-based seroprevalence cohort, with both an epidemiological and sociological approaches to evaluate the spread of the COVID-19 epidemic, and the impact on health and living conditions. Expand


Indicators for the representativeness of survey response
This paper describes the concept of R-indicators to assess potential differences between the sample and the response and may facilitate analysis of survey response over time, between various fieldwork strategies or data collection modes. Expand
The Effect of Survey Mode and Sampling on Inferences about Political Attitudes and Behavior: Comparing the 2000 and 2004 ANES to Internet Surveys with Nonprobability Samples
Since the inception of the American National Election Study (ANES) in the 1940s, data have been collected via face-to-face interviewing in the homes of members of area probability samples of AmericanExpand
National Surveys Via Rdd Telephone Interviewing Versus the Internet Comparing Sample Representativeness and Response Quality
In a national field experiment, the same questionnaires were administered simultaneously by RDD telephone interviewing, by the In- ternet with a probability sample, and by the Internet with aExpand
An evaluation of the weighting procedures for an online access panel survey
Opinion research is frequently carried out through the Internet and a further increase can be expected. The article focuses on the online access panel, in which respondents are previously recruitedExpand
Consequences of reducing nonresponse in a national telephone survey.
This study compares two random digit dial national telephone surveys that used identical questionnaires but very different levels of effort, finding very few significant differences on attention to media and engagement in politics, social trust and connectedness, and most social and political attitudes. Expand
Noncoverage and nonresponse in an Internet survey
Noncoverage (lack of access to the Internet) appears to be of greater concern than nonresponse (unwillingness to participate given access) for representation in Internet surveys of persons 50 years old and older in the US. Expand
Responsive design for household surveys: tools for actively controlling survey errors and costs
The paper defines responsive design and uses examples to illustrate the responsive use of paradata to guide mid-survey decisions affecting the non-response, measurement and sampling variance properties of resulting statistics. Expand
Selection error in single‐ and mixed mode surveys of the Dutch general population
This study compares the extent of selection error evoked by the four major contemporary modes of data collection and three sequential mixed mode designs and questions the use of response rates to motivate the choice of mode and use of mixed mode surveys. Expand
Aspects of Responsive Design with Applications to the Swedish Living Conditions Survey
Abstract In recent literature on survey nonresponse, new indicators of the quality of the data collection have been proposed. These include indicators of balance and representativity (of the set ofExpand
The Fraction of Missing Information as a Tool for Monitoring the Quality of Survey Data
The response rate has been a longstanding indicator of the quality of survey data. Recent empirical research, however, has called into question the value of the response rate as a proxy indicator forExpand