Quality of Different Scales in an Online Survey in Mexico and Colombia

@article{Revilla2015QualityOD,
  title={Quality of Different Scales in an Online Survey in Mexico and Colombia},
  author={M. Revilla and Carlos Ochoa},
  journal={Journal of Politics in Latin America},
  year={2015},
  volume={7},
  pages={157 - 177}
}
The formulation of theories and hypotheses is done at the level of concepts. These concepts are often tested by operationalizing them using survey questions. However, measurement errors make it impossible for survey questions to measure the concepts of interest perfectly. In order to correct for measurement errors, information is needed about their size, or the size of their complement, the quality. For the USA and Europe, a lot is already known about the quality of questions, but this has not… Expand

Tables from this paper

Two Approaches to Evaluate Measurement Quality in Online Surveys: An Application Using the Norwegian Citizen Panel
TLDR
Evaluating the measurement quality of a set of survey questions from two Multitrait-Multimethod experiments implemented in the 5th wave of the Norwegian Citizen Panel concludes that SQP can provide as accurate quality predictions as MTMM can estimate the quality for web survey questions. Expand
A classification of response scale characteristics that affect data quality: a literature review
TLDR
This paper provides an updated and detailed classification of the design decisions that matter in questionnaire development, and a summary of what is said in the literature about their impact on data quality. Expand
Towards a reconsideration of the use of agree-disagree questions in measuring subjective evaluations.
TLDR
Based on available research, models of cognitive processing, and a review of question characteristics, it is recommended that IS questions over AD questions for most purposes are recommended. Expand
In Search of the Best Response Scale in a Mixed-mode Survey (Web and Mail). Evidence from MTMM Experiments in the GESIS Panel
Mixed-mode surveys allow researchers to combine the advantages of multiple modes, for example, the low cost of the web mode with the higher coverage of offline modes. One drawback of combining modesExpand
The value of online surveys: a look back and a look ahead
TLDR
A detailed and critical look at the evolution of online survey research since Evans and Mathur’s (2005) article on the value of online surveys is presented. Expand
Measurement Reliability, Validity, and Quality of Slider Versus Radio Button Scales in an Online Probability-Based Panel in Norway
TLDR
Estimating the measurement quality of sliders compared to radio button scales controlling for the device respondents used in the Norwegian Citizen Panel (NCP), a probability-based online panel finds that if smartphone respondents represent a nonnegligible part of the whole sample, offering the response options in form of a slider or a radio button scale leads to a quite similar measurement quality. Expand
Measuring Trust in Medical Researchers: Adding Insights from Cognitive Interviews to Examine Agree-Disagree and Construct-Specific Survey Questions
TLDR
Qualitative analysis reveals five sources of difficulties with response processing that shed light on under-examined reasons why AD and CS questions can produce different results, with CS not always yielding higher measures of data quality than AD. Expand

References

SHOWING 1-10 OF 63 REFERENCES
Impact of the Mode of Data Collection on the Quality of Answers to Survey Questions Depending on Respondent Characteristics
TLDR
No significant impact of the background characteristics, the mode and the interaction between them on the quality is found when comparing the quality for different groups of respondents in a face-to-face and in a Web survey. Expand
The Validity and Reliability of Survey Questions
Inspired by the research of Frank Andrews on the reliability and validity of survey questions, a large-scale research project was conducted in the Netherlands. The project was comprised of twoExpand
INFORMATION TRANSMISSION IN THE SURVEY INTERVIEW: NUMBER OF RESPONSE CATEGORIES AND THE RELIABILITY OF ATTITUDE MEASUREMENT
This paper examines the relation between the number of response categories used to measure attitudes in survey interviews and the reliability of such attitude measurements. I review and criticize theExpand
Correction for Measurement Errors in Survey Research: Necessary and Possible
TLDR
It is illustrated here that correction for measurement errors can and should be performed in survey research. Expand
The Reliability of Survey Attitude Measurement
Several theoretical hypotheses are developed concerning the relation of question and respondent characteristics to the reliability of survey attitude measurement. To test these hypotheses,Expand
Response Styles in Cross-national Survey Research
Studies of attitudes across countries generally rely on a comparison of aggregated mean scores to Likert-scale questions. This presupposes that when people complete a questionnaire, their answers areExpand
Construct Validity and Error Components of Survey Measures: A Structural Modeling Approach
Measurement errors can have profound effects on statistical relationships, and better information on the quality of measures seems needed. This study uses a new technology-structural modeling of dataExpand
Can a Non-Probabilistic Online Panel Achieve Question Quality Similar to that of the European Social Survey?
Recently, Revilla and Saris (2012) showed, using data from the Netherlands, that the quality of responses (product of reliability and validity) in a probability-based online panel (LISS) can beExpand
Design, Evaluation, and Analysis of Questionnaires for Survey Research
TLDR
This book discusses the development of survey research features of requests for an answer, the effects of measurement characteristics on the quality of survey questions, and applications in social science research. Expand
The Relation Between Culture and Response Styles
The authors investigated at the country level the effects of four cultural orientations identified and studied by Hofstede on two commonly recognized response biases: extreme response style andExpand
...
1
2
3
4
5
...