Design, Evaluation, and Analysis of Questionnaires for Survey Research

@inproceedings{Saris2007DesignEA,
  title={Design, Evaluation, and Analysis of Questionnaires for Survey Research},
  author={Willem E. Saris and Irmtraud N. Gallhofer},
  year={2007}
}
Preface. Introduction. PART I. THE THREE STEPS PROCEDURE TO DESIGN REQUESTS FOR AN ANSWER. 1. Concepts-by-postulation and concepts-by-intuition. 2. From social science concepts-by-intuition to assertions. 3. The formulation of requests for an answer. PART II. CHOICES INVOLVED IN QUESTIONNAIRE DESIGN. 4. Specific survey research features of requests for an answer. 5. Response alternatives. 6. The structure of open ended and closed survey items. 7. Survey items in batteries. 8. Mode of data… Expand

Figures, Tables, and Topics from this paper

The KISS Principle in Survey Design
Writings on the optimal length for survey questions are characterized by a variety of perspectives and very little empirical evidence. Where evidence exists, support seems to favor lengthy questionsExpand
Discussion Evaluation Procedures for Survey Questions
In this article, different criteria for the choice of an evaluation procedure for survey questions are discussed. Firstly, we mention a practical criterion: the amount of data collection theExpand
Two Approaches to Evaluate Measurement Quality in Online Surveys: An Application Using the Norwegian Citizen Panel
TLDR
Evaluating the measurement quality of a set of survey questions from two Multitrait-Multimethod experiments implemented in the 5th wave of the Norwegian Citizen Panel concludes that SQP can provide as accurate quality predictions as MTMM can estimate the quality for web survey questions. Expand
Good questions, bad questions? A Post-Survey Evaluation Strategy Based on Item Nonresponse.
In this paper we discuss a three-step strategy to evaluate data quality in terms of item nonresponse and to identify potentially flawed questions. We provide an example with several data sets of aExpand
Estimation of the effects of measurement characteristics on the quality of survey questions
TLDR
Cross national generalizations of the findings published so far drawn from national studies are generated to provide a quantitative estimate of the effects of the different choices on the reliability, validity and the method effects. Expand
Impact of the Mode of Data Collection on the Quality of Answers to Survey Questions Depending on Respondent Characteristics
TLDR
No significant impact of the background characteristics, the mode and the interaction between them on the quality is found when comparing the quality for different groups of respondents in a face-to-face and in a Web survey. Expand
Total Survey Error: Design, Implementation, and Evaluation
The total survey error (TSE) paradigm provides a theoretical framework for optimizing surveys by maximizing data quality within budgetary constraints. In this article, the TSE paradigm is viewed asExpand
A procedure to prevent differences in translated survey items using SQP
Survey translation has developed best practice procedures to translate survey instruments aiming that the same stimuli and measurement properties should be provided. However, it is very difficult toExpand
Questions for Surveys: Current Trends and Future Directions.
TLDR
An advocate for a decision-oriented framework for thinking about survey questions and their characteristics is advocated, which distinguishes among various aspects of question characteristics, including question topic, question type and response dimension, conceptualization and operationalization of the target object, question structure, question form, response categories, question implementation, and question wording. Expand
Impact of raising awareness of respondents on the measurement quality in a web survey
Web surveys are very attractive because they offer the possibility to collect a huge amount of data in a very short time, but they also suffer from several problems (Reips in Psychology experimentsExpand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 260 REFERENCES
Estimation of the effects of measurement characteristics on the quality of survey questions
TLDR
Cross national generalizations of the findings published so far drawn from national studies are generated to provide a quantitative estimate of the effects of the different choices on the reliability, validity and the method effects. Expand
An assessment of the difficulty of questions used in the ISSP-questionnaires, the clarity of their wording, and the comparability of the responses
The rationale of cross-national survey research rests on the assumptions (1) that the answers given by respondents are sufficiently informative about the behaviours and opinions asked for in theExpand
Response Effects in the Electronic Survey
IN ALL SCIENTIFIC ENDEAVOR the available tools affect the questions one can ask and the data one can collect. In this report, we examine a new tool in survey research, the electronic orExpand
Survey Questions: Handcrafting the Standardized Questionnaire.
This book reviews the experimental literature on how survey questions "behave" as well as the lore of professional experience and culls from them those guiding principles and specific findings thatExpand
The Reliability of Survey Attitude Measurement
Several theoretical hypotheses are developed concerning the relation of question and respondent characteristics to the reliability of survey attitude measurement. To test these hypotheses,Expand
QUAID: A questionnaire evaluation aid for survey methodologists
TLDR
QUAID was designed to identify nine classes of problems, but only five of these problems are addressed in this article: unfamiliar technical term, vague or imprecise relative term, ambiguous noun phrase, complex syntax, and working memory overload. Expand
The use of magnitude estimation in large scale survey research
A rarely mentioned problem in social science research concerns the discrepancy between the measurement level of variables & the mathematical properties & requirements of the techniques with which theExpand
Operationalization of Social Science Concepts by Intuition
Much has been written about the effects of the wording of survey questions onresponses, whereas, relatively little attention has been given to the content of thequestions or the translation ofExpand
SURVEY PRETESTING: DO DIFFERENT METHODS PRODUCE DIFFERENT RESULTS?
Pretesting is generally agreed to be an indispensable stage in survey questionnaire development, yet we know little about how well different pretesting methods identify particular types of problems.Expand
The calibration and cross-modal validation of ratio scales of political opinion in survey research
Abstract The aims of this paper are twofold: first, to set the ratio scaling of opinion in perspective by reviewing a series of laboratory and field experiments designed to build and validate ratioExpand
...
1
2
3
4
5
...