Challenges in Survey Research

@inproceedings{Wagner2020ChallengesIS,
  title={Challenges in Survey Research},
  author={Stefan Wagner and Daniel M{\'e}ndez Fern{\'a}ndez and Michael Felderer and Daniel Graziotin and Marcos Kalinowski},
  booktitle={Contemporary Empirical Methods in Software Engineering},
  year={2020}
}
While being an important and often used research method, survey research has been less often discussed on a methodological level in empirical software engineering than other types of research. This chapter compiles a set of important and challenging issues in survey research based on experiences with several large-scale international surveys. The chapter covers theory building, sampling, invitation and follow-up, statistical as well as qualitative analysis of survey data and the usage of… 
On Psychometric Instruments in Software Engineering Research: An Ongoing Study
TLDR
A critical review on the use of psychometric instruments in SE research regarding personality is provided to provide a critical review of the instruments used and the results so far are quite initial.
Lyzeli: a tool for identifying the clues in survey research data
TLDR
Lyzeli, a tool designed to assist researchers in analyzing and correlating survey responses, is introduced, which aims to deliver automatic detection of question types, sentiment analysis of responses, data filtering, word cloud, word count, graphics, codification for open-based questions answers.
A Survey Research on Feedback Practices in Agile Software Development Teams
TLDR
Among the obtained results, job satisfaction and productivity were positively influenced by the practice of feedback, and the periodicity of feedback and the absence of an evaluation among members were considered improvement points.
Behavioral Software Engineering: Methodological Introduction to Psychometrics
TLDR
This paper provides an introduction to psychometric theory for the evaluation of measurement instruments (e.g., psychological tests and questionnaires) for software engineering researchers and presents guidelines that enable using existing instruments and developing new ones adequately.
Gender Differences in Personality Traits of Software Engineers
TLDR
Gender differences in personality traits of software engineers are studied to suggest that women score significantly higher in Openness to Experience, Honesty-Humility, and Emotionality than men and men show higher psychopathic traits than women.
"We do not appreciate being experimented on": Developer and Researcher Views on the Ethics of Experiments on Open-Source Projects
TLDR
A survey among open source developers and empirical software engineering researchers to see what behaviors they think are acceptable, and suggests that open-source developers are largely open to research, provided it is done transparently.
Having Fun Doing Research on Agile Methods
TLDR
The influence of Alfredo Goldman’s work within Agile Methods since 2001 is shown, not only on teaching, but also on the research field and on the Brazilian software development industry.
Awareness of Secure Coding Guidelines in the Industry - A first data analysis
TLDR
This study aims to assess the level of awareness of secure coding in industrial software engineering, the skills of software developers to spot weaknesses in software code, avoid them, and the organizational support to adhere to coding guidelines.
A methodology for psycho-biological assessment of stress in software engineering
TLDR
This article proposes a robust methodology to detect and measure stress in controlled experiments that is tailored to software engineering research and hopes to stimulate research on stress in software engineering and inspire future research that is backed up by supported theories and employs psychometrically validated measures.
...
1
2
...

References

SHOWING 1-10 OF 79 REFERENCES
Practical Experiences in the Design and Conduct of Surveys in Empirical Software Engineering
TLDR
A survey is an empirical research strategy for the collection of information from heterogeneous sources that often exhibit a high degree of external validity, and there is still a lack of knowledge on how to use surveys in a systematic manner for software engineering empirical research.
Personal Opinion Surveys
TLDR
This chapter uses examples of three software engineering surveys to illustrate the advantages and pitfalls of using surveys and discusses the six most important stages in survey-based research.
Principles of survey research part 2: designing a survey
TLDR
This second article of this series looks at the process of designing a survey, and uses the three surveys described in Part 1 to suggest good and bad practice in software engineering survey research.
Principles of survey research: part 5: populations and samples
TLDR
What the authors mean by a population and a sample and the implications of each for survey research are discussed and examples of correct and incorrect sampling techniques used in software engineering surveys are provided.
Survey Research in Software Engineering: Problems and Mitigation Strategies
TLDR
The elicited problems and strategies may serve researchers during the design of their studies, however, it was observed that some strategies were conflicting and shows that it is important to conduct a trade-off analysis between strategies.
Principles of survey research: part 3: constructing a survey instrument
TLDR
The need to use any previous research results to reduce the overheads of survey construction is pointed out and a number of issues to consider when selecting questions, constructing questions, deciding on the type of question and finalizing the format of the questionnaire are identified.
Survey Research Methods
TLDR
This chapter discusses ethical issues in Survey Research, as well as methods of data collection and analysis, and types of error in Surveys.
Principles of survey research part 4: questionnaire evaluation
This article discusses how to avoid biased questions in survey instruments, how to motivate people to complete instruments and how to evaluate instruments. In the context of survey evaluation, we
Survey Research Methodology in Management Information Systems: An Assessment
TLDR
A general framework for classifying and examining survey research is presented and this framework is used to analyze the usage of survey research conducted in the past decade in the MIS field and makes specific recommenoations that directly address the major problems highlighted in the review.
...
1
2
3
4
5
...