Generalizing Generalizability in Information Systems Research

@article{Lee2003GeneralizingGI,
  title={Generalizing Generalizability in Information Systems Research},
  author={Allen S. Lee and Richard Baskerville},
  journal={Inf. Syst. Res.},
  year={2003},
  volume={14},
  pages={221-243}
}
Generalizability is a major concern to those who do, and use, research. Statistical, sampling-based generalizability is well known, but methodologists have long been aware of conceptions of generalizability beyond the statistical. The purpose of this essay is to clarify the concept of generalizability by critically examining its nature, illustrating its use and misuse, and presenting a framework for classifying its different forms. The framework organizes the different forms into four types… 
Other-Settings Generalizability in IS Research
TLDR
The paper concludes with the recommendation that future empirical IS research should include an explicit discussion of the other-settings generalizability of research findings.
Improving the replicability and generalizability of inferences in quantitative communication research
  • J. Long
  • Annals of the International Communication Association
  • 2021
ABSTRACT This paper discusses the assessment of quality of quantitative communication research in light of the so-called ‘replicability crisis’ that has affected neighboring disciplines. For social
Conceptualizing Generalizability: New Contributions and a Reply
TLDR
This essay advances the ethical questions raised by generalization: A formulation of judgment calls that need to be made when generalizing a theory to a new setting, based on the common ground between Tsang and Williams and the authors' original article.
Context may be King, but generalizability is the Emperor!
TLDR
This commentary generally agrees with the notion that context should matter more in IS research; yet, the importance of generalizability in research should not be downplayed and should be given higher position in the scientific process and be the ultimate goal for researchers.
Generalizability in Qualitative Research: A Tale of Two Traditions
TLDR
This commentary contributes to the literature on qualitative research by making suggestions for more consistent and unanimous procedures to adopt in qualitative inquiries, and seeks to show that in qualitative domains, generalizability is possible provided that it is the main objective of the study.
Generalization and Induction: Misconceptions, Clarifications, and a Classification of Induction
TLDR
This work builds upon the balance-of-evidence argument that the view that Hume's problem of induction has a solution, even if the authors do not know what it is, and proposes an alternative classification of induction.
Narrowing the Theory's or Study's Scope May Increase Practical Relevance
TLDR
It is argued that generalizability can be in conflict with explanation or prediction accuracy, and in sciences such as cancer research, the cancer accounts have become increasingly narrower (and less generalizable).
Research Commentary - Generalizability of Information Systems Research Using Student Subjects - A Reflection on Our Practices and Recommendations for Future Research
TLDR
Recommendations are presented for authors and reviewers, for determining whether the use of students is appropriate in a particular context, and for presenting and discussing work that uses student subjects.
The Ends of Information Systems Research: A Pragmatic Framework
TLDR
A pragmatic framework is proposed that explores the choices IS researchers make around theories and methodologies, ethical methods of conduct, desirable outcomes, and the long-term impact of the research beyond a single site and topic area.
Towards the improved treatment of generalization of knowledge claims in IS research: drawing general conclusions from samples
TLDR
A framework for justifying generalization in information systems (IS) research is presented and the need for researcher judgment when making any claim about the likely truth of sample-based knowledge claims in other settings is highlighted.
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 99 REFERENCES
Information systems and qualitative research
Most mature social studies include both qualitative and quantitative methods in the normal course of research activities. Scholars may gain reputations based on one or the other, or in some cases on
Studying Information Technology in Organizations: Research Approaches and Assumptions
TLDR
It is suggested that much can be gained if a plurality of research perspectives is effectively employed to investigate information systems phenomena and that there exist other philosophical assumptions that can inform studies of the relationships between information technology, people, and organizations.
Information Systems and Qualitative Research
  • J. Liebenau
  • IFIP — The International Federation for Information Processing
  • 1997
Since the Manchester conference on research methods in Information Systems (IS) more than ten years ago, qualitative IS researchers have made great strides toward acceptance both within the IS field
Validation in Information Systems Research: A State-of-the-Art Assessment
TLDR
If and how the field has advanced in instrument validation is determined, and approaches are suggested for reinvigorating the quest for validation in IS research via content/construct validity, reliability, and manipulation validity.
The Discovery of Grounded Theory: Strategies for Qualitative Research
Most writing on sociological method has been concerned with how accurate facts can be obtained and how theory can thereby be more rigorously tested. In The Discovery of Grounded Theory, Barney Glaser
Information Systems Success: The Quest for the Dependent Variable
A large number of studies have been conducted during the last decade and a half attempting to identify those factors that contribute to information systems success. However, the dependent variable in
Concept and Theory Formation in the Social Sciences
The title of my paper refers intentionally to that of a Symposium held in December, 1952, at the annual meeting of the American Philosophical Association.2 Ernest Nagel and Carl G. Hempel contributed
Information Privacy: Measuring Individuals' Concerns About Organizational Practices
TLDR
An instrument that identifies and measures the primary dimensions of individuals' concers about organizational information privacy practices, and was rigorously tested and validated across several heterogenous populations, providing a high degree of confidence in the scales' validity, reliability, and generalizability.
A Confessional Account of an Ethnography About Knowledge Work
TLDR
Based on data collected during an eight-month ethnographic study of three groups of knowledge workers-computer system administrators, competitive intelligence analysts, and librarians-I explore the informing practices they relied upon.
A Set of Principles for Conducting and Evaluating Interpretive Field Studies in Information Systems
TLDR
A set of principles for the conduct and evaluation of interpretive field research in information systems is proposed, along with their philosophical rationale, and the usefulness of the principles is illustrated by evaluating three publishedinterpretive field studies drawn from the IS research literature.
...
1
2
3
4
5
...