Focus Groups for Artifact Refinement and Evaluation in Design Research

@article{Tremblay2010FocusGF,
  title={Focus Groups for Artifact Refinement and Evaluation in Design Research},
  author={Monica Chiarini Tremblay and Alan R. Hevner and Donald J. Berndt},
  journal={Commun. Assoc. Inf. Syst.},
  year={2010},
  volume={26},
  pages={27}
}
Focus groups to investigate new ideas are widely used in many research fields. [...] Key Method The cycle of build and evaluate using EFGs continues until the artifact is released for field test in the application environment. Then, the field test of the design artifact may employ confirmatory focus groups (CFGs) to establish the utility of the artifact in field use. Rigorous investigation of the artifact requires multiple CFGs to be run with opportunities for quantitative and qualitative data collection and…Expand

Figures, Tables, and Topics from this paper

Conducting focus group research in a design science project : Application in developing a process model for the front end of innovation
Focus groups are a popular qualitative research method often applied to different areas of such as in medical research. The aim of this research paper is to apply and test the focus group procedureExpand
Design science research with focus groups – a pragmatic meta-model
TLDR
A specific meta-model for DSR with FG is presented that delivers new insights and practical guidelines for academics and professionals conducting and documenting real-world research and development initiatives deep-rooted in stakeholders' participation. Expand
Fail Early, Fail Often: Towards Coherent Feedback Loops in Design Science Research Evaluation
TLDR
An approach is proposed that ensures coherence between initial problem definition and final evaluation activities by explicating the notion of relevance underlying the DSR project, and between design and construction activities by creating situational design specifications. Expand
A Mixed Methods Approach To Combining Behavioral And Design Research Methods In Information Systems Research
TLDR
A mixed methods approach to how behavioral and design research methods can be combined in a coherent manner is proposed and five specific mixed methods research designs are identified that describe how a supplementary behavioral research study can be conducted within the context of a larger design research project. Expand
Artifact Sampling: Using Multiple Information Technology Artifacts to Increase Research Rigor
Researchers in many scientific disciplines routinely conceptualize information technologies (IT) as antecedents or outcomes in theoretical models. The ongoing theorizing of IT leads to a novelExpand
Ensemble Artifact Design For Context Sensitive Decision Support
TLDR
This paper describes an IS artifact design framework that has been generated from the development of several practitioner-oriented decision support systems (DSS) in which contextual aspects relevant to practitioners’ decision making are considered as integral design themes. Expand
Lessons learned on applying design science for bridging the collaboration gap between industry and academia in empirical software engineering
TLDR
The practical experiences with using design science in the context of empirical software engineering are presented, and how the design science framework helped us to bridge the collaborative gap with industry partners. Expand
Population targeted requirements acquisition
TLDR
A nascent design theory for RA to target specific populations to define functional requirements for new IS, and five reference theories – personal construct theory, theory of disability, diffusion of innovations, social actor theory, and media richness and information synchronicity theory – support the design. Expand
Evaluation of Design Science instantiation artifacts in Software engineering research*
Design is a process of creating applicable solutions to a problem, and as such has long been accepted research paradigm in traditional engineering disciplines. More recently, it has been frequentlyExpand
The POWER app: design and usability testing of a mobile app for the collection of patient-reported outcome data in type A haemophilia (Preprint)
BACKGROUND POWER is an observational study that aims at evaluating the relationship between physical activity levels and bleedings in patients with haemophilia A. Self-reported outcomes of theExpand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 60 REFERENCES
Using the focus group method in software engineering: obtaining practitioner and user experiences
  • J. Kontio, L. Lehtola, J. Bragge
  • Computer Science
  • Proceedings. 2004 International Symposium on Empirical Software Engineering, 2004. ISESE '04.
  • 2004
TLDR
The focus group method is a cost-effective and quick empirical research approach for obtaining qualitative insights and feedback from practitioners and application users but a major limitation is that it is useful only in studying concepts that can be understood by participants in a limited time. Expand
Design alternatives for the evaluation of design science research artifacts
TLDR
The paper at hand surveys existing methods and introduces a framework that equally supports the designer and the user of artifact evaluation approaches, and embeds the framework into the design science research process. Expand
On theory development in design science research: anatomy of a research project
TLDR
This paper presents the exegesis of a DSRIS research project in which creating a (prescriptive) design theory through the process of developing and testing an information systems artifact is inextricably bound to the testing and refinement of its kernel theory. Expand
A Three Cycle View of Design Science Research
TLDR
The recognition of these three cycles in a research project clearly positions and differentiates design science from other research paradigms and concludes with a claim to the pragmatic nature of design science. Expand
A framework for Design Science research activities
Design Science (or Design Research) as a research paradigm has been underemphasised in IS research in favour of empirical research using the Positivist and Interpretivist approaches of Natural andExpand
Being Proactive: Where Action Research Meets Design Research
TLDR
The similarities between two approaches to investigating information systems in organizations, action research and design research, both directly intervene in real-world domains and effect changes in these domains are investigated. Expand
Focus Groups in Social Research
There is an increasing divergence of focus group practice between social researchers and commercial market researchers. This book addresses the key issues and practical requirements of the socialExpand
Complexity of Information Systems Development Projects: Conceptualization and Measurement Development
TLDR
This paper conceptualizes and develops valid measurements of the key dimensions of information systems development project (ISDP) complexity that adequately satisfies the criteria for unidimensionality, convergent validity, discriminant validity, reliability, factorial invariance across different types of ISDPs, and nomological validity. Expand
Focus Groups as a Knowledge Elicitation Technique: An Exploratory Survey
TLDR
It was found that focus groups performed better in generating original responses than individual interviews and thatfocus groups were at least as good as individual interviews in terms of the quality and acceptability of ideas. Expand
Interface: The Use and Misuse of Focus Groups
TLDR
The paper discusses the use and misuse of focus groups, a somewhat informal technique that can help assess user needs and feeling both before interface design and long after implementation. Expand
...
1
2
3
4
5
...