Focus Groups for Artifact Refinement and Evaluation in Design Research

  title={Focus Groups for Artifact Refinement and Evaluation in Design Research},
  author={Monica Chiarini Tremblay and Alan R. Hevner and Donald J. Berndt},
  journal={Commun. Assoc. Inf. Syst.},
Focus groups to investigate new ideas are widely used in many research fields. [] Key Method The cycle of build and evaluate using EFGs continues until the artifact is released for field test in the application environment. Then, the field test of the design artifact may employ confirmatory focus groups (CFGs) to establish the utility of the artifact in field use. Rigorous investigation of the artifact requires multiple CFGs to be run with opportunities for quantitative and qualitative data collection and…

Figures and Tables from this paper

Conducting focus group research in a design science project : Application in developing a process model for the front end of innovation

Focus groups are a popular qualitative research method often applied to different areas of such as in medical research. The aim of this research paper is to apply and test the focus group procedure

Design science research with focus groups – a pragmatic meta-model

A specific meta-model for DSR with FG is presented that delivers new insights and practical guidelines for academics and professionals conducting and documenting real-world research and development initiatives deep-rooted in stakeholders' participation.

Fail Early, Fail Often: Towards Coherent Feedback Loops in Design Science Research Evaluation

An approach is proposed that ensures coherence between initial problem definition and final evaluation activities by explicating the notion of relevance underlying the DSR project, and between design and construction activities by creating situational design specifications.

A Mixed Methods Approach To Combining Behavioral And Design Research Methods In Information Systems Research

A mixed methods approach to how behavioral and design research methods can be combined in a coherent manner is proposed and five specific mixed methods research designs are identified that describe how a supplementary behavioral research study can be conducted within the context of a larger design research project.

Artifact Sampling: Using Multiple Information Technology Artifacts to Increase Research Rigor

Researchers in many scientific disciplines routinely conceptualize information technologies (IT) as antecedents or outcomes in theoretical models. The ongoing theorizing of IT leads to a novel

Ensemble Artifact Design For Context Sensitive Decision Support

This paper describes an IS artifact design framework that has been generated from the development of several practitioner-oriented decision support systems (DSS) in which contextual aspects relevant to practitioners’ decision making are considered as integral design themes.

Method Engineering as Design Science

In this paper, we motivate, devise, demonstrate, and evaluate an approach for the research-based development of information systems development methods (ISDMs). This approach, termed “method

Population targeted requirements acquisition

A nascent design theory for RA to target specific populations to define functional requirements for new IS, and five reference theories – personal construct theory, theory of disability, diffusion of innovations, social actor theory, and media richness and information synchronicity theory – support the design.

Lessons learned on applying design science for bridging the collaboration gap between industry and academia in empirical software engineering

The practical experiences with using design science in the context of empirical software engineering are presented, and how the design science framework helped us to bridge the collaborative gap with industry partners.

Evaluation of Design Science instantiation artifacts in Software engineering research*

This paper presents guidelines for defining and performing evaluation of Design Science instantiation artifacts in software engineering research.



Using the focus group method in software engineering: obtaining practitioner and user experiences

  • J. KontioL. LehtolaJ. Bragge
  • Computer Science
    Proceedings. 2004 International Symposium on Empirical Software Engineering, 2004. ISESE '04.
  • 2004
The focus group method is a cost-effective and quick empirical research approach for obtaining qualitative insights and feedback from practitioners and application users but a major limitation is that it is useful only in studying concepts that can be understood by participants in a limited time.

Design alternatives for the evaluation of design science research artifacts

The paper at hand surveys existing methods and introduces a framework that equally supports the designer and the user of artifact evaluation approaches, and embeds the framework into the design science research process.

On theory development in design science research: anatomy of a research project

This paper presents the exegesis of a DSRIS research project in which creating a (prescriptive) design theory through the process of developing and testing an information systems artifact is inextricably bound to the testing and refinement of its kernel theory.

A Three Cycle View of Design Science Research

The recognition of these three cycles in a research project clearly positions and differentiates design science from other research paradigms and concludes with a claim to the pragmatic nature of design science.

A framework for Design Science research activities

Design Science (or Design Research) as a research paradigm has been underemphasised in IS research in favour of empirical research using the Positivist and Interpretivist approaches of Natural and

Being Proactive: Where Action Research Meets Design Research

The similarities between two approaches to investigating information systems in organizations, action research and design research, both directly intervene in real-world domains and effect changes in these domains are investigated.

Focus Groups in Social Research

There is an increasing divergence of focus group practice between social researchers and commercial market researchers. This book addresses the key issues and practical requirements of the social

Complexity of Information Systems Development Projects: Conceptualization and Measurement Development

This paper conceptualizes and develops valid measurements of the key dimensions of information systems development project (ISDP) complexity that adequately satisfies the criteria for unidimensionality, convergent validity, discriminant validity, reliability, factorial invariance across different types of ISDPs, and nomological validity.

Focus Groups as a Knowledge Elicitation Technique: An Exploratory Survey

It was found that focus groups performed better in generating original responses than individual interviews and thatfocus groups were at least as good as individual interviews in terms of the quality and acceptability of ideas.

Interface: The Use and Misuse of Focus Groups

The paper discusses the use and misuse of focus groups, a somewhat informal technique that can help assess user needs and feeling both before interface design and long after implementation.