How Legitimate and Justified are Judgments in Program Evaluation?

@article{Hurteau2009HowLA,
  title={How Legitimate and Justified are Judgments in Program Evaluation?},
  author={Marthe Hurteau and Sylvain Houle and St{\'e}phanie Mongiat},
  journal={Evaluation},
  year={2009},
  volume={15},
  pages={307 - 319}
}
The main function of program evaluations is to describe programs in order to generate judgments of value. To be considered credible, judgments should be both legitimate and justified. The research presented in this article posed the following question: do program evaluation practitioners generate legitimate and justified judgments? A meta-analysis of 40 program evaluation reports was carried out, which found that only 50 percent of the reports generated judgments. While these judgments seemed… 

Figures and Tables from this paper

Credible Judgment: Combining Truth, Beauty, and Justice

The research summarized in this chapter provides descriptive evidence to support House's vision of validity by expanding connections with his theory to a wide variety of professions, in addition to

Toward the Development of Reporting Standards for Evaluations

The process used and the resulting checklist and associated standards are outlined, which are defined as the minimum, evaluation-specific elements that must be reported to make judgments about the quality of the evaluation.

The overall evaluative conclusion as an element of evaluation practice

  • J. Macdonald
  • Medicine, Sociology
    Evaluation Matters—He Take Tō Te Aromatawai
  • 2019
While the literature does not definitively inform evaluators of whether they should always reach an overall evaluative conclusion, who they should involve, and what methods they should use, this review does supportevaluators to reflect on these issues in their practice, and to make deliberate, informed decisions about the making—or not—of overall conclusions or judgements in future evaluations.

Methodological Credibility

Investigation of how evaluations are perceived and used by the public through an online crowdsourcing service indicated that the type of evaluation methods and the direction of the findings both influenced the credibility of the foundries and moderated the relationship between thedirection of the evaluation findings and attitudes toward the evaluated program.

Acting together in determining value: A professional ethical responsibility of evaluators

What ethics means in the field of evaluation is largely confined to matters of face-to-face interaction of professionals with those with whom professionals work; what is commonly referred to as

The practice of evaluative reasoning in the Aotearoa New Zealand public sector : a thesis presented in partial fulfilment of the requirements for the degree of Doctor of Philosophy at Massey University, Wellington, New Zealand

iii ABSTRACT This study argues that sound evaluative reasoning, defined as “the systematic means for arriving at evaluative conclusions . . . the principles that support inferences drawn by

How Do You Define Success? Evaluative Criteria for Informal STEM Education

Abstract Evaluative criteria define a “successful” intervention and direct what evaluation questions to ask, data to collect, and conclusions to draw. This study analyzes the criteria that underpin a

Administrators’ Assessments of Online Courses and Student Retention in Higher Education: Lessons Learned

Criteria may vary across public, private, and for profit universities for online courses around the world, but despite differences, there seem to be some successful lessons that could be shared

Do frameworks enable educational psychologists to work effectively and efficiently in practice? A critical discussion of the development of executive frameworks

This paper explores whether adopting an “executive framework” makes educational psychologists’ (EPs) practice more efficient and effective. Whilst many EPs understand and value executive frameworks

A Teacher and Researcher: A Scratch on the Science Community and Meaning of Evaluation with the Research Doctoral Programs Ranking

The epistemology and phenomenology of contemporary society tend to be deepened, and the philosophical challenges never are minimal that we may be called to face with the kind of post-modern chaos

References

SHOWING 1-10 OF 47 REFERENCES

Foundations of Program Evaluation: Theories of Practice

PART ONE: INTRODUCTION Social Program Evaluation Its History, Tasks and Theory Good Theory for Social Program Evaluation PART TWO: STAGE ONE THEORIES: BRINGING TRUTH TO SOCIAL PROBLEM SOLVING Michael

The Evolving Syntheses of Program Value

In this paper, we object to Michael Scriven's claim that the basic logic of evaluation is criterial and standards-based. We note that valuing is an integral part of perception and that valuing within

Evaluation Practice Reconsidered

Evaluation Practice Reconsidered encourages a new way of thinking about the activity of judging the merit, worth, or significance of some human action, such as a policy, program, or project. Yet, it

Evaluation Utilization as Argumentation

Evaluation utilization is discussed in this article from an argumentative perspective. Rather than regarding evaluative information as indisputable knowledge, it is viewed as a collection of

The Logic of Evaluation

A sketch of the arguments for adding the logic of evaluation to the areas of argumentation that have been partly mapped and are worth further work by workers in rhetoric, argumentation,

Utilization-focused evaluation: The new century text

PART ONE: TOWARD MORE USEFUL EVALUATIONS Evaluation Use Both Challenge and Mandate What Is Utilization-Focused Evaluation? How Do You Get Started? Fostering Intended Use by Intended Users The

Evaluation Methodology Basics: The Nuts and Bolts of Sound Evaluation

Our online web service was introduced by using a wish to work as a comprehensive on the web electronic digital collection that gives access to many PDF file e-book catalog. You could find many kinds

Values in Evaluation and Social Research

This chapter discusses the role of evaluation in society and the importance of values in the development of deliberative democracy.

Validity in quantitative content analysis

It is argued that QCA should be conceived of as a form of testing and measurement, and if this argument is successful, it becomes possible to frame many of the problems associated with QCA studies under the well-articulated rubric of test validity.