Field Reliability of Comprehensive System Scoring in an Adolescent Inpatient Sample

  title={Field Reliability of Comprehensive System Scoring in an Adolescent Inpatient Sample},
  author={Robert E. McGrath and David L. Pogge and John M Stokes and Ana Cragnolino and Michele L Zaccario and Judy Hayman and Teresa Piacentini and Douglas Wayland-Smith},
  pages={199 - 209}
The extent to which the Comprehensive System for the Rorschach is reliably scored has been a topic of some controversy. Although several studies have concluded it can be scored reliably in research settings, little is known about its reliability in field settings. This study evaluated the reliability of both response-level codes and protocol-level scores among 84 adolescent psychiatric inpatients in a clinical setting. Rorschachs were originally administered and scored for clinical purposes… 

Figures and Tables from this paper

Rorschach Performance Assessment System (R-PAS) Interrater Reliability in a Brazilian Adolescent Sample and Comparisons With Three Other Studies

Examination of interrater reliability for scoring the Rorschach Performance Assessment System (R-PAS) in a sample of 89 adolescents using exact agreement intraclass correlations coefficient (ICCs) showed that the ICCs for most variables had low variability across studies, suggesting clear coding guidelines.

Initial Validity of the Logical Rorschach in the Assessment of Trauma

Despite largely equivocal findings, it appears that some aspects of the LR may have some validity in the assessment of trauma-related phenomena.

Neuropsychological Factors and Rorschach Performance in Children

Abstract. This study uses an archival data set to correlate Rorschach scores with measures of cognitive functioning in youth, and extends the literature in three ways. First, although Wechsler-based

Resolving Discrepancies in Psychological Assessment Data with Maltreated Children and Adolescents: The Relevance of Attachment Organization

Psychological assessment is an important area of clinical work with maltreated children. The current study investigated the role of attachment organization as a predictor of patterns of similarities

Response Character Styles in Adolescents: A Replication of Convergent Validity Between the MMPI–A and the Rorschach

Mod Moderated regression analysis supports the hypothesis that RCS moderates the strength of the relationship between Rorschach and MMPI–A.

One More Datum on Rorschach Form Quality

The authors recognize the possibility of Rorschach normative data to be universally applied, but still consider the possible advantage of each country or culture to build its own FQ table that will permit preservation of its particularities.

Juvenile Psychopathy: A Clinical Construct in Need of Restraint?

ABSTRACT Interest in psychopathic traits and their potential applicability to youths appears to be increasing precipitously in the social sciences. Although research on the causes, correlates, and

The Rorschach Inkblot Method: Research

This chapter is aimed at demonstrating how conceptually derived Rorschach research can promote evidence-based practice with adolescents. The chapter discusses accumulated research findings

The Interrater Reliability of Elizur's Hostility Systems and Holt's Aggression Variables: A Meta-Analytical Review

These meta-analytic data suggest that like the contemporary variables included in Exner's Comprehensive System or Gacono and Meloy's (1994) extended aggression scores, the historically important Elizur scoring systems and Holt aggression variables can be scored reliably.

Rorschach Assessment in Child Custody Case

SUMMARY This article describes the utility and limitations of the Rorschach Inkblot Test for addressing issues in child custody cases, with particular attention to identifying level of adjustment or



Scoring Accuracy Using the Comprehensive System for the Rorschach

The results suggest that high levels of scoring errors may exist in the field use of the Comprehensive System, and training standards may need to be devised to insure scoring competence.

Interobserver Agreement, Intraobserver Reliability, and the Rorschach Comprehensive System

Reliability was analyzed at multiple levels of Comprehensive System data, including response-level individual codes and coding decisions and ratios, percentages, and derivations from the Structural Summary.

An Examination of Interrater Reliability for Scoring the Rorschach Comprehensive System in Eight Data Sets

Reliability findings from this study closely match the results derived from a synthesis of prior research, CS summary scores are more reliable than scores assigned to individual responses, small samples are more likely to generate unstable and lower reliability estimates, and Meyer's (1997a) procedures for estimating response segment reliability were accurate.

The Relationship of the Rorschach Schizophrenia Index to Psychotic Features in a Child Psychiatric Sample

Investigation of the reliability and validity of the Rorschach Schizophrenia Index from Exner's (1978, 1993) Comprehensive System for a sample of 413 child psychiatric inpatients found relationships with the Personality Inventory for Children-Revised (PIC-R) and chart diagnoses were examined.

The Comprehensive System for the Rorschach: A Critical Examination

The Comprehensive System (Exner, 1993) is widely accepted as a reliable and valid approach to Rorschach interpretation However, the present article calls attention to significant problems with the

Enhancing Accuracy in Observational Test Scoring: The Comprehensive System As a Case Example

  • R. McGrath
  • Psychology
    Journal of personality assessment
  • 2003
In this article, some issues surrounding accuracy in testing procedures are reviewed, including a discussion of what is known about the problem, an evaluation of several approaches to improving testing practices, and a review of recommendations for the statistical evaluation of rater accuracy.

Empirical support for interrater reliability of Rorschach Comprehensive System coding.

Results confirm the strong empirical evidence of the interrater reliability of this measure when scored by a well-trained and diverse group of researchers and clinicians and suggest that large samples are needed for stable reliability estimates of low base-rate variables and that estimates of the reliability of low Base rate variables are subject to error.

Measurement reliability and agreement in psychiatry

  • P. Shrout
  • Psychology
    Statistical methods in medical research
  • 1998
Psychiatric research has benefited from attention to measurement theories of reliability, and reliability/agreement statistics for psychopathology ratings and diagnoses are regularly reported in

Current nonpatient data for the Rorschach, WAIS-R, and MMPI-2

A literature review yields a surprisingly small number of nonpatient studies focusing on three widely used assessment tools: the WAIS-R, Rorschach, and MMPI-2. In this study, 123 nonpatient adults

The clinical utility of the Rorschach: Unfulfilled promises and an uncertain future

There is currently no scientific basis for justifying the use of Rorschach scales in psychological assessments as they do not address the rational, scientific, and ethical requirements of professional standards for psychological measures.