Comparing and ranking hospitals based on outcome: results from The Netherlands Stroke Survey.

Abstract

BACKGROUND Measuring quality of care and ranking hospitals with outcome measures poses two major methodological challenges: case-mix adjustment and variation that exists by chance. AIM To compare methods for comparing and ranking hospitals that considers these. METHODS The Netherlands Stroke Survey was conducted in 10 hospitals in the Netherlands, between October 2002 and May 2003, with prospective and consecutive enrollment of patients with acute brain ischaemia. Poor outcome was defined as death or disability after 1 year (modified Rankin scale of > or =3). We calculated fixed and random hospital effects on poor outcome, unadjusted and adjusted for patient characteristics. We compared the hospitals using the expected rank, a novel statistical measure incorporating the magnitude and the uncertainty of differences in outcome. RESULTS At 1 year after stroke, 268 of the total 505 patients (53%) had a poor outcome. There were substantial differences in outcome between hospitals in unadjusted analysis (chi(2) = 48, 9 df, P < 0.0001). Adjustment for 12 confounders led to halving of the chi(2) (chi(2) = 24). The same pattern was observed in random effects analysis. Estimated performance of individual hospitals changed considerably between unadjusted and adjusted analysis. Further changes were seen with random effect estimation, especially for smaller hospitals. Ordering by expected rank led to shrinkage of the original ranks of 1-10 towards the median rank of 5.5 and to a different order of the hospitals, compared to ranking based on fixed effects. CONCLUSION In comparing and ranking hospitals, case-mix-adjusted random effect estimates and the expected ranks are more robust alternatives to traditional fixed effect estimates and simple rankings.

DOI: 10.1093/qjmed/hcp169

5 Figures and Tables

020402011201220132014201520162017
Citations per Year

64 Citations

Semantic Scholar estimates that this publication has 64 citations based on the available data.

See our FAQ for additional information.

Cite this paper

@article{Lingsma2010ComparingAR, title={Comparing and ranking hospitals based on outcome: results from The Netherlands Stroke Survey.}, author={Hester F. Lingsma and Ewout Willem Steyerberg and Marinus J. C. Eijkemans and Diederik W. J. Dippel and Wilma J M Scholte op Reimer and Hans JC van Houwelingen}, journal={QJM : monthly journal of the Association of Physicians}, year={2010}, volume={103 2}, pages={99-108} }