Meta‐audit of laboratory ISO accreditation inspections: measuring the old emperor's clothes

Abstract

Accreditation to ISO/IEC 17025 is required for EC official food control and veterinary laboratories by Regulation (EC) No. 882/2004. Measurements in hospital laboratories and clinics are increasingly accredited to ISO/IEC 15189. Both of these management standards arose from command and control military standards for factory inspection during World War II. They rely on auditing of compliance and have not been validated internally as assessment bodies require of those they accredit. Neither have they been validated to criteria outside their own ideology such as the Cochrane principles of evidence-based medicine which might establish whether any benefit exceeds their cost. We undertook a retrospective meta-audit over 14 years of internal and external laboratory audits that checked compliance with ISO 17025 in a public health laboratory. Most noncompliances arose solely from clauses in the standard and would not affect users. No effect was likely from 91% of these. Fewer than 1% of noncompliances were likely to have consequences for the validity of results or quality of service. The ISO system of compliance auditing has the performance characteristics of a poor screening test. It adds substantially to costs and generates more noise (false positives) than informative signal. Ethical use of resources indicates that management standards should not be used unless proven to deliver the efficacy, effectiveness, and value required of modern healthcare interventions.

DOI: 10.1002/mbo3.314

Extracted Key Phrases

Showing 1-10 of 50 references

Coercive monopoly Available at http:// en.wikipedia.org/wiki

  • b Wikipedia
  • 2015
Highly Influential
5 Excerpts

United Kingdom accreditation service Available at http://en.wikipedia.org/wiki/United_Kingdom_ Accreditation_Service

  • Wikipedia
  • 2015
Highly Influential
5 Excerpts

Evaluation of Accreditation by Meta-Audit http://www.scientificamerican.com/article/medicalprocedures-prove-unnecessary

  • I G Wilson
  • 2015
1 Excerpt

Guidance document on official controls, under Regulation (EC) 882/2004, concerning microbiological sampling and testing of foodstuffs

  • 2015

ISO 9000: an ineffective quality system. Available at http:// asq.org/learn-about-quality/iso-9000/overview/is-it-worth-it/ iso-9000-ineffective

  • C Heffner, S C Larson, B Lowder, P Stites
  • 2015
2 Excerpts

Probophila: a disease of our time

  • A Kenny, P Davies
  • 2015
2 Excerpts

On the hazards of significance testing Part 1: the screening problem Available at http:// www.dcscience.net/2014/03/10/on-the-hazards-of- significance-testing-part-1-screening

  • D Colquhoun
  • 2014
3 Excerpts

Pathology quality assurance review report

  • I Barnes
  • 2014
1 Excerpt