Psychometric properties of implementation measures for public health and community settings and mapping of constructs against the Consolidated Framework for Implementation Research: a systematic review
BACKGROUND The Worksite Health Promotion Capacity Instrument (WHPCI) was developed to assess two key factors for effective worksite health promotion: collective willingness and the systematic implementation of health promotion activities in companies. This study evaluates the diagnostic qualities of the WHPCI based on its subscales Health Promotion Willingness and Health Promotion Management, which can be used to place companies into four different categories based on their level of health promotion capacity. METHODS Psychometric evaluation was conducted using exploratory factor and reliability analyses with data taken from a random sample of managers from n = 522 German information and communication technology (ICT) companies. Receiver operating characteristic (ROC) analyses were conducted to determine further diagnostic qualities of the instrument and to establish the cut-off scores used to determine each company's level of health promotion capacity. RESULTS The instrument's subscales, Health Promotion Willingness and Health Promotion Management, are based on one-dimensional constructs, each with very good reliability (Cronbach's alpha = 0.83/0.91). ROC analyses demonstrated satisfactory diagnostic accuracy with an area under the curve (AUC) of 0.76 (SE = 0.021; 95% CI 0.72-0.80) for the Health Promotion Willingness scale and 0.81 (SE = 0.021; 95% CI 0.77-0.86) for the Health Promotion Management scale. A cut-off score with good sensitivity (71%/76%) and specificity (69%/75%) was determined for each scale. Both scales were found to have good predictive power and exhibited good efficiency. CONCLUSIONS Our findings indicate preliminary evidence for the validity and reliability of both subscales of the WHPCI. The goodness of each cut-off score suggests that the scales are appropriate for determining companies' levels of health promotion capacity. Support in implementing (systematic) worksite health promotion can then be tailored to each company's needs based on their current capacity level.