Measuring the reliability of a computer-aided systematic observation instrument.


The inter- and intraobserver reliabilities of data collected by observers trained in the use of the coach analysis instrument (CAI) are reported. The CAI is part of the computerized coaching analysis system (CCAS). The CAI collects data related to the learning environment created by the coach in a team/sport practice situation. Both inter- and intraobserver reliabilities are reported for each of the instrument's seven dimensions as well as for the overall instrument. The reliability measures reported are total percent agreement (T) and Cohen's kappa (K). The results indicated that, although the overall coaching analysis instrument reached a T value of 90.8%, it failed to meet the 80% level for the K measure (K = 78.5%). A dimension by dimension examination of the data was undertaken to determine the reasons for these results and it was revealed that the problem was associated with three specific dimensions of the instrument.

Cite this paper

@article{Johnson1991MeasuringTR, title={Measuring the reliability of a computer-aided systematic observation instrument.}, author={Rubin Johnson and Ian Michael Franks}, journal={Canadian journal of sport sciences = Journal canadien des sciences du sport}, year={1991}, volume={16 1}, pages={45-57} }