In this paper, we proposed a new video quality metric model, which describe the video quality feature using quaternion matrix. The four parts of the quaternion are brightness, chrominance, contour, and inter frame residual, respectively. The feature value of each block is computed from quaternion model by singular value decomposition. In addition we extract gray-level co-occurrence matrix (GLCM) of each block, then calculate differential entropy of GLCM as the weight of the block. The algorithm is tested on the video quality expert group (VQEG) Phase I FR-TV test data set. Experiments show that it has good correlation with perceived video quality.