This paper deals with a facial recognition system and its verification using the RGB-D data obtained from the Kinect and FRAV3D database. The FRAV3D database contains 106 subjects, which involves approximately one woman after every three men. The Kinect database has17 images per 31 persons. The proposed algorithm computes a descriptor based on the entropy of RGB-D faces along with the saliency feature obtained from a 2D face which is used as input to a tree bagger classifier to establish the identity. © 2014 The Authors. Published by Elsevier B.V. Peer-review under responsibility of organizing committee of the International Conference on Information and Communication Technologies (ICICT 2014).