Face recognition indeed plays a major rule in the biometrics security environment. Facial marks as for example freckles, moles, scars etc that are soft biometric traits have played a crucial role in identifying the human face. To provide secure authentication, we require robust methodology for recognizing and authentication of the human face. However, there are numbers of difficulties in recognizing the human face and authentication of the person perfectly. The difficulty includes low quality of images due to sparse dark or light disturbances. To overcome such kind of problems, powerful algorithms are required to filter the images and detect the face and facial marks. This technique comprise extensively of detecting the different facial marks from that of low quality images which have salt and pepper noise in them. Initially we applied (AMF) Adaptive Median Filter to filter the images. The filtered images are then extracted to detect the primary facial feature using a powerful algorithm like Active Shape Model (ASM) into Active Appearance Model (AAM). Finally, the features are extracted using feature extractor algorithm Gradient Location Orientation Histogram (GLOH).