It is well known that the careful selection of a set of features, with higher discrimination competence, may increase recognition performance. In general, the magnitude coefficients of some selected orders of ZMs and PZMs have been used as invariant image features. The authors have used a statistical method to estimate the discrimination strength of all the coefficients of ZMs and PZMs. For classification, only the coefficients with estimated higher discrimination strength are selected and are used in the feature vector. The performance of these selected Discriminative ZMs (DZMs) and Discriminative PZMs (DPZMs) features are compared to that of their corresponding conventional approaches on YALE, ORL, and FERET databases against illumination, expression, scale, and pose variations. In this chapter, an extension to these DZMs and DPZMs is presented by exploring the use of phase information along with the magnitude coefficients of these approaches. As the phase coefficients are computed in parallel to the magnitude, no additional time is spent on their computation. Further, DZMs and DPZMs are also combined with PCA and FLD. It is observed from the exhaustive experimentation that with the inclusion of phase features the recognition rate is improved by 2-8%, at reduced dimensions and with less computational complexity, than that of using the successive ZMs and PZMs features.