In this paper, we propose a novel method to classify Breast Lesions based on minute changes in the cell and nuclear features of the cell. It is important to note these changes as they play a significant role in diagnosis and the line of treatment by an oncologist. To overcome the problem of inter-observer variability the method of scoring is used to grade the lesions considered for the study. We have used the Modified Masood Score and designed an algorithm which classifies a given breast lesion into 6 classes namely Benign, Intermediate class-1,Intermediate class-2, Malignant class-1,Malignant class-2 and Malignant class-3. We have developed a sensitive model using the feed-forward neural network and Pattern Network to achieve the above objective. The Rank of the features is observed using ReliefF Algorithm.