Whether an email is a spam or not? Whether the image containing the image of cat or not? Such type of questions in machine learning can be answered only by using process of classification. The uses of classification under the umbrella of supervised learning are inevitably important. So in the voyage of classification, a classifier need to be used which is responsible for apt classification or categorization of a data into its valid category. Further, the performance of the classifier chosen for the course of action will be analysed in order to get insights about its accuracy. Hence, in this attempt, Stochastic Gradient Descent binary classifier will be chosen for classification based prediction of an image carrying handwritten digits. Afterwards, the performance will be analysed by using cross validation, confusion matrix and ROC curve analysis.