Computer aided diagnosis of medical images can help physicians in better detecting and early diagnosis of many symptoms and therefore reducing the mortality rate. Realization of an efficient mobile device for semi-automatic diagnosis of melanoma would greatly enhance the applicability of medical image classification scheme and make it useful in clinical contexts. In this paper, interactive object recognition methodology is adopted for border segmentation of clinical skin lesion images. In addition, performance of five classifiers, KNN, Naïve Bayes, multi-layer perceptron, random forest and SVM are compared based on color and texture features for discriminating melanoma from benign nevus. The results show that a sensitivity of 82.6% and specificity of 83% can be achieved using a single SVM classifier. However, a better classification performance was achieved using a proposed cascade classifier with the sensitivity of 83.06% and specificity of 90.05% when performing ten-fold cross validation.