In this study, the authors design a cognitive tool to detect malicious images using a smart phone. This tool can learn shot images taken with the camera of a smart phone and automatically classify the new image as a malicious image in the smart phone. To develop the learning and classifier tool, the authors implement an image analysis function and a learning and classifier function using a support vector machine (SVM) with the smart phone. With this tool, the user can collect image data with the camera of a smart phone, create learning data, and classify the new image data according to the learning data in the smart phone. In this study, the authors apply this tool to a user interface of a cosmetics recommendation service system and demonstrate its effectiveness by in reducing the load of the diagnosis server in this service and improving the user service.