Inferring Skin Lesion Segmentation With Fully Connected CRFs Based on Multiple Deep Convolutional Neural Networks

Deep convolutional neural networks (DCNNs) trained for face identification can rival and even exceed human-level performance. The relationships between internal representations learned by DCNNs and those of the primate face processing system are not well understood, especially in naturalistic settings. We developed the largest naturalistic dynamic face stimulus set in human neuroimaging research (700+ naturalistic video clips of unfamiliar faces) and used representational similarity analysis to investigate how well the representations learned by high-performing DCNNs match human brain representations across the entire distributed face processing system. DCNN representational geometries were strikingly consistent across diverse architectures and captured meaningful variance among faces. Similarly, representational geometries throughout the human face network were highly consistent across subjects. Nonetheless, correlations between DCNN and neural representations were very weak overall—DCNNs captured 3% of variance in the neural representational geometries at best. Intermediate DCNN layers better matched visual and face-selective cortices than the final fully-connected layers. Behavioral ratings of face similarity were highly correlated with intermediate layers of DCNNs, but also failed to capture representational geometry in the human brain. Our results suggest that the correspondence between intermediate DCNN layers and neural representations of naturalistic human face processing is weak at best, and diverges even further in the later fully-connected layers. This poor correspondence can be attributed, at least in part, to the dynamic and cognitive information that plays an essential role in human face processing but is not modeled by DCNNs. These mismatches indicate that current DCNNs have limited validity as in silico models of dynamic, naturalistic face processing in humans.

Download Full-text

Lesion Segmentation and Automated Melanoma Detection using Deep Convolutional Neural Networks and XGBoost

2019 International Conference on System Science and Engineering (ICSSE) ◽

10.1109/icsse.2019.8823129 ◽

2019 ◽

Author(s):

Hung N. Pham ◽

Chin Yang Koay ◽

Tanmoy Chakraborty ◽

Sudhanshu Gupta ◽

Boon Leong Tan ◽

...

Keyword(s):

Neural Networks ◽

Convolutional Neural Networks ◽

Lesion Segmentation ◽

Deep Convolutional Neural Networks ◽

Melanoma Detection

Download Full-text

Bucket of Deep Transfer Learning Features and Classification Models for Melanoma Detection

Journal of Imaging ◽

10.3390/jimaging6120129 ◽

2020 ◽

Vol 6 (12) ◽

pp. 129

Author(s):

Mario Manzo ◽

Simone Pellino

Keyword(s):

Neural Networks ◽

Skin Lesion ◽

Transfer Learning ◽

Convolutional Neural Networks ◽

Image Features ◽

Ensemble Classification ◽

Deep Convolutional Neural Networks ◽

Melanoma Detection ◽

Statistical Measures ◽

Different Types

Malignant melanoma is the deadliest form of skin cancer and, in recent years, is rapidly growing in terms of the incidence worldwide rate. The most effective approach to targeted treatment is early diagnosis. Deep learning algorithms, specifically convolutional neural networks, represent a methodology for the image analysis and representation. They optimize the features design task, essential for an automatic approach on different types of images, including medical. In this paper, we adopted pretrained deep convolutional neural networks architectures for the image representation with purpose to predict skin lesion melanoma. Firstly, we applied a transfer learning approach to extract image features. Secondly, we adopted the transferred learning features inside an ensemble classification context. Specifically, the framework trains individual classifiers on balanced subspaces and combines the provided predictions through statistical measures. Experimental phase on datasets of skin lesion images is performed and results obtained show the effectiveness of the proposed approach with respect to state-of-the-art competitors.

Download Full-text