SSD-KD: A Self-supervised Diverse Knowledge Distillation Method for Lightweight Skin Lesion Classification Using Dermoscopic Images

@article{Wang2022SSDKDAS,
  title={SSD-KD: A Self-supervised Diverse Knowledge Distillation Method for Lightweight Skin Lesion Classification Using Dermoscopic Images},
  author={Yongwei Wang and Yuheng Wang and Tim K. Lee and Chunyan Miao and Z. Jane Wang},
  journal={Medical image analysis},
  year={2022},
  volume={84},
  pages={
          102693
        }
}
Skin cancer is one of the most common types of malignancy, affecting a large population and causing a heavy economic burden worldwide. Over the last few years, computer-aided diagnosis has been rapidly developed and make great progress in healthcare and medical practices due to the advances in artificial intelligence, particularly with the adoption of convolutional neural networks. However, most studies in skin cancer detection keep pursuing high prediction accuracies without considering the… 

Figures and Tables from this paper

Reversing Skin Cancer Adversarial Examples by Multiscale Diffusive and Denoising Aggregation Mechanism

Experimental results demonstrate that the proposed method can successfully reverse adversarial perturbations from di ff erent attacks and significantly outperform some state-of-the-art methods in defending skin cancer diagnosis models.

Fight Fire With Fire: Reversing Skin Adversarial Examples by Multiscale Diffusive and Denoising Aggregation Mechanism

Experimental results demonstrate that the proposed method can successfully reverse adversarial perturbations from di ff erent attacks and significantly outperform some state-of-the-art methods in defending skin cancer diagnosis models.

A survey, review, and future trends of skin lesion segmentation and classification

Lightweight Deep Network for the Classification of Breast Cancer Histopathological Images

A lightweight network, based on knowledge distillation, which performs almost the same as the teacher network but with significantly fewer parameters is proposed, which is based on inverted residual blocks of MobileNetV2 and the ghost module.

Occlusion-Robust FAU Recognition by Mining Latent Space of Masked Autoencoders

The first occlusion-robust FAU recognition method to maintain FAU detection performance under heavy occlusions is proposed and can achieve comparable performance as state-of-the-art methods under normal conditions.

References

SHOWING 1-10 OF 62 REFERENCES

Incorporating clinical knowledge with constrained classifier chain into a multimodal deep network for melanoma detection

An Attention-Based Mechanism to Combine Images and Metadata in Deep Learning Models Applied to Skin Cancer Classification

This work proposes the Metadata Processing Block (MetaBlock), a novel algorithm that uses metadata to support data classification by enhancing the most relevant features extracted from the images throughout the classification pipeline.

Dermatologist-level classification of skin cancer with deep neural networks

This work demonstrates an artificial intelligence capable of classifying skin cancer with a level of competence comparable to dermatologists, trained end-to-end from images directly, using only pixels and disease labels as inputs.

Robust Skin Disease Classification by Distilling Deep Neural Network Ensemble for the Mobile Diagnosis of Herpes Zoster

A robust and mobile deep neural network that can distinguish HZ from other skin diseases using user-submitted images is trained and a knowledge distillation from ensemble via curriculum training (KDE-CT) wherein a student network learns from a stronger teacher network progressively is proposed.
...