Report Open Access

Applications of generative adversarial networks to dermatologic imaging

Furger, Fabian; Amruthalingam, Ludovic; Navarini, Alexander A.; Pouly, Marc

Even though standard dermatological images are relatively easy to take, the availability and public release of such dataset for machine learning is notoriously limited due to medical data legal constraints, availability of field experts for annotation, numerous and sometimes rare diseases, large variance of skin pigmentation or the presence of identifying factors such as fingerprints or tattoos. With these generic issues in mind, we explore the application of Generative Adversarial Networks (GANs) to three different types of images showing full hands, skin lesions, and varying degrees of eczema. A first model generates realistic images of all three types with a focus on the technical application of data augmentation. A perceptual study conducted with laypeople con- firms that generated skin images cannot be distinguished from real data. Next, we propose models to add eczema lesions to healthy skin, respectively to remove eczema from patient skin using seg- mentation masks in a supervised learning setting. Such models allow to leverage existing unrelated skin pictures and enable non-technical applications, e.g. in aesthetic dermatology. Finally, we combine both models for eczema addition and removal in an entirely unsupervised process based on CycleGAN. Although eczema can no longer be placed in particular areas, we achieve convincing results for eczema removal without relying on ground truth annotations anymore.

Files (6.7 MB)
Name Size
Technical Report 5.pdf
md5:ee5476ce13d32a360f47622cbc31a295
6.7 MB Download
411
67
views
downloads
All versions This version
Views 411411
Downloads 6767
Data volume 451.2 MB451.2 MB
Unique views 392392
Unique downloads 6464

Share

Cite as