Deep mutual GANs: representation learning from multiple experts

Mina Rezaei; Janne J. Näppi; Bernd Bischl; Hiroyuki Yoshida

doi:10.1117/12.2612968

4 April 2022 Deep mutual GANs: representation learning from multiple experts

Mina Rezaei, Janne J. Näppi, Bernd Bischl, Hiroyuki Yoshida

Proceedings Volume 12037, Medical Imaging 2022: Imaging Informatics for Healthcare, Research, and Applications; 120370U (2022) https://doi.org/10.1117/12.2612968
Event: SPIE Medical Imaging, 2022, San Diego, California, United States

Conference Poster

Abstract

Representation learning is one of the canonical objectives of most deep learning models. However, the learning of real-world clinical data is often compromised by their inherently imbalanced or long-tailed distribution wherein a few classes have significantly larger numbers of training instances than do the other classes. In this study, we investigated the representation learning of such long-tailed data distributions by the use of a deep mutual ensemble generative adversarial network. Our proposed framework consists of multiple powerful pre-trained discriminator networks that transfer knowledge to multiple individual untrained generator networks. During the training process, each generator learns to collaborate with the other generators. Additionally, each generator receives feedback from the individual discriminators in an adversarial manner. Especially, we explored the use of mutual information shared between the independent generators that makes our framework robust against misclassification of long-tailed data distributions in medical image analysis. We evaluated our proposed framework on four public datasets that represented different medical imaging modalities and imbalance ratios. Our experimental results show that our proposed framework benefits from ensemble learning and shared mutual learning, and achieves compelling results on several medical imaging benchmarks. Thus, our approach offers potential advantages over traditional deep learning in real-world applications.

Conference Presentation

Citation Download Citation

Mina Rezaei, Janne J. Näppi, Bernd Bischl, and Hiroyuki Yoshida "Deep mutual GANs: representation learning from multiple experts", Proc. SPIE 12037, Medical Imaging 2022: Imaging Informatics for Healthcare, Research, and Applications, 120370U (4 April 2022); https://doi.org/10.1117/12.2612968

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available