Planned intervention: On Wednesday April 3rd 05:30 UTC Zenodo will be unavailable for up to 2-10 minutes to perform a storage cluster upgrade.
Published August 23, 2022 | Version v1
Journal article Embargoed

Multi-Attribute Balanced Sampling for Disentangled GAN Controls

  • 1. CEDRIC, CNAM
  • 2. Universit ́e Paris-Saclay, CEA, List

Description

Various controls over the generated data can be extracted from the latent space of a pre-trained GAN, as it implicitly encodes the semantics of the training data. The discovered controls allow to vary semantic attributes in the generated images but usually lead to entangled edits that affect multiple attributes at the same time.
Supervised approaches typically sample and annotate a collection of latent codes, then train classifiers in the latent space to identify the controls. Since the data generated by GANs reflects the biases of the original dataset, so do the resulting semantic controls. We propose to address disentanglement by balancing the semantics of the dataset before training the classifiers.
We demonstrate the effectiveness of this approach by extracting disentangled linear
directions for face manipulation on state-of-the-art GAN architectures (including StyleGAN2 and StyleGAN3) and two datasets, CelebAHQ and FFHQ.
We show that this simple and general approach outperforms state-of-the-art classifier-based methods while avoiding the need for disentanglement-enforcing post-processing.

Files

Embargoed

The files will be made publicly available on August 23, 2024.

Additional details

Funding

AI4Media – A European Excellence Centre for Media, Society and Democracy 951911
European Commission