EbookQA
ProcessAdvanced

How does the WGAN-GP ensure that the critic is trained to convergence before updating the generator?

The WGAN-GP ensures the critic is trained to convergence by updating the critic multiple times before each generator update, typically using a ratio of three to five critic updates per generator update. This approach ensures that the gradients used for updating the generator are accurate.

In WGAN-GP, the critic is trained to convergence before updating the generator to ensure accurate gradients for the generator's updates. This is achieved by performing multiple critic updates for each generator update, typically using a ratio of three to five critic updates per generator update. This approach contrasts with standard GANs, where it is important not to let the discriminator become too strong. The WGAN-GP's use of the Wasserstein loss allows for this training strategy, as it stabilizes the training process and ensures the critic provides meaningful feedback to the generator.

Key points

  • WGAN-GP trains the critic to convergence before updating the generator.
  • Multiple critic updates (3-5) are done per generator update.
  • This ensures accurate gradients for generator updates.
  • The Wasserstein loss stabilizes the training process.
  • This approach contrasts with standard GANs, where the discriminator should not become too strong.
Source:Generative Deep Learning: Teaching Machines to Paint, Write, Compose, and Play· Generative Adversarial Networks· p. 143–150

Related questions

Cover of Generative Deep Learning: Teaching Machines to Paint, Write, Compose, and Play

Generative Deep Learning: Teaching Machines to Paint, Write, Compose, and Play

David Foster;

Second Edition · O’Reilly Media, Inc.

View this ebook