Monotone generative modeling via a geometry-preserving mapping

17.04.2024 16:00 - 17:00

Wonjun Lee (University of Minnesota)

Abstract:

Generative Adversarial Networks (GANs) are powerful tools for creating new content, but they face challenges such as sensitivity to starting conditions and mode collapse. To address these issues, we propose a deep generative model that utilizes the Gromov-Monge embedding (GME). It helps identify the low-dimensional structure of the underlying measure of the data and then map it, while preserving its geometry, into a measure in a low-dimensional latent space, which is then optimally transported to the reference measure. We guarantee the preservation of the underlying geometry by the GME and c-cyclical monotonicity of the generative map, where c is an intrinsic embedding cost employed by the GME. The latter property is a first step in guaranteeing better robustness to initialization of parameters and mode collapse. Numerical experiments demonstrate the effectiveness of our approach in generating high-quality images, avoiding mode collapse, and exhibiting robustness to different starting conditions.

Zoom link and passcode can be found at the Mathematics of Machine Learning and Data Science seminar (https://math-ml.univie.ac.at/seminar/)

Organiser:
M. Naumann, S. Schmutzhard-Hoefler
Location:
Zoom