Reparameterization invariance in representation learning - 06/12/2023

It was truly an honour to host Prof. Dr. Søren Hauberg, a distinguished faculty member from the Technical University of Denmark. He graciously delivered an engaging video presentation on the captivating topic:

Generative models learn a compressed representation of data that is often used for downstream tasks such as interpretation, visualization and prediction via transfer learning. Unfortunately, the learned representations are generally not statistically identifiable, leading to a high risk of arbitrariness in the downstream tasks. We propose to use differential geometry to construct representations that are invariant to reparametrizations. We demonstrate that the approach is deeply tied to the uncertainty of the representation, and that practical applications require high-quality uncertainty quantification. With the reparametrization problem solved, we show how to construct better priors for generative models, and that the identifiable representations reveals signals in the data that were otherwise hidden.

More on https://www2.compute.dtu.dk/~sohau/talks/2023_Antwerp/#frame5844