Latent Spectroscopy: Posterior Collapse as a Feature
We show that, in linear Gaussian VAEs, posterior collapse is a form of latent feature selection. Feature importance is set by each latent coordinate's contribution to reconstruction, itself given by the corresponding PCA eigenvalue. Varying the regularizer strength $β$ reveals a ranked spectrum of collapse events, with thresholds set by the utility/PCA spectrum. A mode-by-mode analysis identifies the scale-invariant signal fraction as an order parameter obeying Landau scaling near collapse. WorldClim experiments confirm both the utility-threshold calibration and the predicted near-collapse scaling.
| Authors | Johannes Hirn |
|---|---|
| Primary category | cs.LG |
| Published | 21 May 2026 |
| Last updated at source | 10 August 2026 |
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.