Sign inGet started
Paper · arXiv

Latent Spectroscopy: Posterior Collapse as a Feature

We show that, in linear Gaussian VAEs, posterior collapse is a form of latent feature selection. Feature importance is set by each latent coordinate's contribution to reconstruction, itself given by the corresponding PCA eigenvalue. Varying the regularizer strength $β$ reveals a ranked spectrum of collapse events, with thresholds set by the utility/PCA spectrum. A mode-by-mode analysis identifies the scale-invariant signal fraction as an order parameter obeying Landau scaling near collapse. WorldClim experiments confirm both the utility-threshold calibration and the predicted near-collapse scaling.

AuthorsJohannes Hirn
Primary categorycs.LG
Published21 May 2026
Last updated at source10 August 2026
cs.LGcond-mat.stat-mech
Embed this entry
<iframe src="https://silytics.si/embed/item/caf3bb20-78c0-40cd-afe6-0d5759aa7b86" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.