Interpretability in latent variable modeling is defined by a fundamental trade-off between structural sparseness and explained vari-ance. However, in practice, parsimony of the loading structure is fre-quently sacrificed to maximize fit, due to a lack of formal evaluation metrics. To address this, we propose a synthetic measure that explicitly integrates explanatory power and structural simplicity. By extending an established metric of sparseness basedon the L_1/L_2 norm ratio into a flexible L_p1/L_p2 formulation, we define interpretability as the geomet-ric mean of explained variance and component-wise sparseness. Through simulations and an application to economic growth data, we show how the metric facilitates model selection within two f rameworks: standard dimensionality reduction (PCA vs. Disjoint PCA) and simultaneous unit-clustering (Reduced K-Means vs. Clustering Disjoint PCA).
A generalized Lp1 /Lp2 approach to measure the interpretability of latent variable models / Bottazzi Schenone, M., Iannaccio, T., Mozzetta, I., Vichi, M.. - (2026), pp. 52-59. (19th conference of the International Federation of Classification Societies Milano ) [10.1007/978-3-032-32009-4].
A generalized Lp1 /Lp2 approach to measure the interpretability of latent variable models
Mariaelena Bottazzi Schenone
;Tiziano Iannaccio;Ilaria Mozzetta;Maurizio Vichi
2026
Abstract
Interpretability in latent variable modeling is defined by a fundamental trade-off between structural sparseness and explained vari-ance. However, in practice, parsimony of the loading structure is fre-quently sacrificed to maximize fit, due to a lack of formal evaluation metrics. To address this, we propose a synthetic measure that explicitly integrates explanatory power and structural simplicity. By extending an established metric of sparseness basedon the L_1/L_2 norm ratio into a flexible L_p1/L_p2 formulation, we define interpretability as the geomet-ric mean of explained variance and component-wise sparseness. Through simulations and an application to economic growth data, we show how the metric facilitates model selection within two f rameworks: standard dimensionality reduction (PCA vs. Disjoint PCA) and simultaneous unit-clustering (Reduced K-Means vs. Clustering Disjoint PCA).I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.


