Skip to content

Model Selection and Parameter Estimation of Multi-dimensional Gaussian Mixture Model

Apr 2024 · arXiv.org · Vol abs/2603.19657 · 0 citations · 49 references
Computer Science Mathematics Engineering

TL;DR

A fundamental lower bound on the number of samples required to correctly identify the number of components with high probability is proved, showing that this limit depends critically on the separation between component means and the total number of components.

Abstract

In this paper, we study the problem of learning one-dimensional Gaussian mixture models (GMMs) with a specific focus on estimating both the model order and the mixing distribution from independent and identically distributed (i.i.d.) samples. This paper establishes the optimal sampling complexity for model order estimation in one-dimensional Gaussian mixture models. We prove a fundamental lower bound on the number of samples required to correctly identify the number of components with high probability, showing that this limit depends critically on the separation between component means and the total number of components. We then propose a Fourier-based approach to estimate both the model order and the mixing distribution. Our algorithm utilizes Fourier measurements constructed from the samples, and our analysis demonstrates that its sample complexity matches the established lower bound, thereby confirming its optimality. Numerical experiments further show that our method outperforms conventional techniques in terms of efficiency and accuracy.

View source

Similar papers

Preprint Sep 2026

Riemannian Gradient Descent for Gaussian Mixture Models with unknown diagonal covariances

This paper investigates the numerical resolution of the Beurling-LASSO (BLASSO), a convex optimization framework that promotes sparsity in the space of measures. We consider its application to the estimation of Gaussian mixture models (GMMs) with an unknown number of components and unknown diagonal covariance matrices....

Romane Giard, Y. de Castro, R. Denis et al. · 0 citations
Open access Sep 2026

Parameter Estimation in Multidimensional Diffusion Models with Low Regularity Coefficients

This paper studies parameter estimation for discretely observed multidimensional diffusion models with low-regularity coefficients. Since the transition density of such models is typically unavailable in closed form, likelihood-based inference becomes difficult, especially in multidimensional settings. To address this...

D. Ivanenko, R. Pogorielov · 0 citations
Preprint Aug 2026

Asymptotics for Model Selection in Probabilistic Principal Component Analysis

The probabilistic formulation of principal component analysis promises statistically grounded solutions to the problem of selecting the number of principal components. However, developing tractable model selection methods is complicated by the fact that the probabilistic principal component analysis (PPCA) model exhibi...

Mathias Drton, Andrew McCormack, Daniel Windisch · 0 citations
Preprint Sep 2026

Gaussian Comparison Theorems for High-Dimensional Posterior Inference

We develop a Gaussian comparison theory for posterior inference in non-Gaussian high-dimensional models. The framework allows for model misspecification and does not require the posterior distribution itself to be approximately Gaussian. Working directly with likelihood processes on separable function spaces, we establ...

Wen-Xuan Zou, Galen Reeves · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.