Determining the number of components in mixtures of linear models

Dollena S. Hawkins, David M. Allen, Arnold J. Stromberg

Research output: Contribution to journalArticlepeer-review

39 Scopus citations

Abstract

Methods for determining the number of components in normal mixtures are extended to mixtures of linear regression models. This simulation study evaluates the influence of component separation and mixing proportions on the performance of 22 approximations of measures for determining the number of components in mixtures of linear regression models. Estimated measures based on the maximized log likelihood of the observed data are compared to estimated measures based on the maximized log likelihood of the complete data. Approximations of measures which previously required the convergence rate of the EM algorithm are presented which have no such restriction for their implementation. As an alternative to the EM algorithm, which is known to be sensitive to starting values, differential evolution was the implemented optimization algorithm. This study is further set apart in that the performances of the approximated component measures are explored without assuming the mixing proportions to be equal or assuming equal component variances. Based on the results of the k = 1 and 2 component model simulations, the minimum description length, MDL, is the recommended criterion for choosing between one and two component mixtures of linear regression models.

Original languageEnglish
Pages (from-to)15-48
Number of pages34
JournalComputational Statistics and Data Analysis
Volume38
Issue number1
DOIs
StatePublished - Nov 28 2001

Keywords

  • Differential evolution
  • Linear models
  • Mixture models
  • Number of components

ASJC Scopus subject areas

  • Statistics and Probability
  • Computational Mathematics
  • Computational Theory and Mathematics
  • Applied Mathematics

Fingerprint

Dive into the research topics of 'Determining the number of components in mixtures of linear models'. Together they form a unique fingerprint.

Cite this