Information criteria for model selection

Jiawei Zhang, Yuhong Yang, Jie Ding

Research output: Contribution to journalReview articlepeer-review

4 Scopus citations

Abstract

The rapid development of modeling techniques has brought many opportunities for data-driven discovery and prediction. However, this also leads to the challenge of selecting the most appropriate model for any particular data task. Information criteria, such as the Akaike information criterion (AIC) and Bayesian information criterion (BIC), have been developed as a general class of model selection methods with profound connections with foundational thoughts in statistics and information theory. Many perspectives and theoretical justifications have been developed to understand when and how to use information criteria, which often depend on particular data circumstances. This review article will revisit information criteria by summarizing their key concepts, evaluation metrics, fundamental properties, interconnections, recent advancements, and common misconceptions to enrich the understanding of model selection in general. This article is categorized under: Data: Types and Structure > Traditional Statistical Data Statistical Learning and Exploratory Methods of the Data Sciences > Modeling Methods Statistical and Graphical Methods of Data Analysis > Information Theoretic Methods Statistical Models > Model Selection.

Original languageEnglish
Article numbere1607
JournalWiley Interdisciplinary Reviews: Computational Statistics
Volume15
Issue number5
DOIs
StatePublished - Sep 1 2023

Bibliographical note

Publisher Copyright:
© 2023 The Authors. WIREs Computational Statistics published by Wiley Periodicals LLC.

Keywords

  • Akaike information criterion
  • Bayesian information criterion
  • information criteria
  • model selection
  • variable selection

ASJC Scopus subject areas

  • Statistics and Probability

Fingerprint

Dive into the research topics of 'Information criteria for model selection'. Together they form a unique fingerprint.

Cite this