Discriminative Ridge Machine: A Classifier for High-Dimensional Data or Imbalanced Data

Chong Peng, Qiang Cheng

Research output: Contribution to journalArticlepeer-review

16 Scopus citations


In this article, we introduce a discriminative ridge regression approach to supervised classification. It estimates a representation model while accounting for discriminativeness between classes, thereby enabling accurate derivation of categorical information. This new type of regression model extends the existing models, such as ridge, lasso, and group lasso, by explicitly incorporating discriminative information. As a special case, we focus on a quadratic model that admits a closed-form analytical solution. The corresponding classifier is called the discriminative ridge machine (DRM). Three iterative algorithms are further established for the DRM to enhance the efficiency and scalability for real applications. Our approach and the algorithms are applicable to general types of data including images, high-dimensional data, and imbalanced data. We compare the DRM with current state-of-the-art classifiers. Our extensive experimental results show the superior performance of the DRM and confirm the effectiveness of the proposed approach.

Original languageEnglish
Article number9145840
Pages (from-to)2595-2609
Number of pages15
JournalIEEE Transactions on Neural Networks and Learning Systems
Issue number6
StatePublished - Jun 2021

Bibliographical note

Funding Information:
Manuscript received May 4, 2019; revised December 20, 2019 and April 16, 2020; accepted June 21, 2020. Date of publication July 21, 2020; date of current version June 2, 2021. The work of Chong Peng was supported in part by the National Natural Science Foundation of China (NSFC) under Grant 61806106 and in part by the Shandong Provincial Natural Science Foundation, China, under Grant ZR2019QF009. The work of Qiang Cheng was supported in part by NIH under Grant UH3 NS100606-03 and Grant R01HD101508-01 and in part by a grant from the University of Kentucky. (Corresponding author: Qiang Cheng.) Chong Peng is with the College of Computer Science and Technology, Qingdao University, Qingdao 266071, China (e-mail: pchong1991@163.com).

Publisher Copyright:
© 2012 IEEE.


  • Discriminative
  • high-dimensional data
  • imbalanced data
  • label information
  • ridge regression

ASJC Scopus subject areas

  • Software
  • Computer Science Applications
  • Computer Networks and Communications
  • Artificial Intelligence


Dive into the research topics of 'Discriminative Ridge Machine: A Classifier for High-Dimensional Data or Imbalanced Data'. Together they form a unique fingerprint.

Cite this