Skip to main navigation Skip to search Skip to main content

Classifying data streams with skewed class distributions and concept drifts

  • Jing Gao
  • , Bolin Ding
  • , Wei Fan
  • , Jiawei Han
  • , Philip S. Yu
  • University of Illinois at Urbana-Champaign
  • IBM

Research output: Contribution to journalArticlepeer-review

118 Scopus citations

Abstract

Classification is an important data analysis tool that uses a model built from historical data to predict class labels for new observations. More and more applications are featuring data streams, rather than finite stored data sets, which are a challenge for traditional classification algorithms. Concept drifts and skewed distributions, two common properties of data stream applications, make the task of learning in streams difficult. The authors aim to develop a new approach to classify skewed data streams that uses an ensemble of models to match the distribution over under-samples of negatives and repeated samples of positives.

Original languageEnglish
Pages (from-to)37-49
Number of pages13
JournalIEEE Internet Computing
Volume12
Issue number6
DOIs
StatePublished - 2008

Keywords

  • Classification algorithms
  • Companies
  • Concept drifts
  • Data mining
  • Data models
  • Data stream
  • Model averaging
  • Predictive models
  • Presses
  • Skewed distributions
  • Training
  • Training data

Fingerprint

Dive into the research topics of 'Classifying data streams with skewed class distributions and concept drifts'. Together they form a unique fingerprint.

Cite this