FIMUS: A framework for imputing missing values using co-appearance, correlation and similarity analysis

Research output: Contribution to journalArticle

41 Citations (Scopus)
33 Downloads (Pure)

Abstract

Natural data sets often have missing values in them. An accurate missing value imputation is crucial to increase the usability of a data set for statistical analyses and data mining tasks. In this paper we present a novel missing value imputation technique using a data set's existing patterns including co-appearances of attribute values, correlations among the attributes and similarity of values belonging to an attribute. Our technique can impute both numerical and categorical missing values. We carry out extensive experiments on nine natural data sets, and compare our technique with four high quality existing techniques. We simulate 32 types of missing patterns (combinations), and thereby generate 320 missing data sets for each of the nine natural data sets. Two well known evaluation criteria namely index of agreement (d2) and root mean squared error are used. Our experimental results, based on the statistical sign test, indicate that our technique achieves significantly better imputation accuracy than the existing techniques.
Original languageEnglish
Pages (from-to)311-327
Number of pages17
JournalKnowledge-Based Systems
Volume56
Early online date2013
DOIs
Publication statusPublished - Jan 2014

Fingerprint Dive into the research topics of 'FIMUS: A framework for imputing missing values using co-appearance, correlation and similarity analysis'. Together they form a unique fingerprint.

  • Cite this