iDMI: A novel technique for missing value imputation using a decision tree and expectation-maximization algorithm

Research output: Book chapter/Published conference paperConference paper

6 Citations (Scopus)

Abstract

In this paper we present a novel technique called iDMI that imputes missing values of a data set by combining a decision tree algorithm (DT) and an expectation-maximization(EMI) algorithm. We first divide a data set into horizontal segmentsthrough applying a DT algorithm such as C4.5, and thenapply an EMI algorithm on each segment in order to impute themissing values belong to the segment. If all numerical attribute values of a record are missing then we impute them by the meanvalues of the attributes of the records belong to a segment wherethe record falls in, and thereby reduce the computational time complexity of iDMI compare to an existing technique calledDMI which calculate the mean value of an attribute by using all records of a data set. We evaluate the performance of iDMIover three high quality existing techniques on two real data sets in terms of four evaluation criteria. Our initial experimental results, including several statistical significance analysis, indicatethe superiority of iDMI over the existing techniques.
Original languageEnglish
Title of host publicationProceedings of the 16th International Conference on Computer and Information Technology
Subtitle of host publicationICCIT 2013
EditorsRameswar Debnath
Place of PublicationUnited States
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages496-501
Number of pages6
ISBN (Electronic)9781479934980
DOIs
Publication statusPublished - 2014
Event16th International Conference on Computer and Information Technology: ICCIT 2013 - Khulna University, Khulna, Bangladesh
Duration: 08 Mar 201410 Mar 2014
https://web.archive.org/web/20130409043745/http://www.iccit.org.bd/2013/

Conference

Conference16th International Conference on Computer and Information Technology
CountryBangladesh
CityKhulna
Period08/03/1410/03/14
Internet address

Fingerprint Dive into the research topics of 'iDMI: A novel technique for missing value imputation using a decision tree and expectation-maximization algorithm'. Together they form a unique fingerprint.

  • Cite this

    Rahman, M. G., & Islam, M. Z. (2014). iDMI: A novel technique for missing value imputation using a decision tree and expectation-maximization algorithm. In R. Debnath (Ed.), Proceedings of the 16th International Conference on Computer and Information Technology: ICCIT 2013 (pp. 496-501). IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/ICCITechn.2014.6997351