Particle swarm optimisation assisted classification using elastic net prefiltering

Xia Hong, Junbin Gao, Sheng Cheng, Chris Harris

Research output: Contribution to journalArticlepeer-review

4 Citations (Scopus)

Abstract

A novel two-stage construction algorithm for linear-in-the-parameters classifier is proposed, aiming at noisy two-class classification problems. The purpose of the first stage is to produce a prefiltered signal that is used as the desired output for the second stage to construct a sparse linear-in-the-parameters classifier. For the first stage learning of generating the prefiltered signal, a two-level algorithm is introduced to maximise the model's generalisation capability, in which an elastic net model identification algorithm using singular value decomposition is employed at the lower level while the two regularisation parameters are selected by maximising the Bayesian evidence using a particle swarm optimization algorithm. Analysis is provided to demonstrate how 'Occam's razor' is embodied in this approach. The second stage of sparse classifier construction is based on an orthogonal forward regression with the D-optimality algorithm. Extensive experimental results demonstrate that the proposed approach is effective and yields competitive results for noisy data sets.
Original languageEnglish
Pages (from-to)210-220
Number of pages11
JournalNeurocomputing
Volume122
DOIs
Publication statusPublished - Dec 2013

Fingerprint Dive into the research topics of 'Particle swarm optimisation assisted classification using elastic net prefiltering'. Together they form a unique fingerprint.

Cite this