Boosting backpropagation algorithm by stimulus-sampling: Application in computer-aided medical diagnosis.

Neural networks (NNs), in general, and multi-layer perceptron (MLP), in particular, represent one of the most efficient classifiers among the machine learning (ML) algorithms. Inspired by the stimulus-sampling paradigm, it is plausible to assume that the association of stimuli with the neurons in th...

Descripción completa

Detalles Bibliográficos
Publicado en:Journal of Biomedical Informatics Vol. 63; pp. 74 - 82
Autores principales: Gorunescu, Florin, Belciug, Smaranda
Formato: research Journal Article
Publicado: Academic Press Inc. Oct2016
Acceso en línea:Ver este registro en EBSCOhost
Descripción
Sumario:Neural networks (NNs), in general, and multi-layer perceptron (MLP), in particular, represent one of the most efficient classifiers among the machine learning (ML) algorithms. Inspired by the stimulus-sampling paradigm, it is plausible to assume that the association of stimuli with the neurons in the output layer of a MLP can increase its performance. The stimulus-sampling process is assumed memoryless (Markovian), in the sense that the choice of a particular stimulus at a certain step, conditioned by the whole prior evolution of the learning process, depends only on the network's answer at the previous step. This paper proposes a novel learning technique, by enhancing the standard backpropagation algorithm performance with the aid of a stimulus-sampling procedure applied to the output neurons. The network uses the observable behavior that varies throughout the training process by stimulating the correct answers through corresponding rewards/penalties assigned to the output neurons. The proposed model has been applied in computer-aided medical diagnosis using five real-life breast cancer, colon cancer, diabetes, thyroid, and fetal heartbeat databases. The statistical comparison to well-established ML algorithms proved beyond doubt its efficiency and robustness.