Efficacy of modified backpropagation and optimisation methods on a real-world medical problem

Dogan Alpsan, Michael Towsey, Ozcan Ozdamar, Ah Chung Tsoi, Dhanjoo N. Ghista

Research output: Contribution to journalArticle

32 Scopus citations

Abstract

A wide range of modifications to the backpropagation (BP) algorithm, motivated by heuristic arguments and optimisation theory, has been examined on a real-world medical signal classification problem. The method of choice depends both upon the nature of the learning task and whether one wants to optimise learning for speed or generalisation. It was found that, comparatively, standard BP was sufficiently fast and provided good generalisation when the task was to learn the training set within a given error tolerance. However, if the task was to find the global minimum, then standard BP failed to do so within 100000 iterations, but first order methods which adapt the stepsize were as fast as, if not faster than, conjugate gradient and quasi-Newton methods. Second order methods required the same amount of fine tuning of line search and restart parameters as did the first order methods of their parameters in order to achieve optimum performance.

Original languageEnglish (US)
Pages (from-to)945-962
Number of pages18
JournalNeural Networks
Volume8
Issue number6
DOIs
StatePublished - 1995

Keywords

  • Auditory evoked potential
  • Backpropagation
  • Multilayer perception
  • Neural networks
  • Optimisation
  • Pattern classification

ASJC Scopus subject areas

  • Artificial Intelligence
  • Neuroscience(all)
  • Cognitive Neuroscience

Fingerprint Dive into the research topics of 'Efficacy of modified backpropagation and optimisation methods on a real-world medical problem'. Together they form a unique fingerprint.

  • Cite this