Pulse-coupled networks

From Wikipedia, the free encyclopedia

Pulse-coupled networks or pulse-coupled neural networks (PCNNs) are neural models proposed by modeling a cat’s visual cortex and developed for high-performance biomimetic image processing.

In 1989, Eckhorn introduced a neural model to emulate the mechanism of cat’s visual cortex. The Eckhorn model provided a simple and effective tool for studying small mammal’s visual cortex, and was soon recognized as having significant application potential in image processing. In 1994, the Eckhorn model was adapted to be an image processing algorithm by Johnson, who termed this algorithm Pulse-Coupled Neural Network. Over the past decade, PCNNs have been utilized for a variety of image processing applications, including: image segmentation, feature generation, face extraction, motion detection, region growing, noise reduction, and so on.

The basic property of the Eckhorn's linking-field model (LFM) is the coupling term. LFM is a modulation of the primary input by a biased offset factor driven by the linking input. These drive a threshold variable that decays from an initial high value. When the threshold drops below zero it is reset to a high value and the process starts over. This is different than the standard integrate-and-fire neural model which accumulates the input until it passes an upper limit and effectively "shorts out" to cause the pulse.

This difference causes LFM to be able to sustain pulse bursts, something the standard model does not do on a single neuron level. It is valuable to understand, however, that a detailed analysis of the standard model must include a shunting term due to the floating voltages level in the dendritic compartment(s), and in turn this causes an elegant multiple modulation effect that enables a true higher-order network (HON).[1] Multidimensional pulse image processing of chemical structure data using PCNN has been discussed by Kinser, et al.[2]

A PCNN is a two-dimensional neural network. Each neuron in the network corresponds to one pixel in an input image, receiving its corresponding pixel’s color information (e.g. intensity) as an external stimulus. Each neuron also connects with its neighboring neurons, receiving local stimuli from them. The external and local stimuli are combined in an internal activation system, which accumulates the stimuli until it exceeds a dynamic threshold, resulting in a pulse output. Through iterative computation, PCNN neurons produce temporal series of pulse outputs. The temporal series of pulse outputs contain information of input images and can be utilized for various image processing applications, such as image segmentation and feature generation. Compared with conventional image processing means, PCNNs have several significant merits, including robustness against noise, independence of geometric variations in input patterns, capability of bridging minor intensity variations in input patterns, etc.

A simplified PCNN called a spiking cortical model was developed in 2009.[3]

PCNNs are useful for image processing, as discussed in a book by Thomas Lindblad and Jason M. Kinser.[4]

References

  1. See Johnson and Padgett IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 10, NO. 3, MAY 1999, page 480-498 for the shunting terms, and C. Lee Giles' old work from the late 80's on HONs)
  2. Jason M. Kinser a, Karina Waldemark b, Thomas Lindblad b, Sven P. Jacobsson in Chemometrics and Intelligent Laboratory Systems 51�2000.115–124
  3. K. Zhan, H.J. Zhang, Y.D. Ma. New spiking cortical model for invariant texture retrieval and image processing. IEEE Trans. on neural networks, 2009, 20(12): 1980-1986.
  4. Image Processing Using Pulse-Coupled Neural Networks, Second, Revised Version, Springer Verlag ISBN 3-540-24218-X
This article is issued from Wikipedia. The text is available under the Creative Commons Attribution/Share Alike; additional terms may apply for the media files.