Archive for the ‘Neural network models’ Category

Neuroimaging with Rescorla-Wagner model

Sunday, August 28th, 2005

Neuroimaging data of different brain areas fit to a Rescorla-Wagner model show that different cortical areas integrate stimulus changes over different time intervals. The result itself probably isn’t that shocking but I liked the nice combination of theory and experiment.

From the July 21 Neuron:

Formal Learning Theory Dissociates Brain Regions with Different Temporal Integration

Jan Gläscher and Christian Büchel

Learning can be characterized as the extraction of reliable predictions about stimulus occurrences from past experience. In two experiments, we investigated the interval of temporal integration of previous learning trials in different brain regions using implicit and explicit Pavlovian fear conditioning with a dynamically changing reinforcement regime in an experimental setting. With formal learning theory (the Rescorla-Wagner model), temporal integration is characterized by the learning rate. Using fMRI and this theoretical framework, we are able to distinguish between learning-related brain regions that show long temporal integration (e.g., amygdala) and higher perceptual regions that integrate only over a short period of time (e.g., fusiform face area, parahippocampal place area). This approach allows for the investigation of learning-related changes in brain activation, as it can dissociate brain areas that differ with respect to their integration of past learning experiences by either computing long-term outcome predictions or instantaneous reinforcement expectancies.

How does this relate to Hawkins’s idea that all cortex implements the same underlying “algorithm”? Is the integration time constant (or, in RW terms, the learning rate) tuned differently by different inputs?

Differential equations for neuroscientists

Saturday, August 27th, 2005

I wrote up a little primer on differential equations for neuroscientists. It can be found here: http://science.ethomson.net/Diff_Eq.pdf. Any comments or suggestions appreciated, especially at this early stage!

Here is the first paragraph:

Ordinary first-order differential equations come up frequently in neuroscience. They are used to model many fundamental processes such as passive membrane dynamics and gating kinetics in individual ion channels. When the equations come up, most electrophysiology texts provide the solution, but do not provide any explanation. This manuscript tries to fill the gap, providing an introduction to many of the mathematical facets of the first-order differential equation. Section One provides a brief statement of the problem and its solution. Section Two works through the solution for a special case that often comes up in practice. I also work through a concrete example chosen for its near-ubiquity in neuroscience, the equivalent circuit model of a patch of neuronal membrane. Section Three contains a simple derivation of the general solution given in Section One. The manuscript presupposes a little knowledge of first-year calculus, much of which is reviewed when needed.

Best,
Eric (Thomson)

McCulloch-Pitts-Wiener neurons?

Monday, March 7th, 2005

Interesting article in the NYT about a new biography of Norbert Wiener, the father of the field of cybernetics. The surprising revelation is that Wiener (who received a PhD from Harvard in mathematical psychology at the age of 18) was “tricked” by his wife into stopping his collaboration with McCulloch, shortly before McCulloch went on to propose the perceptron with Walter Pitts.

The relevant portion is cited below…
(more…)

NEOXI.com - Neural Network Resources

Wednesday, January 5th, 2005

Neural Network Resources: www.neoxi.com

* Content: Professionally selected extensive collection of neural network resources.

* Audience: Communities of commerce, industry, academics, engineers, practitioners, and individuals interested in neural networks, machine learning, data mining, artificial intelligence, soft-computing, and numerous other fields directly or indirectly utilizing the neural network technology.

Neural networks at your fingertips

Monday, November 15th, 2004

This website has short, free, open-source C implementations of 8 kinds of neural networks:

  • Adaline Network
  • Backpropagation Network
  • Hopfield Model
  • Bidirectional Associative Memory
  • Boltzmann Machine
  • Counterpropagation Network
  • Self-Organizing Map
  • Adaptive Resonance Theory

    doing 8 kinds of tasks:

  • Classification of Digits 0-9
  • Prediction of the Annual Number of Sunspots
  • Associative Recall of Images
  • Association of Names and Phone Numbers
  • Traveling Salesman Problem
  • Determination of the Angle of Rotation
  • Pole Balancing Problem
  • Stability-Plasticity Demonstration