neurodudes

The great Masao Ito, originator of one of the classic theories of cerebellar function, has published a new theory in the recent issue of Nature Neuroscience regarding how the cerebellum may be involved in control of cognition.

The basic idea is that while the cerebellum has evolutionarily had a role of refining motor commands for the purpose of controlling the skeleton, in the human the cerebellum is capable of refining commands from frontal cortex to “control” internal representations of the outside world. Ito uses the increasingly popular language of control theory to describe the effect that the cerebellum may have on different parts of the brain.

From the abstract:

The intricate neuronal circuitry of the cerebellum is thought to encode internal models that reproduce the dynamic properties of body parts. These models are essential for controlling the movement of these body parts: they allow the brain to precisely control the movement without the need for sensory feedback. It is thought that the cerebellum might also encode internal models that reproduce the essential properties of mental representations in the cerebral cortex. This hypothesis suggests a possible mechanism by which intuition and implicit thought might function and explains some of the symptoms that are exhibited by psychiatric patients. This article examines the conceptual bases and experimental evidence for this hypothesis.

Researchers at the University of Nevada, Reno have an interesting and ambitious set-up for doing research in AI that the describe in a recent paper.

From the paper:

We define virtual neurorobotics as follows: a computer-facilitated behavioral loop wherein a human interacts with a projected robot that meets five criteria: (1) the robot is sufficiently embodied for the human to tentatively accept the robot as a social partner, (2) the loop operates in real time, with no pre-specified parcellation into receptive and responsive time windows, (3) the cognitive control is a neuromorphic brain emulation incorporating realistic neuronal dynamics whose time constants reflect synaptic activation and learning, membrane and circuitry properties, and (4) the neuromorphic architecture is expandable to progressively larger scale and complexity to track brain development, (5) the neuromorphic architecture can potentially provide circuitry underlying intrinsic motivation and intentionality, which physiologically is best described as “emotional” rather than rule-based drive.

What’s interesting to me about this is the combination of a embodied robot in a virtual world with a neurally inspired controller for that robot. While there are pros and cons of embodiment in virtual world (some of which have been touched on here before), I think that if your priority is closing the loop from embodiment to research on neural systems, the importance of this kind of approach cannot be ignored.

Neurons come in many shapes and sizes. Frequently, the shape of a neuron is characteristic to its type. Several theoretical papers have demonstrated that the shape of a neuron can crucially determine its pattern of activity, independently of other factors (Mainen & Sejnowski, 1996, for example). Several resources on the web such as neuromorpho.org and the Cell Centered Database are dedicated to maintaining repositories of different neuronal shapes (also known as morphologies).

Any computer scientist worth their salt, noticing this trend, is tempted to say: if neuronal shape is so important, maybe we ought to have good data standards to describe it. That’s just what a paper last year did. It surveyed the popular data standards for modeling, primarily in the NEURON and Genesis simulation packages. The result is a data standard called MorphML, which is part of a larger effort called NeuroML.

Neuronal shape is a weird data type for the computer science world, but I think an incredibly important and fundamental one for deeply coping with the complexity of real brain tissue. It seems to me that many areas of neuroscience research could benefit from the construction of more explicit models of the circuits they study.

Interview with Steve Grand on building human level artificial intelligence at Machines Like Us. Really interesting. Via Chris Chatham at (the excellent) Developing Intelligence.

In particular, MLU asks why his current project to create an android was done as a physical robot rather than as a simulation. The answer, that you can cheat too much in a simulation, is familiar to those from the Brooksian school of embodied intelligence. He says that simulations still aren’t good enough to provide the kinds of physical constraints, like gravity and friction, etc, that you get when building real robots .

However, with the availability of free 3D simulation environments that handle physics, like Breve, we are getting a lot closer. Building a robot within a simulation like this, particularly where you don’t modify the code of the the simulation environment itself, is a terrific way to balance the competing interests of keeping yourself honest and avoiding the painstaking mechanical engineering required to construct complicated robots. This kind of environment allows you to build a body with primary sensory systems and primary motor outputs in a similar fashion as one would with real robots.

Why there aren’t more who have adopted this kind of “in silico embodiment” philosophy I think is the result of taking Brooks’ a bit too seriously. Brooks idea of embodiment is very well founded, but back in the day when he first made those statements, there really were no good ways to simulate the physics of an embodied creature very faithfully. Today that is not the case. Moreover, building real physical robots is great if you have a lot of time, or an engineering team, but it’s a huge investment that distracts from the real problem of understanding the nature of intelligence. The fact that the world has extremely few labs that can make that investment is one of the many reasons there aren’t more serious strong AI researchers any more.

Update: Steve apparently received a few comments along these lines and replies.

Gerstner’s group in Lausanne, Switzerland has announced a competition to predict the electrical behavior of individual neurons in two respects:

1) predict the timing of every spike that a neuron emits with a precision of 2ms.

2) predict the subthreshold membrane potential with a precision of 2mV for arbitrary input.

Details on the competition, including the dataset (released 16 March 2007), are here.

Note that the first prize winner receives:

- 4 nights of hotel in Lausanne at the Lake Geneva, June 23-27.
- Free participation in the Quantitative Neuron Modeling workshop June 25/26
- 35-minute-slot for talk as an Invited Speaker in the workshop.

get coding.

The field of neuroscience naturally focuses its inquiry into neurons. This approach to understanding the brain by studying its parts has been thought to have a greater potential than that of psychology to understand how the brain works, a comment made by no less than Daniel L. Schacter, chair of Harvard’s Department of Psychology, in his book, The Seven Sins of Memory.

However promising the field has been thus far, even the most accomplished neuroscientists will admit that we still do not understand how the brain really works. I would submit that the current reductionist nature of neuroscience has shed much light on the dynamics of how neurons work, but has to a far lesser degree shed light on how neurons process information. The difference between these two lines of inquiry is important for making progress in understanding how the brain works.
(more…)

This paper describes the creation of a set of Matlab scripts that allow a researcher to efficiently program an FPGA to simulate a conductance-based neural network model. The researchers describe the use of their system to run a conductance-based model of 40 neurons with all-to-all connectivity at up to around 8x real-time (I wonder how long it takes to run the same model in software on a typical PC?).

(more…)

Entrepreneur-turned-cognitive neuroscientist Jeff Hawkins is distributing a “research release” of their experimental code base implementing his idea of hierarchical temporal memory described in his book, “On Intelligence”. Hawkins drew inspiration for the model from his own reading about the structure and function of the human neocortex and believes that it represents the foundation for developing intelligent machines.

Jeff explains this surprising move to open source the code for the Numenta Platform for Intelligent Computing (NuPIC) on the Numenta web site:

Why are we making NuPIC available now?

We have been contacted by dozens of researchers and scientists who are excited about HTM and by our work at Numenta. These people are anxious to work on HTM, are willing to be pioneers, and are willing to accept the uncertainty associated with a new technology. We are making our tools available so that these sophisticated developers can start building a community around HTM technology. NuPIC has been under development for 18 months, is pretty solid, and is well documented - including several examples to make it easy to get started - so we’re ready to open up to more developers, even while knowing that we do not yet have benchmarking data, and we cannot make guarantees about applicability to specific problems.

Here’s why Hawkins thinks that HTMs are new.

We have been covering Hawkins’ work for a while now. See these previous posts for more background info.

Neurodudes is actively soliciting code reviews of the newly released software. Is NuPIC the next big thing, or are you left feeling cold? Post your thoughts yourself using the instructions on the right-hand column, or let us know at contactus -AT- neurodudes.com!

What is the right level of biological realism to model neuronal systems in order to understand their computational properties? Some recent papers may help shed some light on the subject. Models of the computational properties of local networks of neurons are starting to come into their own. This year has already seen at least two articles published in experimentalist journals based on the same core of theoretical work.

To bring you up to speed, I need to remind you what is going on in the world of experimental neuroscience.

Experimentalists are now able to record the single-cell activities of a whole population of neurons simultaneously. From Briggman, Abarbanel, Kristan (2006):

By using multi-electrode arrays or optical imaging, investigators can now record from many individual neurons in various parts of nervous systems simultaneously while an animal performs sensory, motor or cognitive tasks. Given the large multidimensional datasets that are now routinely generated, it is often not obvious how to find meaningful results within the data.

This paper goes on to provide a nice overview on mathematical methods that researchers are using to grapple with the challenge of understanding the dynamics of the neural systems they are recording from. They make the case that conceptual progress needs to be made on the interpretation of the data these results yield. How can we understand what computations these neurons are collectively performing?

(Incidentally, this topic is being explored in a conference happening this week at the Los Alamos National Laboratory, which, according to one of the conference session chairs, is intended to help shape future directions for the lab. Hopefully there will be webcasts from this conference.)

(more…)

Postdoctoral/research scientist positions are available in the inter-disciplinary group of Dmitri Chklovskii at the new Janelia Farm Research Campus of the Howard Hughes Medical Institute located in the suburbs of Washington, D.C. Candidates are expected to have a PhD in neuroscience, physics, computer science or electrical engineering. Most of the work is theoretical or computational and is done in collaboration with several experimental laboratories. Successful applicants will work on projects centered on neuronal circuits such as high-throughput reconstruction of wiring diagrams as well as combining structural and physiological data to infer circuit function. Salary will be commensurate with qualifications. For more information about research directions in the group please see: http://www.hhmi.org/research/groupleaders/chklovskii.html
Interested applicants should send their CV and a statement of research interests to mitya (at) janelia.hhmi.org, and arrange for three recommendation letters to be emailed to me.