On Intelligence

This article has multiple issues. Please help improve it or discuss these issues on the talk page. (Learn how and when to remove these messages) This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed. Find sources: "On Intelligence" – news · newspapers · books · scholar · JSTOR (April 2013) (Learn how and when to remove this message) This article may be in need of reorganization to comply with Wikipedia's layout guidelines. Please help by editing the article to make improvements to the overall structure. (November 2024) (Learn how and when to remove this message) (Learn how and when to remove this message)

On Intelligence: How a New Understanding of the Brain will Lead to the Creation of Truly Intelligent Machines

Front cover
Author	Jeff Hawkins & Sandra Blakeslee
Language	English
Subject	Psychology
Publisher	Times Books
Publication date	2004
Publication place	United States
Media type	Paperback
Pages	272
ISBN	0-8050-7456-2
OCLC	55510125
Dewey Decimal	612.8/2 22
LC Class	QP376 .H294 2004

On Intelligence: How a New Understanding of the Brain will Lead to the Creation of Truly Intelligent Machines is a 2004 book^[1] by Jeff Hawkins and Sandra Blakeslee. The book explains Hawkins' memory-prediction framework theory of the brain and describes some of its consequences.

Hawkins' basic idea is that the brain is a mechanism to predict the future, specifically, hierarchical regions of the brain predict their future input sequences. Perhaps not always far in the future, but far enough to be of real use to an organism. As such, the brain is a feed forward hierarchical state machine with special properties that enable it to learn.^{[1]: 208–210, 222}

The state machine actually controls the behavior of the organism. Since it is a feed forward state machine, the machine responds to future events predicted from past data.

The hierarchy is capable of memorizing frequently observed sequences (Cognitive modules) of patterns and developing invariant representations. Higher levels of the cortical hierarchy predict the future on a longer time scale, or over a wider range of sensory input. Lower levels interpret or control limited domains of experience, or sensory or effector systems. Connections from the higher level states predispose some selected transitions in the lower-level state machines.

Hebbian learning is part of the framework, in which the event of learning physically alters neurons and connections, as learning takes place.^{[1]: 48, 164}

Vernon Mountcastle's formulation of a cortical column is a basic element in the framework. Hawkins places particular emphasis on the role of the interconnections from peer columns, and the activation of columns as a whole. He strongly implies that a column is the cortex's physical representation of a state in a state machine.^{[1]: 50, 51, 55}

As an engineer, any specific failure to find a natural occurrence of some process in his framework does not signal a fault in the memory-prediction framework per se, but merely signals that the natural process has performed Hawkins' functional decomposition in a different, unexpected way, as Hawkins' motivation is to create intelligent machines. For example, for the purposes of his framework, the nerve impulses can be taken to form a temporal sequence (but phase encoding could be a possible implementation of such a sequence; these details are immaterial for the framework).

His predictions use the visual system as a prototype for some example predictions, such as Predictions 2, 8, 10, and 11. Other predictions cite the auditory system ( Predictions 1, 3, 4, and 7).

• An Appendix of 11 Testable Predictions, beginning on page 237:

1. In all areas of cortex, Hawkins (2004) predicts "we should find anticipatory cells", cells that fire in anticipation of a sensory event.

Note: As of 2005 mirror neurons have been observed to fire before an anticipated event.^[2]

2. In primary sensory cortex, Hawkins predicts, for example, "we should find anticipatory cells in or near V1, at a precise location in the visual field (the scene)". It has been experimentally determined, for example, after mapping the angular position of some objects in the visual field, there will be a one-to-one correspondence of cells in the scene to the angular positions of those objects. Hawkins predicts that when the features of a visual scene are known in a memory, anticipatory cells should fire before the actual objects are seen in the scene.

3. In layers 2 and 3, predictive activity (neural firing) should stop propagating at specific cells, corresponding to a specific prediction. Hawkins does not rule out anticipatory cells in layers 4 and 5.

4. Learned sequences of firings comprise a representation of temporally constant invariants. Hawkins calls the cells which fire in this sequence "name cells". Hawkins suggests that these name cells are in layer 2, physically adjacent to layer 1. Hawkins does not rule out the existence of layer 3 cells with dendrites in layer 1, which might perform as name cells.

5. By definition, a temporally constant invariant will be active during a learned sequence. Hawkins posits that these cells will remain active for the duration of the learned sequence, even if the remainder of the cortical column is shifting state. Since we do not know the encoding of the sequence, we do not yet know the definition of ON or active; Hawkins suggests that the ON pattern may be as simple as a simultaneous AND (i.e., the name cells simultaneously "light up") across an array of name cells.

See Neural ensemble#Encoding for grandmother neurons which perform this type of function.

6. Hawkins' novel prediction is that certain cells are inhibited during a learned sequence. A class of cells in layers 2 and 3 should NOT fire during a learned sequence, the axons of these "exception cells" should fire only if a local prediction is failing. This prevents flooding the brain with the usual sensations, leaving only exceptions for post-processing.

7. If an unusual event occurs (the learned sequence fails), the "exception cells" should fire, propagating up the cortical hierarchy to the hippocampus, the repository of new memories.

8. Hawkins predicts a cascade of predictions, when recognition occurs, propagating down the cortical column (with each saccade of the eye over a learned scene, for example).

9. Pyramidal cells should be capable of detecting coincident events on thin dendrites, even for a neuron with thousands of synapses. Hawkins posits a temporal window (presuming time-encoded firing) which is necessary for his theory to remain viable.

10. Hawkins posits, for example, that if the inferotemporal (IT) level has learned a sequence, that eventually cells in V4 will also learn the sequence.

11. Hawkins predicts that "name cells" will be found in all regions of the cortex.

• Hierarchical temporal memory, a technology by Hawkins's startup Numenta Inc. to replicate the properties of the neocortex.
• Memory-prediction framework

• Official website
• George, Dileep; Hawkins, Jeff (2005). "A Hierarchical Bayesian Model of Invariant Pattern Recognition in the Visual Cortex": 1812–1817. CiteSeerX 10.1.1.132.6744. {{cite journal}}: Cite journal requires |journal= (help)
• Saulius Garalevicius' research page - Research papers and programs presenting experimental results with Bayesian models of the Memory-Prediction Framework
• Project Neocortex - An open source project for modeling Memory-Prediction Framework

• Colwell, Bob (January 2005). "Machine Intelligence Meets Neuroscience". Computer. 38 (1). IEEE: 12–15. doi:10.1109/MC.2005.24. Archived from the original on 2005-02-04.
  • Colwell, B. (2005). "Machine Intelligence Meets Neuroscience". Computer. 38: 12–15. doi:10.1109/MC.2005.24.
• Dill, Franz (October 30, 2004). "Jeff Hawkins: On Intelligence". Archived from the original on 2012-02-05.
• Kling, Arnold (22 November 2004). "On Intelligence, People and Computers". Tech Central Station. Archived from the original on 2012-03-05.
• On Biological and Digital Intelligence A review by Ben Goertzel (7 Oct 2004)