Springe zum Hauptinhalt

Professur Künstliche Intelligenz

Neurokognition II

SS2012

Inhalte

Die Veranstaltung führt in die Modellierung neurokognitiver Vorgänge des Gehirns ein. Neurokognition ist ein Forschungsfeld, welches an der Schnittstelle zwischen Psychologie, Neurowissenschaft, Informatik und Physik angesiedelt ist. Es dient zum Verständnis des Gehirns auf der einen Seite und der Entwicklung intelligenter adaptiver Systeme auf der anderen Seite. Die Neurokognition II beleuchtet komplexere Modelle von Neuro-psychologischen Prozessen, mit dem Ziel neue Algorithmen für intelligente, kognitive Roboter zu entwickeln. Themen sind Wahrnehmung, Gedächtnis, Handlungskontrolle, Emotionen, Entscheidungen und Raumwahrnehmung. Zum tieferen Verständnis erfordern die Übungen auch praktische Aufgaben am Rechner.

Ziele: Fachspezifische Kenntnisse der Neurokognition


Syllabus

Introduction

The introduction motivates the goals of the course and basic concepts of models. It further explains why computational models are useful to understand the brain and why cognitive computational models can lead to a new approach in modeling truly intelligent agents.

The styles of computation used by biological systems are fundamentally different from those used by conventional computers: biological neural networks process information using energy-efficient asynchronous, event-driven, methods. They learn from their interactions with the environment, and can flexibly produce complex behaviors. These biological abilities yield a potentially attractive alternative to conventional computing strategies.

Neurokognition II is particularly devoted to model perception cognition and behavior in large-scale neural networks. The course introduces models of early vision, attention, object recognition, space perception, cognitive control, memory, emotion and consciousness.


Part I Anatomy

Part I describes the basic computational elements in the brain, the neurons. A neuron is already an extremely complicated device. Thus, models at different abstraction levels are introduced.

1.1 Anatomy

Biophysical models of single cells are constructed using electrical circuits composed of resistors, capacitors, and voltage and current sources. This lecture introduces these basic elements.

Part II Early Vision

Perhaps our most important sensory information about our environment is vision. The lecture "early vision" explains the first processing steps of visual perception.

2.1 The Retina and LGN

Vision starts in the retina, which is considered part of the brain. The lecture explains the concept of a receptive field and introduces simple models of early processing that model dynamic receptive fields.

2.2 Shape perception

Shape perception refers to the fact that the visual system has filters that respond optimally to oriented bars or edges, which takes place in area V1, also called striate cortex. This lecture introduces into the receptive fields of neurons in V1 and explains what kind of information V1 encodes with respect to shape perception.

Exercise II.1: Gabor filters, Files: exercise1.tar

2.3 Color

Color perception begins in the retina by receptors that are sensitive to light of different wavelength.

2.4 Motion

Motion perception begins already in area V1 by motion sensitive cells and then continues in the dorsal pathway in areas MT and MST.

2.5 Depth

Seeing in three dimensions requires to extract depth information from the visual scene. One method, called binocular disparitiy, is of primary focus.

Suggested Reading: Read JCA (2005) Early computational processing in binocular vision and depth perception. Progress in Biophysics and Molecular Biology 87:77-108.

2.6 Gain Normalization

Gain normalization appears to be a canonical neural computation in sensory systems and possibly also in other neural systems. Gain normalization is introduced and examples for normalization in retina, in primary visual cortex, in higher visual cortical areas and in non-visual cortical areas are given.

Suggested Reading: Carandini M., Heeger DJ. (2012) Normalization as a canonical neural computation. Nature Reviews Neuroscience, 13:51-62.

2.7 Efficient Coding

Efficient coding relates to the question why the brain has developed a particular set of feature detectors for early vision. The idea is that theoretical concepts from information theory could help to better understand the coding of vision in the brain.

Suggested Reading:
Wiltschut, J., Hamker, F.H. (2009) Efficient Coding correlates with spatial frequency tuning in a model of V1 receptive field organization. Visual Neuroscience. 26:21-34
Additional Reading:
Carandini, M., Heeger, D.J.: Normalization as a canonical neural computation. Nature Reviews Neuroscience 2012. 13:51-62
Simoncelli, E.P., Olshausen, B. A.: Natural Image Statistics and Neural Representation. Annu. Rev. Neurosci. 2001. 24:1193-216
Simoncelli, E.P.: Vision and the statistics of the visual environment. Current Opinion in Neurobiology 2003, 13:144-149._
Teichmann, M., Wiltschut, J., Hamker, F.H. (2012) Learning invariance from natural images inspired by observations in the primary visual cortex. Neural Computation, 24: 1271-1296

Exercise II.2: Efficient coding, Files: exercise3.tar.gz ; Preparatory reading: Wiltschut and Hamker (2009). Efficient Coding correlates with spatial frequency tuning in a model of V1 receptive field organization. Visual Neuroscience. 2009. 26:21-34

2.8 Cortical magnification

In the cortex, the visual space is overrepresented in the fovea, which means that much more space in cortex is devoted to compute information around the center of visual space. A cortical magnification function allows to model the relation between visual and cortical space providing a method to account for the overrepresentation in models of visual perception.

Part III High-level Vision

High-level vision deals with questions of how we recognize objects or scenes and how we direct processing resources to particular aspects of visual scenes (visual attention).

3.1 Object recognition

Object recognition appears to be solved by a hierarchically organized system that progressively increases the complexity and invariance of feature detectors.

Exercise III.1: Object Recognition and HMAX, Files: exercise2.tar.bz2 ; article: Serre, Wolf and Poggio (2005).

3.2 High-Level Vision: Visual Attention

Attention refers to mechanisms that allow the focusing of processing resources. Experimental observations, neural principles and system-level models of attention are described.

Exercise III.2: Normalization model of attention, Files: exercise4.tar.gz .

Exercise III.3: Visual attention and experimental data, Files: exercise5.tar.bz2 .

3.3 High-Level Vision: Space Perception

The perception of space is very crucial for systems that interact with the wold. This lecture introduces to anatomical pathways of space perception. The primary focus is then directed to the problem of "Visual Stability", which deals with the question of why we perceive a stable environment regardless that each eye movement changes the content on the retina.

Part IV Cognition

Cognition deals with questions of how a system can learn and execute complex tasks and allow control over sensors and actions.

4.1 Introduction

4.2 Motor decision and Parkinson disease

Suggested Reading:
Vitay, J., Fix, J., Beuth, F., Schroll, H., Hamker, F.H. (2009) Biological Models of Reinforcement Learning. Künstliche Intelligenz, 3:12-18.
Wiecki, T.V., Frank, M.J. (2010) Neurocomputational models of motor and cognitive deficits in Parkinson's disease. Prog. Brain Res. 183:275-297.

4.3 Working Memory

Suggested Reading:
Hamker, F.H. (2012) Neural learning of cognitive control. Künstliche Intelligenz.

Exercise IV.1: Seminar, Frank MJ (2005) Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism. J Cogn Neurosci 17:51-72

Exercise IV.2: Basal Ganglia an Parkinson's disease, , Files: exercise6.tar.bz2