Book contents
- Frontmatter
- Contents
- Foreword
- Preface
- Contributors
- 1 General introduction
- Part I Rational and optimal decision making
- Part II Computational neuroscience models
- 9 Introduction to Part II: computational neuroscience models
- 10 Action selection and refinement in subcortical loops through basal ganglia and cerebellum
- 11 Cortical mechanisms of action selection: the affordance competition hypothesis
- 12 Toward an executive without a homunculus: computational models of the prefrontal cortex/basal ganglia system
- 13 Hierarchically organised behaviour and its neural foundations: a reinforcement-learning perspective
- 14 The medial reticular formation: a brainstem substrate for simple action selection?
- 15 Understanding decision-making deficits in neurological conditions: insights from models of natural action selection
- 16 Biologically constrained action selection improves cognitive control in a model of the Stroop task
- 17 Mechanisms of choice in the primate brain: a quick look at positive feedback
- Part III Action selection in social contexts
- Index
- Plate section
- References
17 - Mechanisms of choice in the primate brain: a quick look at positive feedback
from Part II - Computational neuroscience models
Published online by Cambridge University Press: 05 November 2011
Book contents
- Frontmatter
- Contents
- Foreword
- Preface
- Contributors
- 1 General introduction
- Part I Rational and optimal decision making
- Part II Computational neuroscience models
- 9 Introduction to Part II: computational neuroscience models
- 10 Action selection and refinement in subcortical loops through basal ganglia and cerebellum
- 11 Cortical mechanisms of action selection: the affordance competition hypothesis
- 12 Toward an executive without a homunculus: computational models of the prefrontal cortex/basal ganglia system
- 13 Hierarchically organised behaviour and its neural foundations: a reinforcement-learning perspective
- 14 The medial reticular formation: a brainstem substrate for simple action selection?
- 15 Understanding decision-making deficits in neurological conditions: insights from models of natural action selection
- 16 Biologically constrained action selection improves cognitive control in a model of the Stroop task
- 17 Mechanisms of choice in the primate brain: a quick look at positive feedback
- Part III Action selection in social contexts
- Index
- Plate section
- References
Summary
Summary
The mammalian brain's decision mechanism may utilise a distributed network of positive feedback loops to integrate, over time, noisy sensory evidence for and against a particular choice. Such loops would mitigate the effects of noise and have the benefit of decoupling response size from the strength of evidence, which could assist animals in acting early at the first signs of opportunity or danger. This hypothesis is explored in the context of the sensorimotor control circuitry underlying eye movements, and in relation to the hypothesis that the basal ganglia serve as a central switch acting to control the competitive accumulation of sensory evidence in positive feedback loops representing alternative actions. Results, in support of these proposals, are presented from a systems-level computational model of the primate oculomotor control. This model is able to reproduce behavioural data relating strength of sensory evidence to response time and accuracy, while also demonstrating how the basal ganglia and related oculomotor circuitry might work together to manage the initiation, control, and termination of the decision process over time.
Introduction
Whether it is a cheetah deciding whether its prey is veering left or right, a rabbit deciding whether that movement in the bushes is friend or foe, or a poker player wondering if his opponent has a stronger hand, infinitesimally small variations in sensory input can give rise to vastly different behavioural outcomes: the cheetah veers left and not right, the rabbit flees or continues grazing, the card player bets a month's salary or folds. The outcome of such decisions can be critical, even a matter of life or death, which is why there will have been tremendous evolutionary pressure to develop decision-making mechanisms that can extract maximal utility from limited sensory information. In this chapter, using the oculomotor system as an exemplar, we argue that the vertebrate basal ganglia (BG) are one of the results of that evolutionary pressure and explore how these structures tame and exploit positive feedback loops (henceforth PFBLs) within the brain in order to make the most of limited information.
- Type
- Chapter
- Information
- Modelling Natural Action Selection , pp. 390 - 418Publisher: Cambridge University PressPrint publication year: 2011
References
2005 A model of the saccade-generating system that accounts for trajectory variations produced by competing visual stimuliBiol. Cybern 92 21CrossRefGoogle ScholarPubMed
1994 Two-dimensional neural network model of the primate saccadic systemNeural Networks 7 1115CrossRefGoogle Scholar
1994 A sequential procedure for multihypothesis testingIEEE T. Inform. Theory 40 1994CrossRefGoogle Scholar
2006 The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasksPsychol. Rev 113 700CrossRefGoogle ScholarPubMed
2007 The basal ganglia and cortex implement optimal decision making between alternative actionsNeural Comput 19 442CrossRefGoogle ScholarPubMed
1996 Analysis of the step response of the saccadic feedback: system behaviorExp. Brain Res 111 337CrossRefGoogle ScholarPubMed
1993 Responses of neurons in macaque MT to stochastic motion signalsVis. Neurosci 10 1157CrossRefGoogle ScholarPubMed
1993 Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environmentPsychol. Rev 100 432CrossRefGoogle Scholar
1999 Projections from the superior colliculus motor map to omnipause neurons in monkeyJ. Comp. Neurol 413 553.0.CO;2-K>CrossRefGoogle ScholarPubMed
1995 Neural computation of log likelihood in control of saccadic eye movementsNature 377 59CrossRefGoogle ScholarPubMed
1981 Oculomotor procrastinationEye Movements: Cognition and Visual PerceptionHillsdale, NJLawrence Erlbaum Associates237Google Scholar
2007 Deciding where to look: a study of action selection in the oculomotor systemPhD thesis, University of SheffieldGoogle Scholar
2008 A computational model of inaction-selection in multiple domains of basal gangliaSFN Abst 472Google Scholar
1999 Muscimol-induced inactivation of monkey frontal eye field: effects on visually and memory-guided saccadesJ. Neurophysiol 81 2191CrossRefGoogle ScholarPubMed
2003 Microstimulation of visual cortex affects the speed of perceptual decisionsNat. Neurosci 6 891CrossRefGoogle ScholarPubMed
2002 Comparison of cortico-cortical and cortico-collicular signals for the generation of saccadic eye movementsJ. Neurophysiol 87 845CrossRefGoogle ScholarPubMed
1998 A neural model of the saccade generator in the reticular formationNeural Networks 11 1159CrossRefGoogle ScholarPubMed
1997 Spatial distribution and discharge characteristics of superior colliculus neurons antidromically activated from the omnipause region in monkeyJ. Neurophysiol 78 2221CrossRefGoogle ScholarPubMed
1999 Activity of the brain stem omnipause neurons during saccades perturbed by stimulation of the primate superior colliculusJ. Neurophysiol 82 3254CrossRefGoogle ScholarPubMed
1972 Activity of superior colliculus in behaving monkey. I. Visual receptive fields of single neuronsJ. Neurophysiol 35 542CrossRefGoogle ScholarPubMed
2000 Blink-perturbed saccades in monkey. II. Superior colliculus activityJ. Neurophysiol 83 3430CrossRefGoogle ScholarPubMed
2008 Temporal dynamics of decision-making during motion perception in the visual cortexVision Res 48 1345CrossRefGoogle ScholarPubMed
2001 A computational model of action selection in the basal ganglia. II. Analysis and simulation of behaviourBiol. Cybern 84 411CrossRefGoogle ScholarPubMed
2001 The place of the thalamus in frontal cortical-basal ganglia circuitsNeuroscientist 7 315CrossRefGoogle ScholarPubMed
2001 Striatal projections from the cat visual thalamusEur. J. Neurosci 14 893CrossRefGoogle ScholarPubMed
2004 Prefrontal neurons coding suppression of specific saccadesNeuron 43 415CrossRefGoogle ScholarPubMed
2000 Role of the basal ganglia in the control of purposive saccadic eye movementsPhysiol. Rev 80 953CrossRefGoogle ScholarPubMed
2000 Involvement of basal ganglia and orbitofrontal cortex in goal-directed behaviorProg. Brain Res 126 193CrossRefGoogle ScholarPubMed
2008 Neurophysiology and neuroanatomy of reflexive and voluntary saccades in non-human primatesBrain Cogn 68 271CrossRefGoogle ScholarPubMed
1999 Selection of actions in the basal ganglia-thalamocortical circuits: review and modelInt. J. Psychophysiol 31 197CrossRefGoogle ScholarPubMed
1990 Brainstem afferents to the oculomotor omnipause neurons in monkeyJ. Comp. Neurol 295 413CrossRefGoogle ScholarPubMed
1999 Effect of reversible inactivation of macaque lateral intraparietal area on visual and memory saccadesJ. Neurophysiol 81 1827CrossRefGoogle ScholarPubMed
2005 The temporal impulse response underlying saccadic decisionsJ. Neurosci 25 9907CrossRefGoogle ScholarPubMed
1996 The basal ganglia: focused selection and inhibition of competing motor programsProg. Neurobiol 50 381CrossRefGoogle ScholarPubMed
1998 Lateral inhibitory interactions in the intermediate layers of the monkey superior colliculusJ. Neurophysiol 79 1193CrossRefGoogle ScholarPubMed
1993 Fixation cells in monkey superior colliculus. I. Characteristics of cell dischargeJ. Neurophysiol 70 559CrossRefGoogle ScholarPubMed
1995 Saccade-related activity in monkey superior colliculus. I. Characteristics of burst and buildup cellsJ. Neurophysiol 73 2313CrossRefGoogle ScholarPubMed
2003 Controlled movement processing: superior colliculus activity associated with countermanded saccadesJ. Neurosci 23CrossRefGoogle ScholarPubMed
2004 A comparison of sequential sampling models for two-choice reaction timePsychol. Rev 111 333CrossRefGoogle ScholarPubMed
1999 The basal ganglia: a vertebrate solution to the selection problem?Neurosci 89 1009CrossRefGoogle ScholarPubMed
1975 Feedback, spontaneous activity, and behaviourFunction and Evolution in Behaviour. Essays in Honour of Professor Niko Tinbergen, F.R.SOxfordClarendon Press, pp.55Google Scholar
2002 Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time taskJ. Neurosci 22 9475CrossRefGoogle ScholarPubMed
2001 Neural basis of deciding, choosing and actingNat. Rev. Neurosci 2 33CrossRefGoogle ScholarPubMed
1998 The effects of frontal eye field and dorsomedial frontal cortex lesions on visually guided eye movementsNat. Neurosci 1 248CrossRefGoogle ScholarPubMed
1977 Properties and tectal projections of monkey retinal ganglion cellsJ. Neurophysiol 40 428CrossRefGoogle ScholarPubMed
1980 Deficits in eye movements following frontal eye-field and superior colliculus ablationsJ. Neurophysiol 44 1175CrossRefGoogle ScholarPubMed
1992 Activity of monkey frontal eye field neurons projecting to oculomotor regions of the ponsJ. Neurophysiol 68 1967CrossRefGoogle ScholarPubMed
2001 Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkeyJ. Neurophysiol 86 1916CrossRefGoogle ScholarPubMed
2002 Evidence that the superior colliculus participates in the feedback control of saccadic eye movementsJ. Neurophysiol 87 679CrossRefGoogle ScholarPubMed
2004 What the brain stem tells the frontal cortex. I. Oculomotor signals sent from superior colliculus to frontal eye field via mediodorsal thalamusJ. Neurophysiol 91 1381CrossRefGoogle ScholarPubMed
2000 The role of the superior colliculus in saccade initiation: a study of express saccades and the gap effectVision Res 40 2763CrossRefGoogle ScholarPubMed
2002 The brainstem control of saccadic eye movementsNat. Rev. Neurosci 3 952CrossRefGoogle ScholarPubMed
1988 Frontal eye field efferents in the macaque monkey: I. Subcortical pathways and topography of striatal and thalamic terminal fieldsJ. Comp. Neurol 271 473CrossRefGoogle ScholarPubMed
2001 The time course of perceptual choice: the leaky, competing accumulator modelPsychol. Rev 108 550CrossRefGoogle ScholarPubMed
2002 Probabilistic decision making by slow reverberation in cortical circuitsNeuron 36 955CrossRefGoogle ScholarPubMed
1996 On the role of recurrent inhibitory feedback in motor controlProg. Neurobiol 49 517CrossRefGoogle ScholarPubMed
2001 Signal transformations from cerebral cortex to superior colliculus for the generation of saccadesVision Res 41 3399CrossRefGoogle ScholarPubMed
- 2
- Cited by