Skip to main content Accessibility help
×
Home
  • Get access
    Check if you have access via personal or institutional login
  • Cited by 1
  • Print publication year: 2011
  • Online publication date: November 2011

17 - Mechanisms of choice in the primate brain: a quick look at positive feedback

from Part II - Computational neuroscience models

Summary

Summary

The mammalian brain's decision mechanism may utilise a distributed network of positive feedback loops to integrate, over time, noisy sensory evidence for and against a particular choice. Such loops would mitigate the effects of noise and have the benefit of decoupling response size from the strength of evidence, which could assist animals in acting early at the first signs of opportunity or danger. This hypothesis is explored in the context of the sensorimotor control circuitry underlying eye movements, and in relation to the hypothesis that the basal ganglia serve as a central switch acting to control the competitive accumulation of sensory evidence in positive feedback loops representing alternative actions. Results, in support of these proposals, are presented from a systems-level computational model of the primate oculomotor control. This model is able to reproduce behavioural data relating strength of sensory evidence to response time and accuracy, while also demonstrating how the basal ganglia and related oculomotor circuitry might work together to manage the initiation, control, and termination of the decision process over time.

Introduction

Whether it is a cheetah deciding whether its prey is veering left or right, a rabbit deciding whether that movement in the bushes is friend or foe, or a poker player wondering if his opponent has a stronger hand, infinitesimally small variations in sensory input can give rise to vastly different behavioural outcomes: the cheetah veers left and not right, the rabbit flees or continues grazing, the card player bets a month's salary or folds. The outcome of such decisions can be critical, even a matter of life or death, which is why there will have been tremendous evolutionary pressure to develop decision-making mechanisms that can extract maximal utility from limited sensory information. In this chapter, using the oculomotor system as an exemplar, we argue that the vertebrate basal ganglia (BG) are one of the results of that evolutionary pressure and explore how these structures tame and exploit positive feedback loops (henceforth PFBLs) within the brain in order to make the most of limited information.

References
Arai, KKeller, E. L 2005 A model of the saccade-generating system that accounts for trajectory variations produced by competing visual stimuliBiol. Cybern 92 21
Arai, KKeller, E. LEdelman, J 1994 Two-dimensional neural network model of the primate saccadic systemNeural Networks 7 1115
Arbib, M 2003 The Handbook of Brain Theory and Neural NetworksCambridge, MAMIT Press
Baum, C. WVeeravalli, V. V 1994 A sequential procedure for multihypothesis testingIEEE T. Inform. Theory 40 1994
Bogacz, RBrown, EMoehlis, JHolmes, PCohen, J. D 2006 The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasksPsychol. Rev 113 700
Bogacz, RGurney, K 2007 The basal ganglia and cortex implement optimal decision making between alternative actionsNeural Comput 19 442
Breznen, BLu, S. MGnadt, J. W 1996 Analysis of the step response of the saccadic feedback: system behaviorExp. Brain Res 111 337
Britten, K. HShadlen, M. NNewsome, W. TMovshon, J. A 1993 Responses of neurons in macaque MT to stochastic motion signalsVis. Neurosci 10 1157
Busemeyer, J. RTownsend, J. T 1993 Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environmentPsychol. Rev 100 432
Buttner-Ennever, J. AHorn, A. KHenn, VCohen, B 1999 Projections from the superior colliculus motor map to omnipause neurons in monkeyJ. Comp. Neurol 413 55
Carpenter, R. HWilliams, M. L 1995 Neural computation of log likelihood in control of saccadic eye movementsNature 377 59
Carpenter, R. H. S 1981 Oculomotor procrastinationEye Movements: Cognition and Visual PerceptionFisher, D. FMonty, R. ASenders, J. WHillsdale, NJLawrence Erlbaum Associates237
Chambers, J. M 2007 Deciding where to look: a study of action selection in the oculomotor systemPhD thesis, University of Sheffield
Chambers, J. MGurney, K 2008 A computational model of inaction-selection in multiple domains of basal gangliaSFN Abst 472
Dias, E. CSegraves, M. A 1999 Muscimol-induced inactivation of monkey frontal eye field: effects on visually and memory-guided saccadesJ. Neurophysiol 81 2191
Ditterich, JMazurek, M. EShadlen, M. N 2003 Microstimulation of visual cortex affects the speed of perceptual decisionsNat. Neurosci 6 891
Ferraina, SPare, MWurtz, R. H 2002 Comparison of cortico-cortical and cortico-collicular signals for the generation of saccadic eye movementsJ. Neurophysiol 87 845
Gancarz, GGrossberg, S 1998 A neural model of the saccade generator in the reticular formationNeural Networks 11 1159
Gandhi, N. JKeller, E. L 1997 Spatial distribution and discharge characteristics of superior colliculus neurons antidromically activated from the omnipause region in monkeyJ. Neurophysiol 78 2221
Gandhi, N. JKeller, E. L 1999 Activity of the brain stem omnipause neurons during saccades perturbed by stimulation of the primate superior colliculusJ. Neurophysiol 82 3254
Gold, J. IShadlen, M. N 2007 The neural basis of decision makingAnnu. Rev. Neurosci 30 535
Goldberg, M. EWurtz, R. H 1972 Activity of superior colliculus in behaving monkey. I. Visual receptive fields of single neuronsJ. Neurophysiol 35 542
Goossens, H. HVan Opstal, A. J 2000 Blink-perturbed saccades in monkey. II. Superior colliculus activityJ. Neurophysiol 83 3430
Grossberg, SPilly, P. K 2008 Temporal dynamics of decision-making during motion perception in the visual cortexVision Res 48 1345
Gurney, KPrescott, T. JRedgrave, P 2001 A computational model of action selection in the basal ganglia. II. Analysis and simulation of behaviourBiol. Cybern 84 411
Haber, SMcFarland, N. R 2001 The place of the thalamus in frontal cortical-basal ganglia circuitsNeuroscientist 7 315
Hanes, D. PSchall, J. D 1996 Neural control of voluntary movement initiationScience 274 427
Harting, J. KUpdyke, B. VVan Lieshout, D. P 2001 Striatal projections from the cat visual thalamusEur. J. Neurosci 14 893
Hasegawa, R. PPeterson, B. WGoldberg, M. E 2004 Prefrontal neurons coding suppression of specific saccadesNeuron 43 415
Hikosaka, OTakikawa, YKawagoe, R 2000 Role of the basal ganglia in the control of purposive saccadic eye movementsPhysiol. Rev 80 953
Hollerman, J. RTremblay, LSchultz, W 2000 Involvement of basal ganglia and orbitofrontal cortex in goal-directed behaviorProg. Brain Res 126 193
Johnston, KEverling, S 2008 Neurophysiology and neuroanatomy of reflexive and voluntary saccades in non-human primatesBrain Cogn 68 271
Kropotov, J. DEtlinger, S. C 1999 Selection of actions in the basal ganglia-thalamocortical circuits: review and modelInt. J. Psychophysiol 31 197
Langer, T. PKaneko, C. R 1990 Brainstem afferents to the oculomotor omnipause neurons in monkeyJ. Comp. Neurol 295 413
Li, C. SMazzoni, PAndersen, R. A 1999 Effect of reversible inactivation of macaque lateral intraparietal area on visual and memory saccadesJ. Neurophysiol 81 1827
Ludwig, C. JGilchrist, I. DMcSorley, EBaddeley, R. J 2005 The temporal impulse response underlying saccadic decisionsJ. Neurosci 25 9907
McFarland, D 1971 Feedback mechanisms in animal behaviorNew YorkAcademic Press
Mink, J. W 1996 The basal ganglia: focused selection and inhibition of competing motor programsProg. Neurobiol 50 381
Munoz, D. PIstvan, P. J 1998 Lateral inhibitory interactions in the intermediate layers of the monkey superior colliculusJ. Neurophysiol 79 1193
Munoz, D. PWurtz, R. H 1993 Fixation cells in monkey superior colliculus. I. Characteristics of cell dischargeJ. Neurophysiol 70 559
Munoz, D. PWurtz, R. H 1995 Saccade-related activity in monkey superior colliculus. I. Characteristics of burst and buildup cellsJ. Neurophysiol 73 2313
Pare, MHanes, D. P 2003 Controlled movement processing: superior colliculus activity associated with countermanded saccadesJ. Neurosci 23
Prescott, T. JRedgrave, PGurney, K 1999 Layered control architectures in robots and vertebratesAdapt. Behav 7 99
Ratcliff, R 1978 A theory of memory retrievalPsychol. Rev 85 59
Ratcliff, RSmith, P. L 2004 A comparison of sequential sampling models for two-choice reaction timePsychol. Rev 111 333
Reddi, B. ACarpenter, R. H 2000 The influence of urgency on decision timeNat. Neurosci 3 827
Redgrave, PPrescott, T. JGurney, K 1999 The basal ganglia: a vertebrate solution to the selection problem?Neurosci 89 1009
Roeder, K 1975 Feedback, spontaneous activity, and behaviourBaerends, GBeer, CManning, AFunction and Evolution in Behaviour. Essays in Honour of Professor Niko Tinbergen, F.R.SOxfordClarendon Press, pp.55
Roitman, J. DShadlen, M. N 2002 Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time taskJ. Neurosci 22 9475
Schall, J. D 2001 Neural basis of deciding, choosing and actingNat. Rev. Neurosci 2 33
Schiller, P. HChou, I. H 1998 The effects of frontal eye field and dorsomedial frontal cortex lesions on visually guided eye movementsNat. Neurosci 1 248
Schiller, P. HMalpeli, J. G 1977 Properties and tectal projections of monkey retinal ganglion cellsJ. Neurophysiol 40 428
Schiller, P. HTrue, S. DConway, J. L 1980 Deficits in eye movements following frontal eye-field and superior colliculus ablationsJ. Neurophysiol 44 1175
Segraves, M.A 1992 Activity of monkey frontal eye field neurons projecting to oculomotor regions of the ponsJ. Neurophysiol 68 1967
Shadlen, M. NNewsome, W. T 2001 Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkeyJ. Neurophysiol 86 1916
Soetedjo, RKaneko, C. RFuchs, A. F 2002 Evidence that the superior colliculus participates in the feedback control of saccadic eye movementsJ. Neurophysiol 87 679
Sommer, M. AWurtz, R. H 2004 What the brain stem tells the frontal cortex. I. Oculomotor signals sent from superior colliculus to frontal eye field via mediodorsal thalamusJ. Neurophysiol 91 1381
Sparks, DRohrer, W. HZhang, Y 2000 The role of the superior colliculus in saccade initiation: a study of express saccades and the gap effectVision Res 40 2763
Sparks, D. L 2002 The brainstem control of saccadic eye movementsNat. Rev. Neurosci 3 952
Stanton, G. BGoldberg, M. EBruce, C. J 1988 Frontal eye field efferents in the macaque monkey: I. Subcortical pathways and topography of striatal and thalamic terminal fieldsJ. Comp. Neurol 271 473
Stein, B. EMeredith, M. A 1993 The Merging of the SensesCambridge, MAMIT Press
Thiele, AHenning, PKubischik, MHoffmann, K. P 2002 Neural mechanisms of saccadic suppressionScience 295 2460
Ungerleider, L. GMishkin, M 1982 Two cortical visual systemsAnalysis of Visual BehaviorIngle, D. JGoodale, M. AMansfield, R. J. WCambridge, MAMIT Press549
Usher, MMcClelland, J. L 2001 The time course of perceptual choice: the leaky, competing accumulator modelPsychol. Rev 108 550
Wald, A 1947 Sequential AnalysisNew YorkWiley
Wang, X. J 2002 Probabilistic decision making by slow reverberation in cortical circuitsNeuron 36 955
Windhorst, U 1996 On the role of recurrent inhibitory feedback in motor controlProg. Neurobiol 49 517
Wurtz, R. HGoldberg, M. E 1989 The Neurobiology of Saccadic Eye MovementsAmsterdamElsevier
Wurtz, R. HSommer, M. APare, MFerraina, S 2001 Signal transformations from cerebral cortex to superior colliculus for the generation of saccadesVision Res 41 3399