Book contents
- Frontmatter
- Contents
- Contributors
- Preface
- Part I Introduction
- Part II Neuromorphic robots: biologically and neurally inspired designs
- Part III Brain-based robots: architectures and approaches
- Part IV Philosophical and theoretical considerations
- 10 From hardware and software to kernels and envelopes: a concept shift for robotics, developmental psychology, and brain sciences
- 11 Can cognitive developmental robotics cause a paradigm shift?
- 12 A look at the hidden side of situated cognition: a robotic study of brain-oscillation-based dynamics of instantaneous, episodic, and conscious memories
- 13 The case for using brain-based devices to study consciousness
- Part V Ethical considerations
- Index
- References
10 - From hardware and software to kernels and envelopes: a concept shift for robotics, developmental psychology, and brain sciences
from Part IV - Philosophical and theoretical considerations
Published online by Cambridge University Press: 05 February 2012
Book contents
- Frontmatter
- Contents
- Contributors
- Preface
- Part I Introduction
- Part II Neuromorphic robots: biologically and neurally inspired designs
- Part III Brain-based robots: architectures and approaches
- Part IV Philosophical and theoretical considerations
- 10 From hardware and software to kernels and envelopes: a concept shift for robotics, developmental psychology, and brain sciences
- 11 Can cognitive developmental robotics cause a paradigm shift?
- 12 A look at the hidden side of situated cognition: a robotic study of brain-oscillation-based dynamics of instantaneous, episodic, and conscious memories
- 13 The case for using brain-based devices to study consciousness
- Part V Ethical considerations
- Index
- References
Summary
From hardware and software to kernels and envelopes
At the beginning of robotics research, robots were seen as physical platforms on which different behavioral programs could be run, similar to the hardware and software parts of a computer. However, recent advances in developmental robotics have allowed us to consider a reversed paradigm in which a single software, called a kernel, is capable of exploring and controlling many different sensorimotor spaces, called envelopes. In this chapter, we review studies we have previously published about kernels and envelopes to retrace the history of this concept shift and discuss its consequences for robotic designs and also for developmental psychology and brain sciences.
- Type
- Chapter
- Information
- Neuromorphic and Brain-Based Robots , pp. 217 - 250Publisher: Cambridge University PressPrint publication year: 2011
References
2009 Cognitive developmental robotics: a surveyIEEE Transactions on Autonomous Mental Development 1 12CrossRefGoogle Scholar
2002 A modular neural-network model of the basal ganglia’s role in learning and selection motor behaviorsJournal of Cognitive Systems Research 3 5CrossRefGoogle Scholar
2004
1973 The experimental reproduction of amphetamine psychosisArchives in General Psychiatry 29 35CrossRefGoogle ScholarPubMed
1973 Brain dopamine and the syndromes of Parkinson and Huntington: clinical, morphological and neurochemical correlationsJournal of the Neurological Sciences 20 415CrossRefGoogle ScholarPubMed
2007 The debate over dopamine’s role in reward: the case of incentive saliencePsychopharmacology 191 391CrossRefGoogle ScholarPubMed
2002 Rewards and Intrinsic Motivation: Resolving the ControversySouth Hadley, MABergin and Garvey PressGoogle Scholar
1989 Amphetamine, cocaine, phencyclidine and nomifensine increases extra cellullar dopamine concentrations preferentially in the nucleus accumbens of freely moving ratsNeuroscience 28 653CrossRefGoogle Scholar
2004 Natural-born Cyborgs: Minds, Technologies and the Future of Human IntelligenceOxford, UKOxford University PressGoogle Scholar
2002 Opponent interactions between serotonin and dopamineNeural Networks 15 603CrossRefGoogle ScholarPubMed
1993 San Mateo, CAMorgan Kaufmann271
1968 Personal Causation: The Internal Affective Determinants of BehaviorNew YorkAcademic PressGoogle Scholar
1985 Intrinsic Motivation and Self-Determination in Human BehaviorNew York:Plenum PressCrossRefGoogle Scholar
1957 Analysis of exploratory, manipulatory and curiosity behaviorsPsychological Review 64 91CrossRefGoogle ScholarPubMed
2007 Optimal sensorimotor integration in recurrent cortical networks: a neural implementation of Kalman filtersJournal of Neuroscience 27 5744CrossRefGoogle ScholarPubMed
1989 Neurobehavioral aspects of affective disordersAnnual Review of Psychology 40 457CrossRefGoogle ScholarPubMed
2005 How visual stimuli activate dopaminergic neurons at short latencyScience 307 1476CrossRefGoogle ScholarPubMed
1999 What are the computations of cerebellum, basal ganglia, and the cerebral cortex?Neural Networks 12 961CrossRefGoogle ScholarPubMed
2002 Multiple model-based reinforcement learningNeural Computation 14 1347CrossRefGoogle ScholarPubMed
1986 The Ecological Approach to Visual PerceptionHillsdale, NJLawrence Erlbaum AssociatesGoogle Scholar
1991 Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: a hypothesis for the etiology of schizophreniaNeuroscience 41CrossRefGoogle ScholarPubMed
1982 The Neuropsychology of Anxiety: An Enquiry into the Functions of the Septo-hippocampal SystemOxford, UKClarendon PressGoogle Scholar
1990 Brain systems that mediate both emotion and cognitionCognition and Emotion 4 269CrossRefGoogle Scholar
1950 Learning and satiation of response in intrinsically motivated complex puzzle performances by monkeysJournal of Comparative and Physiological Psychology 43 289CrossRefGoogle Scholar
1963 Electrical self-stimulation of the brain in ManAmerican Journal of Psychiatry 120 571CrossRefGoogle ScholarPubMed
1955 Drives and the C.N.S (conceptual nervous system)Psychological Review 62 243CrossRefGoogle Scholar
1994 Involvement of dopamine and excitatory amino acid transmission in novelty-induced motor activityJournal of Pharmacology and Experimental Therapeutics 269 976Google ScholarPubMed
2000 Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward eventsNeuroscience 96 651CrossRefGoogle ScholarPubMed
2002 Dopamine gating of glutamatergic sensorimotor and incentive motivational input signals to the striatumBehavioral and Brain Research 137 65CrossRefGoogle ScholarPubMed
2002 Proceedings of the 2nd International Workshop on Epigenetic Robotics: Modeling Cognitive Development in Robotic SystemsLund, SwedenLund UniversityGoogle Scholar
1943 Principles of Behavior: An Introduction to Behavior TheoryNew YorkAppleton-Century-CroftGoogle Scholar
1965 Nebraska Symposium on MotivationLincoln, NEUniversity of Nebraska Press189
1999 The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seekingBrain Research Reviews 31 6CrossRefGoogle ScholarPubMed
1996 Coding of modified schema during tool use by macaque postcentral neuronesCognitive Neuroscience and Neuropsychology 7 2325Google ScholarPubMed
2001 The Echo State Approach to Analyzing and Training Recurrent Neural NetworksBonn, GermanyGerman National Research Institute for Computer Science (GMD)Google Scholar
2004 Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communicationScience 304 78CrossRefGoogle ScholarPubMed
2002 Actor-critic models of the basal ganglia: new anatomical and computational perspectivesNeural Networks 15 535CrossRefGoogle ScholarPubMed
1994 Hierarchical mixtures of experts and the EM algorithmNeural Computation 6 181CrossRefGoogle Scholar
1972 Motives and developmentJournal of Personality and Social Psychology 22 51CrossRefGoogle ScholarPubMed
2004 Who is afraid of the humanoid? Investigating cultural differences in the acceptance of robotsInternational Journal of Humanoid Robotics 1 465CrossRefGoogle Scholar
2005 Les machines apprivoisees: comprendre les robots de loisirParisVuibert, Collections Automates IntelligentsGoogle Scholar
2003 Proceedings of the 3rd International Workshop on Epigenetic Robotics: Modeling Cognitive Development in Robotic SystemsLund University Cognitive Studies 101Lund, SwedenLund University73Google Scholar
2006 Proceedings of the Sixth International Workshop on Epigenetic Robotics: Modeling Cognitive Development in Robotic SystemsLund University Cognitive Studies 128Lund, SwedenLund UniversityGoogle Scholar
2007 In search of the neural circuits of intrinsic motivationFrontiers in Neuroscience 1 225CrossRefGoogle ScholarPubMed
2007 Models and Mechanisms of Imitation and Social Learning: Behavioural, Social and Communication DimensionsCambridge, UKCambridge University Press, pp.361Google Scholar
2007 Un robot motivé pour apprendre: le rôle des motivations intrinsèques dans le développement sensorimoteurEnfance 59 46CrossRefGoogle Scholar
2009 Stable kernels and fluid body envelopesSICE Journal of Control, Measurement, and System Integration 48Google Scholar
2006 http://aibo.playroom.fr
2007 Computational models in the debate over language learnabilityInfant and Child Development 17 55CrossRefGoogle Scholar
1999 Internal models for motor control and trajectory planningCurrent Opinion in Neurobiology 9 718CrossRefGoogle ScholarPubMed
2005 Actor-critic models of reinforcement learning in the basal gangliaAdaptive Behavior 13 131CrossRefGoogle Scholar
1998 Philosophy in the Flesh: The Embodied Mind and its Challenge to Western ThoughtNew YorkBasic BooksGoogle Scholar
2001 Where Mathematics Comes From: How the Embodied Mind Brings Mathematics Into BeingNew YorkBasic BooksGoogle Scholar
2002 Real-time computing without stable states: a new framework for neural computation based on perturbationsNeural Computation 14 2531CrossRefGoogle Scholar
2004
2003 A computational substate for incentive salienceTrends in Neurosciences 26 423CrossRefGoogle Scholar
1996 A framework for mesencephalic dopamine systems based on predictive Hebbian learningJournal of Neuroscience 16 1936CrossRefGoogle ScholarPubMed
1954 The role of exploratory drive in learningJournal of Comparative and Physiological Psychology 47 60CrossRefGoogle Scholar
1994 Social understanding at the end of the first year of lifeDevelopmental Review 14 349CrossRefGoogle Scholar
2006 Tonic dopamine: opportunity costs and the control of response vigorPsychopharmacology507Google ScholarPubMed
1985 The role of noradrenaline in tuning and dopamine in switching between signals in the CNSNeuroscience Biobehavorial Review 9 261CrossRefGoogle ScholarPubMed
2007 What is intrinsic motivation? A typology of computational approachesFrontiers in Neurorobotics 1CrossRefGoogle ScholarPubMed
2005 42
2007 Intrinsic motivation systems for autonomous mental developmentIEEE Transactions on Evolutionary Computation 11 265CrossRefGoogle Scholar
1998 Affective Neuroscience: The Foundations of Human and Animal EmotionsNew YorkOxford University PressGoogle Scholar
1989 Dopamine in the nucleus accumbens during cocaine self-administration as studied by in vivo microdialysisPharmacology Biochemistry and Behavior 34 899CrossRefGoogle ScholarPubMed
2007 How the Body Shapes the Way We Think: A New View of IntelligenceCambridge, MAMIT PressGoogle Scholar
2000 Learning about pain: the neural substrate of the prediction error of aversive eventsPNAS 97 9281CrossRefGoogle ScholarPubMed
1974 Stereotaxic stimulation and electrocoagulation of the lateral hypothalamus in obese humansActa 30 111Google ScholarPubMed
1999 Is the short latency dopamine response too short to signal reward error?Trends in Neurosciences 22 146CrossRefGoogle ScholarPubMed
2002 The Imitative Mind: Development, Evolution and Brain BasesCambridge, UKCambridge University PressGoogle Scholar
2000 Intrinsic and extrinsic motivations: classic definitions and new directionsContemporary Educational Psychology 25 54CrossRefGoogle ScholarPubMed
1991
1992 Learning complex, extended sequences using the principle of history compressionNeural Computation 4 234CrossRefGoogle Scholar
2006 Optimal artificial curiosity, developmental robotics, creativity, music, and the fine artsConnection Science 18 173CrossRefGoogle Scholar
1998 Predictive reward signal of dopamine neuronsJournal of Neurophysiology 80 1CrossRefGoogle ScholarPubMed
2006 Behavioral theories and the neurophysiology of rewardAnnual Review of Psychology 57 87CrossRefGoogle Scholar
2006 Dopamine, prediction error and associative learning: a model-based accountNetwork: Computation in Neural Systems 17 61CrossRefGoogle ScholarPubMed
2003 Intelligence with representationPhilosophical Transactions of the Royal Society A 361 2381CrossRefGoogle ScholarPubMed
1995 Proceedings of ICANN 1995: International Conference on Artificial Neural NetworksParisEC2159Google Scholar
2001 Temporal difference model reproduces anticipatory neural activityNeural Computation 13 841CrossRefGoogle ScholarPubMed
1988 Learning to predict by the methods of temporal differencesMachine Learning 3 9CrossRefGoogle Scholar
1999 Between MDPSs and semi-MDPs: a framework for temporal abstraction in reinforcement learningArtificial Intelligence 112 181CrossRefGoogle Scholar
2007 On the interactions between top-down anticipation and bottom-up regressionFrontiers in Neurorobotics 1CrossRefGoogle ScholarPubMed
1999 Learning to perceive the world as articulated: an approach for hierarchical learning in sensory-motor systemsNeural Network 12 1131CrossRefGoogle ScholarPubMed
1978 Mind in Society: The Development of Higher Psychological ProcessesCambridge, MAHarvard University PressGoogle Scholar
1999 Construire la culture materielle: l’homme qui pensait avec les doigtsParisPresses Universitaires de FranceCrossRefGoogle Scholar
1987 Implications of normal brain development for the pathogenesis of schizophreniaArchives in General Psychiatry 44 660CrossRefGoogle ScholarPubMed
2002 Handbook of Experimental Pharmacology. Vol 154/II: Dopamine in the CNS IIBerlinSpringer417Google Scholar
1989 Reward or reinforcement: what’s the difference?Neuroscience Biobehavorial Review 13 181CrossRefGoogle ScholarPubMed
1959 Motivation reconsidered: the concept of competencePsychological Review 66 297CrossRefGoogle Scholar
1991 Alcohol stimulates the release of dopamine and serotonin in the nucleus accumbensAlcohol 9 17CrossRefGoogle Scholar
- 1
- Cited by