Hostname: page-component-8448b6f56d-cfpbc Total loading time: 0 Render date: 2024-04-16T21:09:18.677Z Has data issue: false hasContentIssue false

On what motivates us: a detailed review of intrinsic v. extrinsic motivation

Published online by Cambridge University Press:  07 July 2022

Laurel S. Morris*
Affiliation:
Department of Psychiatry, Depression and Anxiety Center for Discovery and Treatment, Icahn School of Medicine at Mount Sinai, New York, NY 10029 USA
Mora M. Grehl
Affiliation:
Department of Psychology, Temple University, Philadelphia, PA 19122 USA
Sarah B. Rutter
Affiliation:
Department of Psychiatry, Depression and Anxiety Center for Discovery and Treatment, Icahn School of Medicine at Mount Sinai, New York, NY 10029 USA
Marishka Mehta
Affiliation:
Department of Psychiatry, Depression and Anxiety Center for Discovery and Treatment, Icahn School of Medicine at Mount Sinai, New York, NY 10029 USA
Margaret L. Westwater
Affiliation:
Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT 06510 USA
*
Author for correspondence: Laurel S. Morris, E-mail: laurel.morris@mssm.edu
Rights & Permissions [Opens in a new window]

Abstract

Motivational processes underlie behaviors that enrich the human experience, and impairments in motivation are commonly observed in psychiatric illness. While motivated behavior is often examined with respect to extrinsic reinforcers, not all actions are driven by reactions to external stimuli; some are driven by ‘intrinsic’ motivation. Intrinsically motivated behaviors are computationally similar to extrinsically motivated behaviors, in that they strive to maximize reward value and minimize punishment. However, our understanding of the neurocognitive mechanisms that underlie intrinsically motivated behavior remains limited. Dysfunction in intrinsic motivation represents an important trans-diagnostic facet of psychiatric symptomology, but due to a lack of clear consensus, the contribution of intrinsic motivation to psychopathology remains poorly understood. This review aims to provide an overview of the conceptualization, measurement, and neurobiology of intrinsic motivation, providing a framework for understanding its potential contributions to psychopathology and its treatment. Distinctions between intrinsic and extrinsic motivation are discussed, including divergence in the types of associated rewards or outcomes that drive behavioral action and choice. A useful framework for understanding intrinsic motivation, and thus separating it from extrinsic motivation, is developed and suggestions for optimization of paradigms to measure intrinsic motivation are proposed.

Type
Review Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
Copyright © The Author(s), 2022. Published by Cambridge University Press

Introduction

Motivation is an integral component of human experience. Children spontaneously explore novel items, and adults autonomously engage in new hobbies, even in the absence of clear extrinsic reinforcers. Thus, not all actions are driven by tangible external stimuli or outcomes, known as ‘extrinsic’ motivation, but are driven by more internal drivers, known as ‘intrinsic’ motivation, where the activity is perceived as its own outcome.

Intrinsically motivated behaviors are computationally similar to extrinsically motivated behaviors, in that they strive to maximize goal attainment and minimize punishment, represented mathematically as value and effort cost functions, respectively (Gottlieb, Lopes, & Oudeyer, Reference Gottlieb, Lopes, Oudeyer, Kim, Reeve and Bong2016). However, subjective internal value functions are difficult to characterize, and our understanding of how they are computed and integrated is limited (Gottlieb et al., Reference Gottlieb, Lopes, Oudeyer, Kim, Reeve and Bong2016).

Dysfunction in intrinsic motivation represents an important transdiagnostic facet of psychiatric symptomology, which is often classified as distinct psychological constructs, such as apathy in neurological disorders, anhedonia in depression, and negative symptoms in schizophrenia. Each of these symptom domains may be underpinned by a shared dysfunction of intrinsic motivation, and interventions targeting intrinsic motivation have the potential to improve treatment outcomes for affected individuals.

However, due to a lack of clear consensus, the contribution of intrinsic motivation to psychiatric disorders remains poorly understood. This review aims to provide an overview of the conceptualization, measurement, and neurobiology of intrinsic motivation, providing a framework for understanding the potential contributions to psychopathology and its treatment.

Historical conceptualizations of intrinsic motivation

During the early 20th century, prominent descriptions of motivation were at odds with each other. Woodworth (Reference Woodworth1918) suggested that intrinsic motivation governed activities perpetuated by their own ‘native drive’, whereas Thorndike (Reference Thorndike1911) and Watson (Reference Watson1913) argued that external stimuli governed behavior. Also centered on internal drives, Hull's (Reference Hull1943) ‘drive theory’ posited that all behaviors were performed to seek or avoid primary biological states, including hunger or pain. However, the drive theory could not explain many behavioral anomalies, such as hungry rats withstanding painful electric shocks to explore a novel environment (Nissen, Reference Nissen1930), or rhesus monkeys performing a puzzle task for no biological reason or external reinforcer (Harlow, Reference Harlow1950). By narrowly presuming that biological states drive all behavior, drive theory failed to account for instances in which an organism prioritizes higher-order cognitive drives over physiological ones.

The shortcomings of drive theory led to the emergence of alternate theories of intrinsic motivation. Some argued that homeostatic maintenance of optimal biological or cognitive states (Hebb, Reference Hebb1955; McClelland & Clark, Reference McClelland, Clark, Mcclelland, Atkinson, Clark and Lowell1953; McClelland, Atkinson, Clark, & Lowell, Reference McClelland, Atkinson, Clark, Lowell and Haber1967), or mitigation of incongruency or uncertainty (Festinger, Reference Festinger1957; Kagan, Reference Kagan1972), drove behavior. However, these theories emphasized external stimuli or cognitive representations of external goal states as key drivers of behavior. In the mid-to-late 20th century, several models underscored the importance of novelty-seeking, interest, and autonomy in driving intrinsic motivation. Novelty-seeking was suggested to energize approach behavior via curiosity and exploration that leads to skill mastery, information attainment, or learning (Kaplan & Oudeyer, Reference Kaplan and Oudeyer2007). Interest and enjoyment in an activity might boost intrinsic motivation by engendering ‘flow’, a prolonged state of focus and enjoyment during task engagement that stretches one's skillset (Csikszentmihalyi, Reference Csikszentmihalyi1975; Nakamura & Csikszentmihalyi, Reference Nakamura, Csikszentmihalyi, Lopez and Snyder2009). Finally, self-determination theory (Deci & Ryan, Reference Deci and Ryan1980) proposed that human needs for competence, achievement, and autonomy drive intrinsic motivation, aligning with observations that intrinsic motivation stems from an internal perceived autonomy during task engagement (DeCharms, Reference DeCharms1968; Lamal, Reference Lamal2003). These models highlight the role of achievement and perceived autonomy (DeCharms, Reference DeCharms1968) in driving intrinsic motivation, coinciding with current computational frameworks of intrinsic reward (Chew, Blain, Dolan, & Rutledge, Reference Chew, Blain, Dolan and Rutledge2021; Murayama, Matsumoto, Izuma, & Matsumoto, Reference Murayama, Matsumoto, Izuma and Matsumoto2010).

The introduction of external goals: a shift to extrinsic motivation

While intrinsic motivation has been proposed to be divorced from external reinforcers, our understanding of motivation has been led largely by using external reinforcers as conceptual and experimental tools. Here, we briefly review historical perspectives on external drivers of motivated behavior, outlining prominent goal- and action-focused models of extrinsic motivation.

Early psychological models of extrinsic motivation suggested that ‘will’ and ‘intention’ fostered goal achievement, emphasizing the influence of goal expectation on action and control (Lewin, Reference Lewin and Rapaport1951; Tolman, Reference Tolman1932). Within this framework, environmental features, as well as an individual's internal state or memory, determine their actions when pursuing a goal, or, more specifically, the cognitive representation of a goal (Kagan, Reference Kagan1972). This requires multiple cognitive representations to be developed, maintained, and updated, with a particular reliance on external stimuli and learning (Deci, Koestner, & Ryan, Reference Deci, Koestner and Ryan1999; Kagan, Reference Kagan1972; Kagan & Moss, Reference Kagan and Moss1983).

Alongside psychological model development, economic models of motivation emerged. These models propose that extrinsic goals, or incentives, elicit motivated behavior via a cost-benefit analysis, where motivated choice occurs when benefits outweigh costs. More recently, behavioral economics has considered how individual personality traits, biases, and irrationalities influence motivated behavior (Strombach, Strang, Park, & Kenning, Reference Strombach, Strang, Park and Kenning2016). A recent model (Strombach et al., Reference Strombach, Strang, Park and Kenning2016) incorporates various factors into the classical cost-benefit analysis, including traditional intrinsic (e.g. satisfaction) and extrinsic drivers (e.g. money), with negative influences from costs (e.g. effort, pain), which are merged into a single dynamic, subjective and state-dependent factor that drives motivated behavior. Though this approach is powerful, the explicit focus on incentives provides limited explanatory power for various paradoxical behaviors, including rodents overcoming the high cost to self-stimulate certain brain regions (e.g. nucleus accumbens; Nac) or extrinsic reinforcers' dampening effect on intrinsic motivation.

In reinforcement learning models of decision-making, an organism, or agent, learns which actions maximize total reward. This process has been formalized within computational sciences and modern artificial intelligence systems (Sutton & Barto, Reference Sutton and Barto1981; Witten, Reference Witten1977), where learning and decision-making depend on an extrinsic outcome. One theory suggests that motivated action is driven solely by a need to reduce reward prediction errors (RPEs; Kaplan and Oudeyer, Reference Kaplan and Oudeyer2007), or the mismatch between expectation and outcome (Montague, Dayan, & Sejnowski, Reference Montague, Dayan and Sejnowski1996; Schultz et al., Reference Schultz, Dayan and Montague1997). RPEs can also be conceptualized as valuation signals for novel outcomes or unexpected stimuli. RPE-based learning then drives motivated behavior, or action choice, but even if the agent displays intact encoding of action or outcome value, motivated behavior can be dampened by reduced novelty. This highlights the role of novelty, expectation and prediction in learning per se, rather than choice valuation.

In action-focused models of motivation, incentives can trigger approach or avoidance behavior by signaling a potential goal state (Berridge, Robinson, & Aldridge, Reference Berridge, Robinson and Aldridge2009). Incentive motivation thus relies on expectancy, probability, and value of outcomes, which are thought to dictate behavioral choice and decision-making. While greater reliance on stimulus-outcome rather than stimulus-response contingencies has led some to describe incentive motivation as proactive (Beckmann & Heckhausen, Reference Beckmann, Heckhausen, Heckhausen and Heckhausen2018), others have characterized it as reactive due to the central role of learning from past experience (Bolles, Reference Bolles1972). Reliance on an expected outcome was central to behaviorism (Watson, Reference Watson1913, Reference Watson1930) and operant conditioning (Skinner, Reference Skinner1938), which assume that actions are driven by a reinforcer, and instrumental value is assigned to the behavior itself. Stimulus-response pairs dominate behaviorism and modern theories of habitual behavior (Gläscher, Daw, Dayan, & O'Doherty, Reference Gläscher, Daw, Dayan and O'Doherty2010), where the dependency on previously reinforced actions ultimately governs motivated choice (de Wit et al., Reference de Wit, Standing, DeVito, Robinson, Ridderinkhof, Robbins and Sahakian2011; Gillan, Robbins, Sahakian, van den Heuvel, & van Wingen, Reference Gillan, Robbins, Sahakian, van den Heuvel and van Wingen2016; Voon et al., Reference Voon, Derbyshire, Rück, Irvine, Worbe, Enander and Bullmore2014). However, this renders behaviors as repetitive, insensitive to punishment and divorced from goals (Robbins, Gillan, Smith, de Wit, & Ersche, Reference Robbins, Gillan, Smith, de Wit and Ersche2012). Therefore, these action-focused models of motivated behavior almost entirely discount intrinsic motivation since extrinsic motivators usurp control of behavior.

Several limitations of extrinsic motivation models must be considered when attempting to characterize intrinsic motivation. First, for cost-benefit analysis and reinforcement learning, an internal representation of the outcome must first be learned, which requires previous experience of the goal. However, intrinsic motivation can occur for novel outcomes, or behaviors that are uncertain or ambiguous. Second, motivation can occur for activities that may already be fully predictable, marking a significant limitation for reinforcement-learning models of motivation, which assume that reward prediction errors drive learning for motivated action. Third, these frameworks cannot fully explain spontaneous novelty seeking or exploratory behavior, in which no external reward is expected and no cost is overcome (Deci et al., Reference Deci, Koestner and Ryan1999; Marsden, Ma, Deci, Ryan, & Chiu, Reference Marsden, Ma, Deci, Ryan and Chiu2014).

Separating and integrating intrinsic and extrinsic motivation

A key question is whether intrinsic and extrinsic motivation can, or should, be experimentally or theoretically separated. There is some evidence that they are dissociable constructs at the neural level. The most compelling support comes from case reports of patients with basal ganglia lesions who developed ‘psychic akinesia’, a syndrome characterized by difficulty with self-generated action initiation but no difficulty in performing complex cognitive or motor tasks when prompted (Laplane, Baulac, Widlocher, & Dubois, Reference Laplane, Baulac, Widlocher and Dubois1984; Lugaresi, Montagna, Morreale, & Gallassi, Reference Lugaresi, Montagna, Morreale and Gallassi1990). In patients with alien hand syndrome, medial prefrontal and anterior cingulate cortex (ACC) lesions lead to a loss of intentional motor control, whereas (pre)-supplementary motor area lesions lead to impairments in implementing motor intentions (Brugger, Galovic, Weder, & Kägi, Reference Brugger, Galovic, Weder and Kägi2015; Nachev, Kennard, & Husain, Reference Nachev, Kennard and Husain2008). Preclinical findings further show that photostimulation of GABAergic amygdala projections modulates extrinsic motivation without affecting intrinsically motivated behavior (Seo et al., Reference Seo, Funderburk, Bhatti, Motard, Newbold, Girven and Bruchas2016). Together, these findings suggest that intrinsic and extrinsic motivation reflect different cortico-striatal-limbic circuits.

Behavioral research primarily supports the view that intrinsic and extrinsic motivation are partially distinct, interacting processes. For example, if the motivation for intrinsic and extrinsic goals were independent constructs, they might demonstrate an additive or subtractive effect on each other (Woodworth, Reference Woodworth1921). Indeed, the expectation (Liu & Hou, Reference Liu and Hou2017) and experience (Badami, VaezMousavi, Wulf, & Namazizadeh, Reference Badami, VaezMousavi, Wulf and Namazizadeh2011) of an extrinsic reinforcer can increase intrinsic motivation. However, reports of the ‘undermining effect’, in which an external reinforcer reduces intrinsic motivation (Cerasoli, Nicklin, & Ford, Reference Cerasoli, Nicklin and Ford2014; Deci, Reference Deci1971; Deci, Benware, & Landy, Reference Deci, Benware and Landy1974; Lepper & Greene, Reference Lepper and Greene1978; Lepper, Greene, & Nisbett, Reference Lepper, Greene and Nisbett1973) have sparked debate over how extrinsic reinforcers affect internally-motived behaviors (Cameron & Pierce, Reference Cameron and Pierce2002; Lamal, Reference Lamal2003; Lepper, Keavney, & Drake, Reference Lepper, Keavney and Drake1996). One explanation for the undermining effect suggests that the presence of an external reinforcer shifts one's perception of the locus of control over the behavior from internal to external (Deci & Ryan, Reference Deci and Ryan1980). This implicates a key role of agency, or the belief of action ownership, in intrinsic motivation. While controversial, mounting evidence supports this account of the undermining effect, where various extrinsic motivators (e.g. food, social observation; Ryan, Reference Ryan1982) decrease intrinsic motivation when their delivery is contingent on task-performance.

A useful framework for parsing motivated action into intrinsic and extrinsic is the Rubicon model of action phases (Heckhausen & Heckhausen, Reference Heckhausen and Heckhausen2018; Heckhausen, Reference Heckhausen1989). Within this framework, pre-decisional option deliberation occurs, which is followed by choice intention formation and planning, volitional action, outcome achievement, and evaluation (Fig. 1). Husain and Roiser (Reference Husain and Roiser2018) recently proposed a complementary model to deconstruct apathy and anhedonia into underlying cognitive processes, including option generation, anticipation, action initiation, prediction, consumption and learning. This parcellation broadly reflects the five main stages of the Rubicon model: (1) pre-decisional deliberation (option generation); (2) intention formation, planning, initiation (anticipation); (3) volitional action (action initiation, prediction), (4) outcome achievement (consumption); and (5) evaluation (learning; Figure 1). Within these overlapping frameworks, the initial pre-decisional deliberation/option generation phase represents the point at which intrinsic and extrinsic facets of motivation diverge, as early drivers of behavior can be intrinsic (e.g. enjoyment, interest, exploration) or extrinsic (e.g. social reward). The differences between these early drivers highlight a key distinction between intrinsic and extrinsic motivation, in which the former is a fundamentally proactive process and the latter reactive.

Fig. 1. Schematic framework for parsing motivated action. Motivated decision-making and action is parsed into separate phases of choice, action and outcome valuation, combining and building upon separate frameworks including the Rubicon model of action phases, well-established computational mechanisms and a recent cognitive framework describing anhedonia and apathy. During choice valuation, pre-decisional deliberation includes option generation, a cost-benefit analysis and option selection. Intrinsic and extrinsic motivation diverges during this early choice valuation phase. Once choice valuation has been computed and an option selected, planning and anticipation occurs. During action valuation, volitional action is initiated and action sustainment or acceleration is maintained. During outcome valuation, outcome achievement and consumption ensue, followed by evaluation based on learning via prediction error (PE) updating. Created with BioRender.com.

If a behavior were intrinsically motivated, the pre-decisional deliberation phase might be determined by biological drives, the need to restore homeostasis (Hebb, Reference Hebb1949; Hull, Reference Hull1943), or a state of incongruency resolution (Festinger, Reference Festinger1957; Kagan, Reference Kagan1972) as described by early theories of intrinsic motivation. In contemporary frameworks, novelty-seeking, exploration, or interest in learning or achievement would render subsequent actions as intrinsically motivated. If a behavior were extrinsically motivated, this pre-decisional deliberation phase would represent the cost-benefit analysis in economic models, prediction-error minimization in reinforcement learning, or effort-reward trade-off computation. Under incentive motivation and behaviorist theories, the pre-decisional deliberation phase would be triggered by conditioned stimuli making conscious deliberation unnecessary and inefficient.

A combination of intrinsic and extrinsic factors likely enters into the pre-decisional deliberation phase to guide motivated behavior (Fig. 1). Although intrinsic and extrinsic motivation are conceptually distinct processes, attempts to formally define them have identified several mechanisms by which they interact, leading to questions about their dissociability. Since they can interact in an additive or subtractive fashion, they may indeed be separate, independent drivers of behavior that are amalgamated during a pre-decisional deliberation phase of behavioral choice.

Measuring intrinsic motivation

Human behavior

Early attempts to quantify intrinsic motivation were largely based on behavioral observation, wherein intrinsic motivation was measured as free choice of an activity in the absence of an external stimulus or performance rating (Butler & Nisan, Reference Butler and Nisan1986; Daniel & Esser, Reference Daniel and Esser1980; Liu & Hou, Reference Liu and Hou2017). These studies also implemented self-report measures of participants' interest or enjoyment in an activity. While such measures do capture intrinsic motivation as inherent task enjoyment, they are limited by their qualitative and indirect nature, as well as by variability in participant insight. However, more objective measures are difficult to develop due to the inherently unobservable nature of intrinsic motivation.

Since spontaneous novelty-seeking and exploratory behavior reflect intrinsic motivation, one candidate objective measure may be the explore-exploit paradigm (Gittins & Jones, Reference Gittins and Jones1979; Robbins, Reference Robbins1952). In explore-exploit foraging tasks, participants must choose among various options and either exploit a previously reinforced choice or explore a novel alternative option. An individual's tendency to either explore an environment or exploit their pre-existing knowledge is influenced by perseverance (Von Culin et al., Reference Von Culin, Tsukayama and Duckworth2014), which acts as an indicator of confidence in the absence of immediate reward. Healthy adults flexibly employ a mix of exploitative and exploratory choices, where striatal and prefrontal dopamine signaling is proposed to drive exploration and exploitation, respectively (Badre, Doll, Long,, & Frank,, Reference Badre, Doll, Long and Frank2012; Daw, O'Doherty, Dayan, Seymour, & Dolan, Reference Daw, O'Doherty, Dayan, Seymour and Dolan2006; Mansouri, Koechlin, Rosa, & Buckley, Reference Mansouri, Koechlin, Rosa and Buckley2017). While these tasks capture one's willingness to trade-off exploratory v. exploitative behaviors, they do not measure free-choice exploratory behavior in the absence of explicit reinforcers, which would be most consistent with intrinsic motivation.

Paradigms that allow an individual to choose to explore an environment without extrinsic reinforcers, or to engage in a previously enjoyable or interesting activity, would more closely index intrinsic motivation. Additionally, outcomes that relate to achievement or autonomy, without socially rewarding feedback or monetary outcomes, would also putatively engage intrinsic motivation. Task parameters related to exploration, enjoyment, achievement, and autonomy can each be modulated and computationally modeled to determine their effects on free choice or behavioral activation vigor.

Current computational approaches depend on modeling decision-making, outcome learning, or action-outcome associations to drive our understanding of motivation. Traditional decision-making models often rely on softmax functions to compute values of available actions (Wilson & Collins, Reference Wilson and Collins2019), where action selection is based on the ‘policy’ of the best outcome. Computationally, an action selection process computes the probability of an action occurring in any state and the expected reward. A policy is developed based on the assumption that motivated actions are performed to increase the probability of rewards and decrease the probability of punishment. Yet, in everyday life, our actions can be motivated by an arbitrary cue that may signal an internal rewarding state. For example, a standard algorithm solving for motivated action assumes that all actions have equal probability, yet this discounts the unknown drivers and evaluators of internal rewards. Hence, they act as limiting factors to the applicability of decision-making models in studies of intrinsic motivation.

Neuroimaging

Functional neuroimaging [e.g., functional magnetic resonance imaging (fMRI), electroencephalography (EEG)] offers a measurement modality that may be particularly apt for the study of internally driven processes like intrinsic motivation. Research using fMRI has characterized the neural correlates of various internal processes that lack clear behavioral indicators (e.g. rumination, emotion regulation, pain perception; Zhou et al., Reference Zhou, Li, Zhao, Xu, Zheng, Fu and Becker2020; Wagner, N'Diaye, Ethofer, and Vuilleumier, Reference Wagner, N'Diaye, Ethofer and Vuilleumier2011), yet few studies have assessed the neural correlates of intrinsic motivation in humans, which likely reflects the limitations in its behavioral measurement. Studies have largely assessed intrinsic motivation via comparisons with neural responses to extrinsic reinforcers during fMRI, which can be correlated with self-reported intrinsic motivation (Bengtsson, Lau, & Passingham, Reference Bengtsson, Lau and Passingham2009; Chew et al., Reference Chew, Blain, Dolan and Rutledge2021; Linke et al., Reference Linke, Kirsch, King, Gass, Hennerici, Bongers and Wessa2010). Despite the relative paucity of neuroimaging studies that clearly separate intrinsic v. extrinsic motivation, existing work provides preliminary insight into the neural circuitry of intrinsic motivation.

First, extrinsic reinforcers have elicited amygdala, ACC, ventromedial prefrontal cortex (vmPFC), orbitofrontal cortex (OFC), and ventral striatal (VS) or Nac activity in healthy subjects that was associated with higher self-reported extrinsic motivation but lower self-reported intrinsic motivation (Linke et al., Reference Linke, Kirsch, King, Gass, Hennerici, Bongers and Wessa2010). This could suggest that intrinsic motivation relates to a lower sensitivity of these regions to extrinsic reinforcers, general deactivation of these regions, or that the dampening impact of extrinsic reinforcers on intrinsic motivation is subserved by these regions. Others report that intrinsic motivation (operationalized as the amount of free-time spent on a puzzle-task, which did not relate to task enjoyment, interest, or accuracy), was associated with deactivation in the amygdala, dorsal ACC, dorsomedial striatum, and insula during puzzle-task onset (Marsden et al., Reference Marsden, Ma, Deci, Ryan and Chiu2014). This is another piece of evidence linking neural deactivation to intrinsic motivation; however, since these tasks were not related to traditional ‘intrinsic motivators’ like task enjoyment, findings may relate to boredom-reduction behavior that might be more related to punishment avoidance rather than intrinsic motivation per se.

Bengtsson et al. (Reference Bengtsson, Lau and Passingham2009) operationalized intrinsic motivation as task-performance with and without explicit experimental observation during fMRI scanning, which boosted self-reported intrinsic motivation. The authors found greater neural activation of ACC, OFC, and lateral prefrontal cortex during task-performance errors when participants were observed (Bengtsson et al., Reference Bengtsson, Lau and Passingham2009). While implicating a similar network of brain regions as prior studies, these findings cannot be divorced from error-related neural activation modulated by task salience (e.g. observed v. not).

In contrast, Murayama et al. (Reference Murayama, Matsumoto, Izuma and Matsumoto2010) provide a more optimal operationalization of intrinsic motivation, in which participants performed a task that was previously rated as inherently interesting, and successful task performance served as the intrinsic reward. During fMRI scanning, feedback for both extrinsic (monetary feedback) and intrinsic (accuracy feedback) rewards elicited VS activation. Participants then had the option to perform the same task without feedback, and intrinsic motivation was operationalized as time spent on the second version of the task. During the second session, VS activation was only diminished for extrinsic rewards, which could reflect reduced VS habituation to intrinsic rewards (Murayama et al., Reference Murayama, Matsumoto, Izuma and Matsumoto2010, Reference Murayama, Matsumoto, Izuma, Sugiura, Ryan, Deci and Matsumoto2015). Additionally, greater reductions in neural responses to extrinsic reinforcers were related to lower intrinsic motivation (i.e. task engagement time outside of the scanner), suggesting that neural habituation to extrinsic reinforcers may relate to lower intrinsic motivation. A recent computational neuroimaging study modeled intrinsic rewards as successful spatial-motor task performance without experienced errors, which was divorced from learning (Chew et al., Reference Chew, Blain, Dolan and Rutledge2021). This modeling of intrinsic rewards was akin to the accuracy feedback operationalization of Murayama et al. (Reference Murayama, Matsumoto, Izuma and Matsumoto2010). Both extrinsic (monetary) reward and intrinsic performance-based rewards (successful task completion) recruited vmPFC activation, which related to subjective happiness (Chew et al., Reference Chew, Blain, Dolan and Rutledge2021). Although limited in their ability to dissociate activation from task performance per se and explicit feedback related to achievement, these studies are the closest examples of objective measures of intrinsic motivation, and they suggest that putative reward-processing regions (VS, vmPFC) encode intrinsic rewards.

Complementary studies have examined how curiosity, or the intrinsic motivation to learn, modulates neural responses and influences memory recall (Gruber, Gelman, & Ranganath, Reference Gruber, Gelman and Ranganath2014; Kang et al., Reference Kang, Hsu, Krajbich, Loewenstein, McClure, Wang and Camerer2009). High-curiosity states augment midbrain and v. activity (Gruber et al., Reference Gruber, Gelman and Ranganath2014), as well as bilateral caudate (Kang et al., Reference Kang, Hsu, Krajbich, Loewenstein, McClure, Wang and Camerer2009) and anterior insula (Lee & Reeve, Reference Lee and Reeve2017) responses, which may improve learning and memory. As these paradigms index intrinsic motivation independently from a rewarding outcome, they perhaps provide the strongest support for partially overlapping circuits of extrinsic and intrinsic motivation.

Dopamine

The brain's dopamine system supports a range of appetitive and aversive motivational processes, including behavioral activation, exertion of effort, and sustained task engagement (Diederen & Fletcher, Reference Diederen and Fletcher2020; Salamone, Yohn, López-Cruz, San Miguel, & Correa, Reference Salamone, Yohn, López-Cruz, San Miguel and Correa2016). The mesolimbic pathway, projecting from the ventral tegmental area (VTA) to limbic regions, including the Nac, amygdala, and hippocampus, facilitates reinforcement and associative learning by acting as a ‘Go’ signal for foraging or exploration (Huang, Lv, & Wu, Reference Huang, Lv and Wu2016). Although it has long been known that dopamine transmission subserves motivational processes, some evidence suggests that it is particularly important for intrinsic motivation. For example, mesolimbic dopamine contributes to exploration for the sake of interest (DeYoung, Reference DeYoung2013; Panksepp & Moskal, Reference Panksepp, Moskal and Elliot2008), and novel and unexpected stimuli elicit phasic dopamine spikes in rodents (Fiorillo, Reference Fiorillo2003; Hooks & Kalivas, Reference Hooks and Kalivas1994; Schultz, Reference Schultz1998). In patients with depression, deep-brain stimulation of dopaminergic brain regions including the Nac (Schlaepfer et al., Reference Schlaepfer, Cohen, Frick, Kosel, Brodesser, Axmacher and Sturm2007) and the mesolimbic dopamine projections from the VTA (Fenoy et al., Reference Fenoy, Schulz, Selvaraj, Burrows, Zunta-Soares, Durkin and Soares2018) increased subjective interest in, and motivational energy for, previously enjoyable activities (Schlaepfer et al., Reference Schlaepfer, Cohen, Frick, Kosel, Brodesser, Axmacher and Sturm2007). Dopamine has also been associated with intrinsically motivated flow states (de Manzano et al., Reference de Manzano, Cervenka, Jucaite, Hellenäs, Farde and Ullén2013; Gyurkovics et al., Reference Gyurkovics, Kotyuk, Katonai, Horvath, Vereczkei and Szekely2016).

However, since VTA dopamine spiking is reduced for expected events (Schultz, Reference Schultz1998), it may not be a strong candidate neural mechanism for intrinsic motivation, which can occur for predictable activities. Efforts to reconcile the role of dopamine in learning and motivation suggest that while phasic cell firing signals RPEs (Kim et al., Reference Kim, Malik, Mikhael, Bech, Tsutsui-Kimura, Sun and Uchida2020), phasic dopamine release and local modulation in key regions, such as the VS/NAc, relates to approach motivation (Berke, Reference Berke2018; Mohebi et al., Reference Mohebi, Pettibone, Hamid, Wong, Vinson, Patriarchi and Berke2019). Indeed, while VTA dopamine cell firing occurs during reward prediction, only NAc dopamine release covaries with reward availability and ramps up during approach and consumption of reward (Mohebi et al., Reference Mohebi, Pettibone, Hamid, Wong, Vinson, Patriarchi and Berke2019). Moreover, increasing dopamine in rodents increases their willingness to exert effort, and this has since been replicated across species, including via pharmacological manipulation in humans (Salamone, Correa, Farrar, & Mingote, Reference Salamone, Correa, Farrar and Mingote2007; Treadway & Zald, Reference Treadway and Zald2011). This suggests that, while VTA dopamine spiking underpins reward prediction and learning, it is local NAc dopamine release that encodes motivational drive.

Opioids, norepinephrine, and related neurotransmitter systems

Though a comprehensive account of the neurotransmitter systems subserving motivated behavior is beyond the scope of this review, we note that endogenous opioid and cannabinoid systems may uniquely modulate intrinsically motivated behavior. For example, mu- and delta-opioid receptor activation underlies the pleasurable effects of opioid and non-opioid drugs of abuse (Berrendero, Robledo, Trigo, Martín-García, & Maldonado, Reference Berrendero, Robledo, Trigo, Martín-García and Maldonado2010; Trigo, Martin-García, Berrendero, Robledo, & Maldonado, Reference Trigo, Martin-García, Berrendero, Robledo and Maldonado2010), as well as primary reinforcers (Hsu et al., Reference Hsu, Sanford, Meyers, Love, Hazlett, Wang and Zubieta2013; Kelley & Berridge, Reference Kelley and Berridge2002). Activation of mu-opioid receptors has also been shown to mediate motivational states following delta-9-tetrahydrocannabinol (THC) administration in rodents (Ghozland et al., Reference Ghozland, Matthes, Simonin, Filliol, Kieffer and Maldonado2002), likely via interactions with the mesolimbic dopamine system. Further evidence implicates antidepressant effects of endogenous opioids in both animals and humans (Peciña et al., Reference Peciña, Karp, Mathew, Todtenkopf, Ehrich and Zubieta2018), which many partly reflect improved intrinsic motivation (e.g. time mice spent swimming during the forced swim test; Kastin, Scollan, Ehrensing, Schally, and Coy, Reference Kastin, Scollan, Ehrensing, Schally and Coy1978). Additionally, the endocannabinoid system interacts with both endogenous opioid and dopaminergic systems to influence intrinsic motivation, such as social play (Trezza et al., Reference Trezza, Damsteegt, Manduca, Petrosino, Van Kerkhof, Pasterkamp and Vanderschuren2012; Trezza & Vanderschuren, Reference Trezza and Vanderschuren2008), and voluntary exercise, in rodents (Dubreucq, Koehl, Abrous, Marsicano, & Chaouloff, Reference Dubreucq, Koehl, Abrous, Marsicano and Chaouloff2010). Since these systems have been primarily examined in animal models, pharmacological manipulation in humans would be an important next step in delineating the contribution of opioid and endocannabinoid systems to intrinsic v. extrinsic motivation.

Intrinsic motivation and psychiatry: focus on anhedonia

Problems with motivation are observed across many neuropsychiatric disorders, and these often correspond to distinct symptoms (Table 1). This section focuses on anhedonia, a reduced ability to experience pleasure (Ribot, Reference Ribot1986), as a prevalent clinical manifestation of deficient intrinsic and extrinsic motivation.

Table 1. Explicit studies of ‘intrinsic motivation’ in neuropsychiatric disorders

Note: Cohort abbreviations: AUD, alcohol use disorder; FEP, first-episode psychosis; MDD, major depressive disorder; PD, Parkinson's disease; SCZ, schizophrenia; SUDs, substance use disorders; SZA, schizoaffective disorder. Evidence abbreviations: EM, extrinsic motivation; IM, intrinsic motivation.

In the Diagnostic and Statistical Model of Mental Disorders, 5th edition (DSM-5), anhedonia serves as one of two cardinal symptoms of depressive disorders, where it is defined as the ‘loss of interest or pleasure in all, or almost all, activities’, (American Psychiatric Association, 2013). The second cardinal symptom relates to persistent depressed mood. Approximately one-third of individuals with depression report clinically significant anhedonia (Pelizza & Ferrari, Reference Pelizza and Ferrari2009), and these individuals are at-risk for poorer treatment outcomes, including nonresponse, relapse, and increased suicidality, relative to their non-anhedonic peers (Morris, Bylsma, & Rottenberg, Reference Morris, Bylsma and Rottenberg2009; Nierenberg et al., Reference Nierenberg, Keefe, Leslie, Alpert, Pava, Worthington and Fava1999).

Anhedonia remains an important clinical target that, by definition, implicates perturbations in intrinsically-motivated behavior, yet most empirical studies of anhedonia and motivation have investigated their relationship using extrinsic reinforcers. Findings broadly support theories of reward dysfunction in depression (reviewed by Sescousse, Caldú, Segura, and Dreher, Reference Sescousse, Caldú, Segura and Dreher2013; Roiser & Husain, 2018; Borsini, Wallis, Zunszain, Pariante, and Kempton, Reference Borsini, Wallis, Zunszain, Pariante and Kempton2020), where anhedonia has been associated with a reduced bias toward a monetary reward in individuals with depression (Liu et al., Reference Liu, Chan, Wang, Huang, Cheung, Gong and Gollan2011) and their first-degree relatives (Liu et al., Reference Liu, Roiser, Wang, Zhu, Huang, Neumann and Chan2016). Children who are at-risk for depression show reduced VS and anterior insula responses to monetary gains, implicating blunted reward sensitivity as an antecedent to anhedonia (Luking, Pagliaccio, Luby, & Barch, Reference Luking, Pagliaccio, Luby and Barch2016). Moreover, vmPFC responses during unexpected reward receipt may indirectly relate to anhedonia in depressed patients by modulating task motivation (Segarra et al., Reference Segarra, Metastasio, Ziauddeen, Spencer, Reinders, Dudas and Murray2016). Interestingly, reward sensitivity disturbances in depression might not extend to aberrant reward learning (Huys, Pizzagalli, Bogdan, & Dayan, Reference Huys, Pizzagalli, Bogdan and Dayan2013) where adults with moderate depression show intact VS RPE-signaling during probabilistic learning (Rutledge et al., Reference Rutledge, Moutoussis, Smittenaar, Zeidman, Taylor, Hrynkiewicz and Dolan2017). Nevertheless, there have been suggestions that perturbations in domains more related to intrinsic motivation, such as model-based future planning or effort initiation and invigoration, may be key in underlying anhedonia (Berwian et al., Reference Berwian, Wenzel, Collins, Seifritz, Stephan, Walter and Huys2020; Cooper, Arulpragasam, & Treadway, Reference Cooper, Arulpragasam and Treadway2018; Rutledge et al., Reference Rutledge, Moutoussis, Smittenaar, Zeidman, Taylor, Hrynkiewicz and Dolan2017). Finally, affect can also alter both the valence and evaluation of an activity, which can, in turn, modulate the likelihood of selecting a more inherently interesting task (Isen & Reeve, Reference Isen and Reeve2006). Anhedonic individuals have more pessimistic likelihood estimates and reduced positive affective forecasts relative to controls while also demonstrating greater reliance on negative emotion during future-oriented cognition (Marroquín & Nolen-Hoeksema, Reference Marroquín and Nolen-Hoeksema2015).

While few studies have implemented objective measures of intrinsic motivation in studying anhedonia, recent work links this symptom with difficulties with representations of future states during early stages of motivated behavior (Moutoussis et al., Reference Moutoussis, Rutledge, Prabhu, Hrynkiewicz, Lam, Ousdal, Guitart-Masip, Fonagy and Dolan2018). Since intrinsic motivation is driven more by proactive factors as opposed to the more reactive domain of extrinsic motivation, parsing future-oriented decision-making might provide novel insights not only into mechanisms of intrinsic motivation but also anhedonia. When considering the pre-decisional deliberation phase of motivated action (Fig. 1), the representation of a future state may be critical for distinguishing intrinsic v. extrinsic motivation. For example, disrupted representations of intrinsic reinforcers (e.g. autonomy, achievement, task enjoyment, novelty seeking), energy expenditure (Treadway, Cooper, & Miller, Reference Treadway, Cooper and Miller2019; Winch, Moberly, & Dickson, Reference Winch, Moberly and Dickson2014), or fatigue (Müller, Klein-Flügge, Manohar, Husain, & Apps, Reference Müller, Klein-Flügge, Manohar, Husain and Apps2021) might disrupt choice deliberation and interrupt ensuing stages of motivation. This could critically determine the capacity for self-generated, intrinsically-motivated actions (Husain & Roiser, Reference Husain and Roiser2018). However, relatively few studies have examined this distinction. One study developed a cognitive task that aimed to capture separate measures of self-generated (intrinsic) v. externally generated (extrinsic) motivation during the option-generation phase (Morris et al., Reference Morris, Norbury, Smith, Harrison, Voon and Murrough2020). This distinction linked self-generated option generation (intrinsic motivation) to anhedonia symptoms in healthy adults (Morris et al., Reference Morris, Norbury, Smith, Harrison, Voon and Murrough2020). However, this task still relies on extrinsic rewards, and there is a need for improved tasks that index both behavioral and neural correlates of intrinsic drivers of motivated behavior.

Summary and future directions

In this review, we summarize how intrinsic motivation has been conceptualized, measured, and related to neural function to elucidate its role in psychopathology. In contrast to extrinsic motivation, which has been rapidly incorporated into prominent cognitive, computational, and neurobiological models of human behavior, knowledge of intrinsic motivation remains limited due to evolving conceptualizations, imprecise measurement, and incomplete characterization of its biological correlates. We identify three potential areas of interest for future research.

First, additional objective measures of intrinsically motivation should be developed. This remains challenging experimentally since even the closest approximations of intrinsic motivation (Murayama et al., Reference Murayama, Matsumoto, Izuma and Matsumoto2010; Rutledge et al., Reference Rutledge, Moutoussis, Smittenaar, Zeidman, Taylor, Hrynkiewicz and Dolan2017) define the construct relative to extrinsic motivation, and other paradigms (e.g. exploration/exploitation tasks) rely on the presence of extrinsic reinforcers. Rather than defining motivated behavior as intrinsic or extrinsic, a more tractable approach might be to consider separate drivers of behavior that can be intrinsic or extrinsic. Future paradigms could index intrinsic motivation by characterizing the effects of intrinsic v. extrinsic reinforcers on motivation for an activity that is enjoyable. Such a design would enable more complex modeling of the effects of distinct reinforcers, and interactions between them, on motivated behavior, which would resolve inconsistencies surrounding the impact of extrinsic reinforcers on intrinsic motivation. For example, monetary incentives might reduce motivation only when a perceived agency is low, or when task enjoyment is high. These interactions might explain paradoxical observations like the undermining effect.

Second, computational models are needed to characterize intrinsic motivation. Computational models of motivation have been successfully implemented in studies of extrinsic motivation, yet few are appropriate for intrinsic motivation due to a focus on action-outcome associations. However, if the intrinsic reward were operationalized as a measurable outcome (e.g. completion of an enjoyable task), reinforcement-learning models could estimate how intrinsic reward value is represented. Advancements in the computational area could significantly improve understanding of the latent processes underlying (ab)normal decision-making, thereby identifying novel therapeutic targets.

Third, although evidence supports the bifurcation of intrinsic and extrinsic motivation at the psychological level, findings at the neural level are more equivocal. Given the overarching role of the mesolimbic dopamine system in learning, reward value estimation, and exploratory behavior, it is perhaps unsurprising that current evidence supports largely overlapping neural circuits for intrinsically and extrinsically motivated behavior. One potential avenue involves targeted pharmacological manipulations or neuromodulation of cortico-limbic circuits to determine if intrinsically and extrinsically motivated behaviors can be systematically modulated in humans. By elucidating the neural circuits of distinct motivational processes and their associations with specific symptom profiles, this approach would improve targeted interventions for highly heterogenous and debilitating disorders like depression.

Financial support

All authors report no financial disclosures. This work was supported by the National Institute of Mental Health (LSM, grant number K01MH120433) and the National Institute on Drug Abuse (MLW, T32DA022975).

References

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: American Psychiatric Association.Google Scholar
Andersson, H. W., Steinsbekk, A., Walderhaug, E., Otterholt, E., & Nordfjærn, T. (2018). Predictors of dropout from inpatient substance use treatment: A prospective cohort study. Substance Abuse: Research and Treatment, 12, 110. https://doi.org/10.1177/1178221818760551.Google ScholarPubMed
Badami, R., VaezMousavi, M., Wulf, G., & Namazizadeh, M. (2011). Feedback after good versus poor trials affects intrinsic motivation. Research Quarterly for Exercise and Sport, 82(2), 360364. https://doi.org/10.1080/02701367.2011.10599765.CrossRefGoogle ScholarPubMed
Badre, D., Doll, B. B., Long, N. M., & Frank, M. J. (2012). Rostrolateral prefrontal cortex and individual differences in uncertainty-driven exploration. Neuron, 73(3), 595607. https://doi.org/10.1016/j.neuron.2011.12.025.CrossRefGoogle ScholarPubMed
Bahorik, A., Eack, S. S., Cochran, G., Greeno, C., & Cornelius, C. (2015). The Longitudinal Impact of Intrinsic Motivation on Substance Use Severity in Schizophrenia and its Patterns in Men and Women. Retrieved March 2, 2022, from d-scholarship.pitt.edu website http://d-scholarship.pitt.edu/25060/.Google Scholar
Bahorik, A. L., Greeno, C. G., Cochran, G., Cornelius, J. R., & Eack, S. M. (2017). Motivation deficits and use of alcohol and illicit drugs among individuals with schizophrenia. Psychiatry Research, 253, 391397. https://doi.org/10.1016/j.psychres.2017.04.012.CrossRefGoogle ScholarPubMed
Barch, D. M., Yodkovik, N., Sypher-Locke, H., & Hanewinkel, M. (2008). Intrinsic motivation in schizophrenia: Relationships to cognitive function, depression, anxiety, and personality. Journal of Abnormal Psychology, 117(4), 776787. https://doi.org/10.1037/a0013944.CrossRefGoogle Scholar
Beckmann, J., & Heckhausen, H.. (2018). Motivation as a function of expectancy and incentive. In Heckhausen, J., & Heckhausen, H. (Eds.), Motivation and Action (2nd edn, pp. 99136). Cambridge: Cambridge University Press. https://doi.org/10.1017/cbo9780511499821.006Google Scholar
Bengtsson, S. L., Lau, H. C., & Passingham, R. E. (2009). Motivation to do well enhances responses to errors and self-monitoring. Cerebral Cortex, 19(4), 797804. https://doi.org/10.1093/cercor/bhn127.CrossRefGoogle Scholar
Berke, J.D. (2018). What does dopamine mean?. Nat Neurosci 21, 787793 . https://doi.org/10.1038/s41593-018-0152-yCrossRefGoogle ScholarPubMed
Berrendero, F., Robledo, P., Trigo, J. M., Martín-García, E., & Maldonado, R. (2010). Neurobiological mechanisms involved in nicotine dependence and reward: Participation of the endogenous opioid system. Neuroscience & Biobehavioral Reviews, 35(2), 220231. https://doi.org/10.1016/j.neubiorev.2010.02.006.CrossRefGoogle ScholarPubMed
Berridge, K. C., Robinson, T. E., & Aldridge, J. W. (2009). Dissecting components of reward: ‘liking’, ‘wanting’, and learning. Current Opinion in Pharmacology, 9(1), 6573. https://doi.org/10.1016/j.coph.2008.12.014.CrossRefGoogle Scholar
Berwian, I. M., Wenzel, J. G., Collins, A. G. E., Seifritz, E., Stephan, K. E., Walter, H., & Huys, Q. J. M. (2020). Computational mechanisms of effort and reward decisions in patients with depression and their association with relapse after antidepressant discontinuation. JAMA Psychiatry, 77(5), 513. https://doi.org/10.1001/jamapsychiatry.2019.4971.CrossRefGoogle ScholarPubMed
Bolles, R. C. (1972). Reinforcement, expectancy, and learning. Psychological Review, 79(5), 394409. https://doi.org/10.1037/h0033120.CrossRefGoogle Scholar
Borsini, A., Wallis, A. S. J., Zunszain, P., Pariante, C. M., & Kempton, M. J. (2020). Characterizing anhedonia: A systematic review of neuroimaging across the subtypes of reward processing deficits in depression. Cognitive, Affective, & Behavioral Neuroscience, 20(4), 816841. https://doi.org/10.3758/s13415-020-00804-6.CrossRefGoogle ScholarPubMed
Bowie, C. R., Gupta, M., Holshausen, K., Jokic, R., Best, M., & Milev, R. (2013). Cognitive remediation for treatment-resistant depression: Effects on cognition and functioning and the role of online homework. The Journal of Nervous and Mental Disease, 201(8), 680685. https://doi.org/10.1097/NMD.0b013e31829c5030.CrossRefGoogle ScholarPubMed
Brugger, F., Galovic, M., Weder, B. J., & Kägi, G. (2015). Supplementary motor complex and disturbed motor control – a retrospective clinical and lesion analysis of patients after anterior cerebral artery stroke. Frontiers in Neurology, 6, 209. https://doi.org/10.3389/fneur.2015.00209.CrossRefGoogle ScholarPubMed
Bryce, S. D., Lee, S. J., Ponsford, J. L., Lawrence, R. J., Tan, E. J., & Rossell, S. L. (2018). The impact of intrinsic motivation on session attendance and reliable cognitive improvement in cognitive remediation in schizophrenia. Schizophrenia Research, 202, 354360. https://doi.org/10.1016/j.schres.2018.06.028.CrossRefGoogle Scholar
Butler, R., & Nisan, M. (1986). Effects of no feedback, task-related comments, and grades on intrinsic motivation and performance. Journal of Educational Psychology, 78(3), 210216. https://doi.org/10.1037//0022-0663.78.3.210.CrossRefGoogle Scholar
Cameron, J., & Pierce, D. W. (2002). Rewards and intrinsic motivation: Resolving the controversy. Westport, CT: Bergin & Garvey.Google Scholar
Cecchini, J., González, C., Carmona, Á, Arruza, J., Escartí, A., & Balagué, G. (2001). The influence of the physical education teacher on intrinsic motivation, self-confidence, anxiety, and pre- and post-competition mood states. European Journal of Sport Science, 1(4), 111. https://doi.org/10.1080/17461390100071407.CrossRefGoogle Scholar
Cerasoli, C. P., Nicklin, J. M., & Ford, M. T. (2014). Intrinsic motivation and extrinsic incentives jointly predict performance: A 40-year meta-analysis. Psychological Bulletin, 140(4), 9801008. https://doi.org/10.1037/a0035661.CrossRefGoogle ScholarPubMed
Chew, B., Blain, B., Dolan, R. J., & Rutledge, R. B. (2021). A neurocomputational model for intrinsic reward. The Journal of Neuroscience, 41(43), 89638971. https://doi.org/10.1523/jneurosci.0858-20.2021.CrossRefGoogle ScholarPubMed
Chiviacowsky, S., Wulf, G., Lewthwaite, R., & Campos, T. (2012). Motor learning benefits of self-controlled practice in persons with Parkinson's disease. Gait & Posture, 35(4), 601605. https://doi.org/10.1016/j.gaitpost.2011.12.003.CrossRefGoogle ScholarPubMed
Choi, J., Choi, K.-H., Felice Reddy, L., & Fiszdon, J. M. (2014). Measuring motivation in schizophrenia: Is a general state of motivation necessary for task-specific motivation? Schizophrenia Research, 153(1–3), 209213. https://doi.org/10.1016/j.schres.2014.01.027.CrossRefGoogle ScholarPubMed
Choi, J., & Medalia, A. (2010). Intrinsic motivation and learning in a schizophrenia spectrum sample. Schizophrenia Research, 118(1–3), 1219. https://doi.org/10.1016/j.schres.2009.08.001.CrossRefGoogle Scholar
Cooper, J. A., Arulpragasam, A. R., & Treadway, M. T. (2018). Anhedonia in depression: Biological mechanisms and computational models. Current Opinion in Behavioral Sciences, 22, 128135. https://doi.org/10.1016/j.cobeha.2018.01.024.CrossRefGoogle ScholarPubMed
Cornelius, T., Earnshaw, V. A., Menino, D., Bogart, L. M., & Levy, S. (2017). Treatment motivation among caregivers and adolescents with substance use disorders. Journal of Substance Abuse Treatment, 75, 1016. https://doi.org/10.1016/j.jsat.2017.01.003.CrossRefGoogle ScholarPubMed
Csikszentmihalyi, M. (1975). Beyond boredom and anxiety. San Francisco: Jossey-Bass Publishers.Google Scholar
Curry, S. J., Grothaus, L., & McBride, C. (1997). Reasons for quitting: Intrinsic and extrinsic motivation for smoking cessation in a population-based sample of smokers. Addictive Behaviors, 22(6), 727739. https://doi.org/10.1016/s0306-4603(97)00059-2.CrossRefGoogle Scholar
Daniel, T. L., & Esser, J. K. (1980). Intrinsic motivation as influenced by rewards, task interest, and task structure. Journal of Applied Psychology, 65(5), 566573. https://doi.org/10.1037/0021-9010.65.5.566.CrossRefGoogle Scholar
Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006). Cortical substrates for exploratory decisions in humans. Nature, 441(7095), 876879. https://doi.org/10.1038/nature04766.CrossRefGoogle ScholarPubMed
DeCharms, R. (1968). Personal causation: The internal affective determinants of behavior. New York: Academic Press.Google Scholar
Deci, E. L. (1971). Effects of externally mediated rewards on intrinsic motivation. Journal of Personality and Social Psychology, 18(1), 105115. https://doi.org/10.1037/h0030644.CrossRefGoogle Scholar
Deci, E. L., Benware, C., & Landy, D. (1974). The attribution of motivation as a function of output and rewards. Journal of Personality, 42(4), 652667. https://doi.org/10.1111/j.1467-6494.1974.tb00699.x.CrossRefGoogle Scholar
Deci, E. L., Koestner, R., & Ryan, R. M. (1999). A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychological Bulletin, 125(6), 627668. https://doi.org/10.1037//0033-2909.125.6.627.CrossRefGoogle ScholarPubMed
Deci, E. L., & Ryan, R. M. (1980). The empirical exploration of intrinsic motivational processes. Advances in Experimental Social Psychology, 13, 3980. https://doi.org/10.1016/s0065-2601(08)60130-6.CrossRefGoogle Scholar
de Manzano, Ö, Cervenka, S., Jucaite, A., Hellenäs, O., Farde, L., & Ullén, F. (2013). Individual differences in the proneness to have flow experiences are linked to dopamine D2-receptor availability in the dorsal striatum. NeuroImage, 67, 16. https://doi.org/10.1016/j.neuroimage.2012.10.072.CrossRefGoogle ScholarPubMed
de Wit, S., Standing, H. R., DeVito, E. E., Robinson, O. J., Ridderinkhof, K. R., Robbins, T. W., & Sahakian, B. J. (2011). Reliance on habits at the expense of goal-directed control following dopamine precursor depletion. Psychopharmacology, 219(2), 621631. https://doi.org/10.1007/s00213-011-2563-2.CrossRefGoogle ScholarPubMed
DeYoung, C. G. (2013). The neuromodulator of exploration: A unifying theory of the role of dopamine in personality. Frontiers in Human Neuroscience, 7, 762. https://doi.org/10.3389/fnhum.2013.00762.CrossRefGoogle ScholarPubMed
Diederen, K. M. J., & Fletcher, P. C. (2020). Dopamine, prediction error and beyond. The Neuroscientist, 27(1), 3046. https://doi.org/10.1177/1073858420907591.CrossRefGoogle ScholarPubMed
Downey, L., Rosengren, D. B., & Donovan, D. M. (2001). Sources of motivation for abstinence. Addictive Behaviors, 26(1), 7989. https://doi.org/10.1016/s0306-4603(00)00090-3.CrossRefGoogle ScholarPubMed
Dubreucq, S., Koehl, M., Abrous, D. N., Marsicano, G., & Chaouloff, F. (2010). CB1 receptor deficiency decreases wheel-running activity: Consequences on emotional behaviours and hippocampal neurogenesis. Experimental Neurology, 224(1), 106113. https://doi.org/10.1016/j.expneurol.2010.01.017.CrossRefGoogle ScholarPubMed
Fenoy, A. J., Schulz, P. E., Selvaraj, S., Burrows, C. L., Zunta-Soares, G., Durkin, K., … Soares, J. C. (2018) A longitudinal study on deep brain stimulation of the medial forebrain bundle for treatment-resistant depression. Translational Psychiatry, 8(111), https://doi.org/10.1038/s41398-018-0160-4.CrossRefGoogle ScholarPubMed
Fervaha, G., Agid, O., Foussias, G., & Remington, G. (2014). Effect of intrinsic motivation on cognitive performance in schizophrenia: A pilot study. Schizophrenia Research, 152(1), 317318. https://doi.org/10.1016/j.schres.2013.11.037.CrossRefGoogle ScholarPubMed
Festinger, L. (1957). A theory of cognitive dissonance. The American Journal of Psychology, 72(1), 153. https://doi.org/10.2307/1420234.Google Scholar
Fiorillo, C. D. (2003). The uncertain nature of dopamine. Molecular Psychiatry, 9(2), 122123. https://doi.org/10.1038/sj.mp.4001445.CrossRefGoogle Scholar
Foerde, K., Braun, E. K., Higgins, E. T., & Shohamy, D. (2014). Motivational modes and learning in Parkinson's disease. Social Cognitive and Affective Neuroscience, 10(8), 10661073. https://doi.org/10.1093/scan/nsu152.CrossRefGoogle ScholarPubMed
Froiland, J. M., Worrell, F. C., Olenchak, F. R., & Kowalski, M. J. (2020). Positive and negative time attitudes, intrinsic motivation, behavioral engagement and substance use among urban adolescents. Addiction Research & Theory, 29(4), 347357. https://doi.org/10.1080/16066359.2020.1857740.CrossRefGoogle Scholar
Ghozland, S., Matthes, H. W. D., Simonin, F., Filliol, D., Kieffer, B. L., & Maldonado, R. (2002). Motivational effects of cannabinoids Are mediated by μ-opioid and κ-opioid receptors. The Journal of Neuroscience, 22(3), 11461154. https://doi.org/10.1523/jneurosci.22-03-01146.2002.CrossRefGoogle ScholarPubMed
Gillan, C. M., Robbins, T. W., Sahakian, B. J., van den Heuvel, O. A., & van Wingen, G. (2016). The role of habit in compulsivity. European Neuropsychopharmacology, 26(5), 828840. https://doi.org/10.1016/j.euroneuro.2015.12.033.CrossRefGoogle ScholarPubMed
Gittins, J. C., & Jones, D. M. (1979). A dynamic allocation index for the discounted multiarmed bandit problem. Biometrika, 66(3), 561565. https://doi.org/10.1093/biomet/66.3.561.CrossRefGoogle Scholar
Gläscher, J., Daw, N., Dayan, P., & O'Doherty, J. P. (2010). States versus rewards: Dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron, 66(4), 585595. https://doi.org/10.1016/j.neuron.2010.04.016.CrossRefGoogle ScholarPubMed
Gottlieb, J., Lopes, M., & Oudeyer, P.-Y. (2016). Motivated cognition: Neural and computational mechanisms of curiosity, attention, and intrinsic motivation. In Kim, S., Reeve, J. & Bong, M. (Eds.), Recent developments in neuroscience research on human motivation (pp. 149172). Bingley: Emerald Group Publishing Limited.CrossRefGoogle Scholar
Gruber, M. J., Gelman,, B. D., & Ranganath, C. (2014). States of curiosity modulate hippocampus-dependent learning via the dopaminergic circuit. Neuron, 84(2), 486496. https://doi.org/10.1016/j.neuron.2014.08.060.CrossRefGoogle ScholarPubMed
Gyurkovics, M., Kotyuk, E., Katonai, E. R., Horvath, E. Z., Vereczkei, A., & Szekely, A. (2016). Individual differences in flow proneness are linked to a dopamine D2 receptor gene variant. Consciousness and Cognition, 42, 18. https://doi.org/10.1016/j.concog.2016.02.014.CrossRefGoogle ScholarPubMed
Harlow, H. F. (1950). Learning and satiation of response in intrinsically motivated complex puzzle performance by monkeys. Journal of Comparative and Physiological Psychology, 43(4), 289294. https://doi.org/10.1037/h0058114.CrossRefGoogle ScholarPubMed
Hebb, D. O. (1949). The organization of behavior: A neuropsychological theory. London: Wiley.Google Scholar
Hebb, D. O. (1955). Drives and the C. N. S. (conceptual nervous system). Psychological Review, 62(4), 243254. https://doi.org/10.1037/h0041823.CrossRefGoogle Scholar
Heckhausen, H. (1989). Motivation und Handeln. Springer-Lehrbuch (2nd ed.) Berlin, Heidelberg: Springer.Google Scholar
Heckhausen, H., & Heckhausen, J. (2018). Motivation and action. Cham: Springer.CrossRefGoogle Scholar
Hooks, M. S., & Kalivas, P. W. (1994). Involvement of dopamine and excitatory amino acid transmission in novelty-induced motor activity. The Journal of Pharmacology and Experimental Therapeutics, 269(3), 976988.Google ScholarPubMed
Hsu, D. T., Sanford, B. J., Meyers, K. K., Love, T. M., Hazlett, K. E., Wang, H., … Zubieta, J.-K. (2013). Response of the μ-opioid system to social rejection and acceptance. Molecular Psychiatry, 18(11), 12111217. https://doi.org/10.1038/mp.2013.96.CrossRefGoogle ScholarPubMed
Huang, Y., Lv, W., & Wu, J. (2016). Relationship between intrinsic motivation and undergraduate students’ depression and stress. Psychological Reports, 119(2), 527538. https://doi.org/10.1177/0033294116661512.CrossRefGoogle ScholarPubMed
Hull, C. L. (1943). Principles of behavior: An introduction to behavior theory. New York, NY: Appleton Century Crofts.Google Scholar
Husain, M., & Roiser, J. P. (2018). Neuroscience of apathy and anhedonia: A transdiagnostic approach. Nature Reviews Neuroscience, 19(8), 470484. https://doi.org/10.1038/s41583-018-0029-9.CrossRefGoogle ScholarPubMed
Huys, Q. J., Pizzagalli, D. A., Bogdan, R., & Dayan, P. (2013). Mapping anhedonia onto reinforcement learning: A behavioural meta-analysis. Biology of Mood & Anxiety Disorders, 3(1), 12. https://doi.org/10.1186/2045-5380-3-12.CrossRefGoogle ScholarPubMed
Isen, A. M., & Reeve, J. (2006). The influence of positive affect on intrinsic and extrinsic motivation: Facilitating enjoyment of play, responsible work behavior, and self-control. Motivation and Emotion, 29(4), 295323. https://doi.org/10.1007/s11031-006-9019-8.CrossRefGoogle Scholar
Kagan, J. (1972). Motives and development. Journal of Personality and Social Psychology, 22(1), 5166. https://doi.org/10.1037/h0032356.CrossRefGoogle ScholarPubMed
Kagan, J., & Moss, H. A. (1983). Birth to maturity: A study in psychological development. New Haven: Yale University Press.CrossRefGoogle Scholar
Kang, M. J., Hsu, M., Krajbich, I. M., Loewenstein, G., McClure, S. M., Wang, J. T., & Camerer, C. F. (2009). The wick in the candle of learning. Psychological Science, 20(8), 963973. https://doi.org/10.1111/j.1467-9280.2009.02402.x.CrossRefGoogle Scholar
Kaplan, F., & Oudeyer, P.-Y. (2007). In search of the neural circuits of intrinsic motivation. Frontiers in Neuroscience, 1(1), 225236. https://doi.org/10.3389/neuro.01.1.1.017.2007.CrossRefGoogle ScholarPubMed
Kastin, A. J., Scollan, E. L., Ehrensing, R. H., Schally, A. V., & Coy, D. H. (1978). Enkephalin and other peptides reduce passiveness. Pharmacology Biochemistry and Behavior, 9(4), 515519. https://doi.org/10.1016/0091-3057(78)90051-5.CrossRefGoogle ScholarPubMed
Kelley, A. E., & Berridge, K. C. (2002). The neuroscience of natural rewards: Relevance to addictive drugs. Journal of Neuroscience, 22(9), 33063311. https://doi.org/10.1523/JNEUROSCI.22-09-03306.2002.CrossRefGoogle ScholarPubMed
Kim, H. R., Malik, A. N., Mikhael, J. G., Bech, P., Tsutsui-Kimura, I., Sun, F., … Uchida, N. (2020). A unified framework for dopamine signals across timescales. Cell, 183(6), 16001616.e25. https://doi.org/10.1016/j.cell.2020.11.013.CrossRefGoogle ScholarPubMed
Lamal, P. (2003). Are rewards bad for us? The Educational Forum, 67(1), 9293. https://doi.org/10.1080/00131720208984539.CrossRefGoogle Scholar
Laplane, D., Baulac, M., Widlocher, D., & Dubois, B. (1984). Pure psychic akinesia with bilateral lesions of basal ganglia. Journal of Neurology, Neurosurgery & Psychiatry, 47(4), 377385. https://doi.org/10.1136/jnnp.47.4.377.CrossRefGoogle ScholarPubMed
Lee, W., & Reeve, J. (2017). Identifying the neural substrates of intrinsic motivation during task performance. Cognitive, Affective, & Behavioral Neuroscience, 17(5), 939953. https://doi.org/10.3758/s13415-017-0524-x.CrossRefGoogle ScholarPubMed
Lepper, M. R., & Greene, D. (1978). The hidden costs of reward: New perspectives on the psychology of human motivation. Lawrence Erlbaum.Google Scholar
Lepper, M. R., Greene, D., & Nisbett, R. E. (1973). Undermining children's intrinsic interest with extrinsic reward: A test of the ‘overjustification’ hypothesis. Journal of Personality and Social Psychology, 28(1), 129137. https://doi.org/10.1037/h0035519.CrossRefGoogle Scholar
Lepper, M. R., Keavney, M., & Drake, M. (1996). Intrinsic motivation and extrinsic rewards: A commentary on cameron and pierce's meta-analysis. Review of Educational Research, 66(1), 532. https://doi.org/10.3102/00346543066001005.CrossRefGoogle Scholar
Lewin, K. (1951). Intention, will and need. In Rapaport, D. (Ed.), Organization and Pathology of Thought: Selected Sources (pp. 95153). Columbia University Press. https://doi.org/10.1037/10584-005.Google Scholar
Linke, J., Kirsch, P., King, A. V., Gass, A., Hennerici, M. G., Bongers, A., & Wessa, M. (2010). Motivational orientation modulates the neural response to reward. NeuroImage, 49(3), 26182625. https://doi.org/10.1016/j.neuroimage.2009.09.013.CrossRefGoogle ScholarPubMed
Liu, W., Chan, R. C. K., Wang, L., Huang, J., Cheung, E. F. C., Gong, Q., & Gollan, J. K. (2011). Deficits in sustaining reward responses in subsyndromal and syndromal major depression. Progress in Neuro-Psychopharmacology and Biological Psychiatry, 35(4), 10451052. https://doi.org/10.1016/j.pnpbp.2011.02.018.CrossRefGoogle ScholarPubMed
Liu, W., Roiser, J. P., Wang, L., Zhu, Y., Huang, J., Neumann, D. L., … Chan, R. C. K. (2016). Anhedonia is associated with blunted reward sensitivity in first-degree relatives of patients with major depression. Journal of Affective Disorders, 190, 640648. https://doi.org/10.1016/j.jad.2015.10.050.CrossRefGoogle ScholarPubMed
Liu, Y., & Hou, S. (2017). Potential reciprocal relationship between motivation and achievement: A longitudinal study. School Psychology International, 39(1), 3855. https://doi.org/10.1177/0143034317710574.Google Scholar
Lu, L. (1999). Work motivation, job stress and employees’ well-being. Journal of Applied Management Studies, 8(1), 61.Google Scholar
Lugaresi, A., Montagna, P., Morreale, A., & Gallassi, R. (1990). ‘Psychic akinesia’ following carbon monoxide poisoning. European Neurology, 30(3), 167169. https://doi.org/10.1159/000117337.CrossRefGoogle ScholarPubMed
Luking, K. R., Pagliaccio, D., Luby, J. L., & Barch, D. M. (2016). Depression risk predicts blunted neural responses to gains and enhanced responses to losses in healthy children. Journal of the American Academy of Child & Adolescent Psychiatry, 55(4), 328337. https://doi.org/10.1016/j.jaac.2016.01.007.CrossRefGoogle ScholarPubMed
Luther, L., Firmin, R. L., Vohs, J. L., Buck, K. D., Rand, K. L., & Lysaker, P. H. (2016). Intrinsic motivation as a mediator between metacognition deficits and impaired functioning in psychosis. British Journal of Clinical Psychology, 55(3), 332347. https://doi.org/10.1111/bjc.12104.CrossRefGoogle ScholarPubMed
Luther, L., Lysaker, P. H., Firmin, R. L., Breier, A., & Vohs, J. L. (2015). Intrinsic motivation and amotivation in first episode and prolonged psychosis. Schizophrenia Research, 169(1–3), 418422. https://doi.org/10.1016/j.schres.2015.08.040.CrossRefGoogle ScholarPubMed
Mansouri, F. A., Koechlin, E., Rosa, M. G. P., & Buckley, M. J. (2017). Managing competing goals – a key role for the frontopolar cortex. Nature Reviews Neuroscience, 18(11), 645657. https://doi.org/10.1038/nrn.2017.111.CrossRefGoogle ScholarPubMed
Marroquín, B., & Nolen-Hoeksema, S. (2015). Emotion regulation and depressive symptoms: Close relationships as social context and influence. Journal of Personality and Social Psychology, 109(5), 836855. https://doi.org/10.1037/pspi0000034.CrossRefGoogle ScholarPubMed
Marsden, K. E., Ma, W. J., Deci, E. L., Ryan, R. M., & Chiu, P. H. (2014). Diminished neural responses predict enhanced intrinsic motivation and sensitivity to external incentive. Cognitive, Affective, & Behavioral Neuroscience, 15(2), 276286. https://doi.org/10.3758/s13415-014-0324-5.CrossRefGoogle Scholar
McClelland, D. C., Atkinson, J. W., Clark, R. A., & Lowell, E. L. (1967). The affective arousal model of motivation. In Haber, R. N. (Ed.), Current research in motivation. New York: Holt, Rinehart And Winston Inc.Google Scholar
McClelland, D. C., & Clark, R. A. (1953). Discrepancy hypothesis. In Mcclelland, D. C., Atkinson, J. W., Clark, R. A. & Lowell, E. L. (Eds.), The achievement motive. New York: Appleton-Century-Crofts.CrossRefGoogle Scholar
Mills, D. J., Li Anthony, W., & Nower, L. (2020). General motivations, basic psychological needs, and problem gambling: Applying the framework of self-determination theory. Addiction Research & Theory, 29(2), 175182. https://doi.org/10.1080/16066359.2020.1787389.CrossRefGoogle Scholar
Mohebi, A., Pettibone, J. R., Hamid, A. A., Wong, J.-M. T., Vinson, L. T., Patriarchi, T., … Berke, J. D. (2019). Dissociable dopamine dynamics for learning and motivation. Nature, 57, 6570. https://doi.org/10.1038/s41586-019-1235-y.CrossRefGoogle Scholar
Montague, P., Dayan, P., & Sejnowski, T. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. The Journal of Neuroscience, 16(5), 19361947. https://doi.org/10.1523/jneurosci.16-05-01936.1996.CrossRefGoogle ScholarPubMed
Mori, A., Okamoto, Y., Okada, G., Takagaki, K., Takamura, M., Jinnin, R., … Yamawaki, S. (2018). Effects of behavioural activation on the neural circuit related to intrinsic motivation. BJPsych Open, 4(5), 317323. https://doi.org/10.1192/bjo.2018.40.CrossRefGoogle ScholarPubMed
Morris, B. H., Bylsma, L. M., & Rottenberg, J. (2009). Does emotion predict the course of major depressive disorder? A review of prospective studies. British Journal of Clinical Psychology, 48(3), 255273. https://doi.org/10.1348/014466508x396549.CrossRefGoogle ScholarPubMed
Morris, L. S., Norbury, A., Smith, D. A., Harrison, N. A., Voon, V., & Murrough, J. W. (2020). Dissociating self-generated volition from externally-generated motivation. PLoS One, 15(5), e0232949. https://doi.org/10.1371/journal.pone.0232949.CrossRefGoogle ScholarPubMed
Moutoussis, M., Rutledge, R. B., Prabhu, G., Hrynkiewicz, L., Lam, J., Ousdal, O.-T., Guitart-Masip, M., Fonagy, P., & Dolan, R. J. (2018). Neural activity and fundamental learning, motivated by monetary loss and reward, are intact in mild to moderate major depressive disorder. PLoS ONE, 13(8), e0201451. https://doi.org/10.1371/journal.pone.0201451CrossRefGoogle ScholarPubMed
Müller, T., Klein-Flügge, M. C., Manohar, S. G., Husain, M., & Apps, M. A. J. (2021). Neural and computational mechanisms of momentary fatigue and persistence in effort-based choice. Nature Communications, 12(1), 4593. https://doi.org/10.1038/s41467-021-24927-7.CrossRefGoogle ScholarPubMed
Murayama, K., Matsumoto, M., Izuma, K., & Matsumoto, K. (2010). Neural basis of the undermining effect of monetary reward on intrinsic motivation. Proceedings of the National Academy of Sciences, 107(49), 2091120916. https://doi.org/10.1073/pnas.1013305107.CrossRefGoogle ScholarPubMed
Murayama, K., Matsumoto, M., Izuma, K., Sugiura, A., Ryan, R. M., Deci, E. L., & Matsumoto, K. (2015). How self-determined choice facilitates performance: A key role of the ventromedial prefrontal cortex. Cerebral Cortex, 25(5), 12411251. https://doi.org/10.1093/cercor/bht317.CrossRefGoogle ScholarPubMed
Nachev, P., Kennard, C., & Husain, M. (2008). Functional role of the supplementary and pre-supplementary motor areas. Nature Reviews Neuroscience, 9(11), 856869. https://doi.org/10.1038/nrn2478.CrossRefGoogle ScholarPubMed
Nakagami, E., Hoe, M., & Brekke, J. S. (2010). The prospective relationships among intrinsic motivation, neurocognition, and psychosocial functioning in schizophrenia. Schizophrenia Bulletin, 36(5), 935948. https://doi.org/10.1093/schbul/sbq043.CrossRefGoogle Scholar
Nakagami, E., Xie, B., Hoe, M., & Brekke, J. S. (2008). Intrinsic motivation, neurocognition and psychosocial functioning in schizophrenia: Testing mediator and moderator effects. Schizophrenia Research, 105(1–3), 95104. https://doi.org/10.1016/j.schres.2008.06.015.CrossRefGoogle ScholarPubMed
Nakamura, J., & Csikszentmihalyi, M. (2009). Flow theory and research. In Lopez, S. J. & Snyder, C. R. (Eds.), The Oxford handbook of positive psychology (pp. 195206). Oxford University Press.Google Scholar
Nierenberg, A. A., Keefe, B. R., Leslie, V. C., Alpert, J. E., Pava, J. A., Worthington, J. J., … Fava, M. (1999). Residual symptoms in depressed patients who respond acutely to fluoxetine. The Journal of Clinical Psychiatry, 60(4), 221225. https://doi.org/10.4088/jcp.v60n0403.CrossRefGoogle ScholarPubMed
Nissen, H. W. (1930). A study of exploratory behavior in the white rat by means of the obstruction method. The Pedagogical Seminary and Journal of Genetic Psychology, 37(3), 361376. https://doi.org/10.1080/08856559.1930.9944162.CrossRefGoogle Scholar
Panksepp, J., & Moskal, J. (2008). Dopamine and SEEKING: Subcortical ‘reward’ systems and appetitive urges. In Elliot, A. J. (Ed.), Handbook of approach and avoidance motivation (pp. 6787). New York: Psychology Press.Google Scholar
Peciña, M., Karp, J. F., Mathew, S., Todtenkopf, M. S., Ehrich, E. W., & Zubieta, J.-K. (2018). Endogenous opioid system dysregulation in depression: Implications for new therapeutic approaches. Molecular Psychiatry, 24(4), 576587. https://doi.org/10.1038/s41380-018-0117-2.CrossRefGoogle ScholarPubMed
Pelizza, L., & Ferrari, A. (2009). Anhedonia in schizophrenia and major depression: State or trait? Annals of General Psychiatry, 8, 22. https://doi.org/10.1186/1744-859x-8-22.CrossRefGoogle ScholarPubMed
Pintrich, P. R., & De Groot, E. V. (1990). Motivational and self-regulated learning components of classroom academic performance. Journal of Educational Psychology, 82(1), 3340. https://doi.org/10.1037/0022-0663.82.1.33.CrossRefGoogle Scholar
Ribot, T. (1986). La Psychologie des Sentiment [The psychology of feelings]. Paris: Felix Alcan.Google Scholar
Robbins, H. (1952). Some aspects of the sequential design of experiments. Bulletin of the American Mathematical Society, 58(5), 527536. https://doi.org/10.1090/s0002-9904-1952-09620-8.CrossRefGoogle Scholar
Robbins, T. W., Gillan, C. M., Smith, D. G., de Wit, S., & Ersche, K. D. (2012). Neurocognitive endophenotypes of impulsivity and compulsivity: Towards dimensional psychiatry. Trends in Cognitive Sciences, 16(1), 8191. https://doi.org/10.1016/j.tics.2011.11.009.CrossRefGoogle ScholarPubMed
Rodriguez, L. M., Neighbors, C., Rinker, D. V., & Tackett, J. L. (2014). Motivational profiles of gambling behavior: Self-determination theory, gambling motives, and gambling behavior. Journal of Gambling Studies, 31(4), 15971615. https://doi.org/10.1007/s10899-014-9497-7.CrossRefGoogle Scholar
Rutledge, R. B., Moutoussis, M., Smittenaar, P., Zeidman, P., Taylor, T., Hrynkiewicz, L., … Dolan, R. J. (2017). Association of neural and emotional impacts of reward prediction errors with major depression. JAMA Psychiatry, 74(8), 790797. https://doi.org/10.1001/jamapsychiatry.2017.1713.CrossRefGoogle ScholarPubMed
Ryan, R. M. (1982). Control and information in the intrapersonal sphere: An extension of cognitive evaluation theory. Journal of Personality and Social Psychology, 43(3), 450461. https://doi.org/10.1037/0022-3514.43.3.450.CrossRefGoogle Scholar
Salamone, J. D., Correa, M., Farrar, A., & Mingote, S. M. (2007). Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology, 191(3), 461482. https://doi.org/10.1007/s00213-006-0668-9.CrossRefGoogle ScholarPubMed
Salamone, J. D., Yohn, S. E., López-Cruz, L., San Miguel, N., & Correa, M. (2016). Activational and effort-related aspects of motivation: Neural mechanisms and implications for psychopathology. Brain, 139(5), 13251347. https://doi.org/10.1093/brain/aww050.CrossRefGoogle ScholarPubMed
Scherer, K. R. (2009). Emotions are emergent processes: They require a dynamic computational architecture. Philosophical Transactions of the Royal Society B: Biological Sciences, 364(1535), 34593474. https://doi.org/10.1098/rstb.2009.0141.CrossRefGoogle ScholarPubMed
Schlaepfer, T. E., Cohen, M. X., Frick, C., Kosel, M., Brodesser, D., Axmacher, N., … Sturm, V. (2007). Deep brain stimulation to reward circuitry alleviates anhedonia in refractory major depression. Neuropsychopharmacology, 33(2), 368377. https://doi.org/10.1038/sj.npp.1301408.CrossRefGoogle ScholarPubMed
Schultz, W. (1998). Predictive reward signal of dopamine neurons. Journal of Neurophysiology, 80(1), 127. https://doi.org/10.1152/jn.1998.80.1.1.CrossRefGoogle ScholarPubMed
Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science (New York, N.Y.), 275(5306), 15931599. https://doi.org/10.1126/science.275.5306.1593.CrossRefGoogle ScholarPubMed
Segarra, N., Metastasio, A., Ziauddeen, H., Spencer, J., Reinders, N. R., Dudas, R. B., … Murray, G. K. (2016). Abnormal frontostriatal activity during unexpected reward receipt in depression and schizophrenia: Relationship to anhedonia. Neuropsychopharmacology: Official Publication of the American College of Neuropsychopharmacology, 41(8), 20012010. https://doi.org/10.1038/npp.2015.370.CrossRefGoogle ScholarPubMed
Seo, D., Funderburk, S. C., Bhatti, D. L., Motard, L. E., Newbold, D., Girven, K. S., … Bruchas, M. R. (2016). A GABAergic projection from the centromedial nuclei of the amygdala to ventromedial prefrontal cortex modulates reward behavior. The Journal of Neuroscience, 36(42), 1083110842. https://doi.org/10.1523/jneurosci.1164-16.2016.CrossRefGoogle ScholarPubMed
Sescousse, G., Caldú, X., Segura, B., & Dreher, J.-C. (2013). Processing of primary and secondary rewards: A quantitative meta-analysis and review of human functional neuroimaging studies. Neuroscience & Biobehavioral Reviews, 37(4), 681696. https://doi.org/10.1016/j.neubiorev.2013.02.002.CrossRefGoogle ScholarPubMed
Shamloo, Z. S., & Cox, W. M. (2010). The relationship between motivational structure, sense of control, intrinsic motivation and university students’ alcohol consumption. Addictive Behaviors, 35(2), 140146. https://doi.org/10.1016/j.addbeh.2009.09.021.CrossRefGoogle ScholarPubMed
Sheehan, R. B., Herring, M. P., & Campbell, M. J. (2018). Associations between motivation and mental health in sport: A test of the hierarchical model of intrinsic and extrinsic motivation. Frontiers in Psychology, 9, 707. https://doi.org/10.3389/fpsyg.2018.00707.CrossRefGoogle ScholarPubMed
Shigemune, Y., Kawasaki, I., Midorikawa, A., Baba, T., Takeda, A., & Abe, N. (2021). Intrinsic motivation in patients with Parkinson's disease: A neuropsychological investigation of curiosity using dopamine transporter imaging. Neurological Sciences, 42(8), 33493356. https://doi.org/10.1007/s10072-020-04968-4.CrossRefGoogle ScholarPubMed
Skinner, B. F. (1938). The behavior of organisms: An experimental analysis. Acton, MA: Copley Publ. Group.Google Scholar
Strombach, T., Strang, S., Park, S. Q., & Kenning, P. (2016). Common and distinctive approaches to motivation in different disciplines. Motivation – Theory, Neurobiology and Applications, 229, 323. https://doi.org/10.1016/bs.pbr.2016.06.007.CrossRefGoogle ScholarPubMed
Sun, Y., & Chen, X. (2017). A randomized controlled clinical trial of a core stability exercise program for the intrinsic motivation of Parkinson's patients. NeuroQuantology, 15(4), 139145. https://doi.org/10.14704/nq.2017.15.4.1144.CrossRefGoogle Scholar
Sutton, R. S., & Barto, A. G. (1981). Toward a modern theory of adaptive networks: Expectation and prediction. Psychological Review, 88(2), 135170. https://doi.org/10.1037/0033-295x.88.2.135.CrossRefGoogle Scholar
Takeda, K., Matsumoto, M., Ogata, Y., Maida, K., Murakami, H., Murayama, K., … Nakagome, K. (2017). Impaired prefrontal activity to regulate the intrinsic motivation-action link in schizophrenia. NeuroImage: Clinical, 16, 3242. https://doi.org/10.1016/j.nicl.2017.07.003.CrossRefGoogle Scholar
Tas, C., Brown, E. C., Esen-Danaci, A., Lysaker, P. H., & Brüne, M. (2012). Intrinsic motivation and metacognition as predictors of learning potential in patients with remitted schizophrenia. Journal of Psychiatric Research, 46(8), 10861092. https://doi.org/10.1016/j.jpsychires.2012.04.027.CrossRefGoogle ScholarPubMed
Thorndike, E. L. (1911). Animal intelligence: Experimental studies. New York: The Macmillan Company. https://doi.org/10.5962/bhl.title.55072.CrossRefGoogle Scholar
Tolman, E. C. (1932). Purposive behavior in animals and men. New York, NY: Century/Random House UK.Google Scholar
Treadway, M. T., Cooper, J. A., & Miller, A. H. (2019). Can't or won't? Immunometabolic constraints on dopaminergic drive. Trends in Cognitive Sciences, 23(5), 435448. https://doi.org/10.1016/j.tics.2019.03.003.CrossRefGoogle ScholarPubMed
Treadway, M. T., & Zald, D. H. (2011). Reconsidering anhedonia in depression: Lessons from translational neuroscience. Neuroscience and Biobehavioral Reviews, 35(3), 537555. https://doi.org/10.1016/j.neubiorev.2010.06.006.CrossRefGoogle ScholarPubMed
Trezza, V., Damsteegt, R., Manduca, A., Petrosino, S., Van Kerkhof, L. W. M., Pasterkamp, R. J., … Vanderschuren, L. J. M. J. (2012). Endocannabinoids in amygdala and nucleus accumbens mediate social play reward in adolescent rats. Journal of Neuroscience, 32(43), 1489914908. https://doi.org/10.1523/jneurosci.0114-12.2012.CrossRefGoogle ScholarPubMed
Trezza, V., & Vanderschuren, L. J. M. J. (2008). Cannabinoid and opioid modulation of social play behavior in adolescent rats: Differential behavioral mechanisms. European Neuropsychopharmacology, 18(7), 519530. https://doi.org/10.1016/j.euroneuro.2008.03.001.CrossRefGoogle ScholarPubMed
Trigo, J. M., Martin-García, E., Berrendero, F., Robledo, P., & Maldonado, R. (2010). The endogenous opioid system: A common substrate in drug addiction. Drug and Alcohol Dependence, 108(3), 183194. https://doi.org/10.1016/j.drugalcdep.2009.10.011.CrossRefGoogle ScholarPubMed
Vandercammen, L., Hofmans, J., & Theuns, P. (2014). Relating specific emotions to intrinsic motivation: On the moderating role of positive and negative emotion differentiation. PLoS ONE, 9(12), e115396. https://doi.org/10.1371/journal.pone.0115396.CrossRefGoogle ScholarPubMed
Vohs, J. L., & Lysaker, P. H. (2014). Metacognitive mastery and intrinsic motivation in schizophrenia. The Journal of Nervous and Mental Disease, 202(1), 7477. https://doi.org/10.1097/nmd.0000000000000063.CrossRefGoogle Scholar
Vohs, J. L., Lysaker, P. H., & Nabors, L. (2013). Associations of personality with intrinsic motivation in schizophrenia. Psychiatry Research, 208(1), 7880. https://doi.org/10.1016/j.psychres.2013.03.008.CrossRefGoogle Scholar
Voon, V., Derbyshire, K., Rück, C., Irvine, M. A., Worbe, Y., Enander, J., … Bullmore, E. T. (2014). Disorders of compulsivity: A common bias towards learning habits. Molecular Psychiatry, 20(3), 345352. https://doi.org/10.1038/mp.2014.44.CrossRefGoogle ScholarPubMed
Von Culin, K. R., Tsukayama, E., & Duckworth, A. L. (2014). Unpacking grit: Motivational correlates of perseverance and passion for long-term goals. The Journal of Positive Psychology, 9(4), 306312. https://doi.org/10.1080/17439760.2014.898320.CrossRefGoogle ScholarPubMed
Wagner, U., N'Diaye, K., Ethofer, T., & Vuilleumier, P. (2011). Guilt-specific processing in the prefrontal cortex. Cerebral Cortex, 21(11), 24612470. https://doi.org/10.1093/cercor/bhr016.CrossRefGoogle ScholarPubMed
Watson, J. B. (1913). Psychology as the behaviorist views it. Psychological Review, 20(2), 158177. https://doi.org/10.1037/h0074428.CrossRefGoogle Scholar
Watson, J. B. (1930). Behaviorism. New York: W.W. Norton & Company, Inc.Google Scholar
Wilson, RC, Collins, AG. Ten simple rules for the computational modeling of behavioral data. Elife 26(8), e49547. doi: 10.7554/eLife.49547.Google Scholar
Winch, A., Moberly, N. J., & Dickson, J. M. (2014). Unique associations between anxiety, depression and motives for approach and avoidance goal pursuit. Cognition and Emotion, 29(7), 12951305. https://doi.org/10.1080/02699931.2014.976544.CrossRefGoogle ScholarPubMed
Witten, I. H. (1977). An adaptive optimal controller for discrete-time Markov environments. Information and Control, 34(4), 286295. https://doi.org/10.1016/s0019-9958(77)90354-0.CrossRefGoogle Scholar
Woodworth, R. S. (1918). Dynamic psychology. New York: Columbia University Press.CrossRefGoogle Scholar
Woodworth, R. S. (1921). Psychology: A study of mental life. Henry Holt And Co.CrossRefGoogle Scholar
Yamada, A.-M., Lee, K. K., Dinh, T. Q., Barrio, C., & Brekke, J. S. (2010). Intrinsic motivation as a mediator of relationships between symptoms and functioning among individuals with schizophrenia spectrum disorders in a diverse urban community. The Journal of Nervous and Mental Disease, 198(1), 2834. https://doi.org/10.1097/nmd.0b013e3181c8aa71.CrossRefGoogle Scholar
Yu, C., Li, X., Wang, S., & Zhang, W. (2016). Teacher autonomy support reduces adolescent anxiety and depression: An 18-month longitudinal study. Journal of Adolescence, 49, 115123. https://doi.org/10.1016/j.adolescence.2016.03.001.CrossRefGoogle Scholar
Zhou, F., Li, J., Zhao, W., Xu, L., Zheng, X., Fu, M., … Becker, B. (2020). Empathic pain evoked by sensory and emotional-communicative cues share common and process-specific neural representations. Elife, 9, e56929. doi: 10.7554/eLife.56929.CrossRefGoogle ScholarPubMed
Zuroff, D. C., Koestner, R., Moskowitz, D. S., McBride, C., Marshall, M., & Bagby, M. R. (2007). Autonomous motivation for therapy: A new common factor in brief treatments for depression. Psychotherapy Research, 17(2), 137147. https://doi.org/10.1080/10503300600919380.CrossRefGoogle Scholar
Figure 0

Fig. 1. Schematic framework for parsing motivated action. Motivated decision-making and action is parsed into separate phases of choice, action and outcome valuation, combining and building upon separate frameworks including the Rubicon model of action phases, well-established computational mechanisms and a recent cognitive framework describing anhedonia and apathy. During choice valuation, pre-decisional deliberation includes option generation, a cost-benefit analysis and option selection. Intrinsic and extrinsic motivation diverges during this early choice valuation phase. Once choice valuation has been computed and an option selected, planning and anticipation occurs. During action valuation, volitional action is initiated and action sustainment or acceleration is maintained. During outcome valuation, outcome achievement and consumption ensue, followed by evaluation based on learning via prediction error (PE) updating. Created with BioRender.com.

Figure 1

Table 1. Explicit studies of ‘intrinsic motivation’ in neuropsychiatric disorders