We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.
To save content items to your account,
please confirm that you agree to abide by our usage policies.
If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account.
Find out more about saving content to .
To save content items to your Kindle, first ensure no-reply@cambridge.org
is added to your Approved Personal Document E-mail List under your Personal Document Settings
on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part
of your Kindle email address below.
Find out more about saving to your Kindle.
Note you can select to save to either the @free.kindle.com or @kindle.com variations.
‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi.
‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.
Combining different pharmaceuticals may be beneficial when treating disorders with complex neurobiology, including alcohol use disorder (AUD). The gut-brain peptides amylin and GLP-1 may be of potential interest as they individually reduce alcohol intake in rodents. While the combination of amylin receptor (AMYR) and glucagon-like peptide-1 receptor (GLP-1R) agonists have been found to decrease feeding and body weight in obese male rats synergistically, their combined impact on alcohol intake is unknown.
Methods:
Therefore, the effect of the combination of an AMYR (salmon calcitonin (sCT)) and a GLP-1R (dulaglutide) agonist on alcohol intake in rats of both sexes was explored in two separate alcohol-drinking experiments. The first alcohol-drinking experiment evaluated the potential of adding sCT to an ongoing dulaglutide treatment, whereas the second alcohol-drinking experiment examined the effect when adding sCT and dulaglutide simultaneously.
Results:
When adding sCT to an ongoing dulaglutide treatment, a reduction in alcohol intake was observed in both male and female rats. However, when combining sCT and dulaglutide simultaneously, an initial reduction in alcohol intake was observed in rats of both sexes, whereas tolerance towards treatment was observed. In both alcohol-drinking experiments, this treatment combination consistently decreased food consumption and body weight in males and females. While the treatment combination did not affect inflammatory mediators, the gene expression of AMYR or GLP-1R, it changed fat tissue morphology.
Conclusions:
Further investigation needs to be done on the combination of AMYR and GLP-1R agonists to assess their combined effects on alcohol intake.
Chapter 6 develops an integrated framework of leader–subordinate dynamics in Chinese SOEs. How do leaders interact with subordinates to execute their agendas, and how do subordinates respond? Grounded in reward, coercion, and legitimate bases of power, the chapter identifies SOE leader tactics such as leveraging position authority, conducting personnel ploys, emphasizing material and status gains, invoking external threats, underscoring superiors’ directives and policies, and appealing to subordinates’ personal duty and morality. Subordinates may react by praising and supporting the leader or by expressing alternative views, delaying or subverting implementation, shirking, engaging in critical expression, or quitting. Leader–subordinate interactions are iterative and evolve over time.
Machine learning (ML) has developed classifiers differentiating patient groups despite concerns regarding diagnostic reliability. An alternative strategy, used here, is to develop a functional classifier (hyperplane) (e.g. distinguishing the neural responses to received reward v. received punishment in typically developing (TD) adolescents) and then determine the functional integrity of the response (reward response distance from the hyperplane) in adolescents with externalizing and internalizing conditions and its associations with symptom clusters.
Methods
Two hundred and ninety nine adolescents (mean age = 15.07 ± 2.30 years, 117 females) were divided into three groups: a training sample of TD adolescents where the Support Vector Machine (SVM) algorithm was applied (N = 65; 32 females), and two test groups– an independent sample of TD adolescents (N = 39; 14 females) and adolescents with a psychiatric diagnosis (major depressive disorder (MDD), generalized anxiety disorder (GAD), attention deficit hyperactivity disorder (ADHD) & conduct disorder (CD); N = 195, 71 females).
Results
SVM ML analysis identified a hyperplane with accuracy = 80.77%, sensitivity = 78.38% and specificity = 88.99% that implicated feature neural regions associated with reward v. punishment (e.g. nucleus accumbens v. anterior insula cortices). Adolescents with externalizing diagnoses were significantly less likely to show a normative and significantly more likely to show a deficient reward response than the TD samples. Deficient reward response was associated with elevated CD, MDD, and ADHD symptoms.
Conclusions
Distinguishing the response to reward relative to punishment in TD adolescents via ML indicated notable disruptions in this response in patients with CD and ADHD and associations between reward responsiveness and CD, MDD, and ADHD symptom severity.
Anorexia nervosa (AN) is characterized by severe restriction of calorie intake, which persists despite serious medical and psychological sequelae of starvation. Several prior studies have identified impaired feedback learning among individuals with AN, but whether it reflects a disturbance in learning from positive feedback (i.e., reward), negative feedback (i.e., punishment), or both, and the extent to which this impairment is related to severity and duration of illness, has not been clarified.
Method:
Participants were female adolescents with AN (n = 76) and healthy teen volunteers (HC; n = 38) between the ages of 12–18 years who completed a probabilistic reinforcement learning task. A Bayesian reinforcement learning model was used to calculate separate learning rates for positive and negative feedback. Exploratory analyses examined associations between feedback learning and duration of illness, eating disorder severity, and self/parent reports of reward and punishment sensitivity.
Results:
Adolescents with AN had a significantly lower rate of learning from positive feedback relative to HC. Patients and HC did not differ in learning from negative feedback or on overall task performance measures. Feedback learning parameters were not significantly associated with duration of illness, eating disorder severity, or questionnaire-based reports of reward and punishment sensitivity.
Conclusion:
Adolescents with AN showed a circumscribed deficit in learning from reward that was not associated with duration of illness or reported sensitivity to reward or punishment. Subsequent longitudinal research should explore whether differences in learning from positive feedback relate to course of illness in youth with AN.
Major depressive disorder (MDD) is characterized by deficient reward functions in the brain. However, existing findings on functional alterations during reward anticipation, reward processing, and learning among MDD patients are inconsistent, and it was unclear whether a common reward system implicated in multiple reward functions is altered in MDD. Here we meta-analyzed 18 past studies that compared brain reward functions between adult MDD patients (N = 477, mean age = 26.50 years, female = 59.40%) and healthy controls (N = 506, mean age = 28.11 years, females = 55.58%), and particularly examined group differences across multiple reward functions. Jack-knife sensitivity and subgroup meta-analyses were conducted to test robustness of findings across patient comorbidity, task paradigm, and reward nature. Meta-regression analyses assessed the moderating effect of patient symptom severity and anhedonia scores. We found during reward anticipation, MDD patients showed lower activities in the lateral prefrontal-thalamus circuitry. During reward processing, patients displayed reduced activities in the right striatum and prefrontal cortex, but increased activities in the left temporal cortex. During reward learning, patients showed reduced activity in the lateral prefrontal–thalamic–striatal circuitry and the right parahippocampal–occipital circuitry but higher activities in bilateral cerebellum and the left visual cortex. MDD patients showed decreased activity in the right thalamus during both reward anticipation and learning, and in the right caudate during both reward processing and learning. Larger functional changes in MDD were observed among patients with more severe symptoms and higher anhedonia levels. The thalamic-striatal circuitry functional alterations could be the key neural mechanism underlying MDD patients overarching reward function deficiencies.
The brain has an automated system designed to keep humans alive by promoting the search for, and remembering the location of, food. It is the motivation and reward system. The main neurotransmitter that drives our motivation and reward system is dopamine, which is the transmitter of repeat behavior. Our habits are formed by this system, and modern society offers numerous substances and activities to indulge in what can become habitual. Beneficial habits include exercise and eating lots of vegetables. Unhealthy habits include drinking too much alcohol, eating too much comfort food, and spending too much time on social media. Our habits often take hold because we use them to soothe our stress, anxiety, and depression. Habits are hard to break because they are established in our brains in networks of our brain cells.
An altered behavioral response to positive reinforcement has been proposed to be a core deficit in attention deficit hyperactivity disorder (ADHD). The spontaneously hypertensive rat (SHR), a congenic animal strain, displays a similarly altered response to reinforcement. The presence of this genetically determined phenotype in a rodent model allows experimental investigation of underlying neural mechanisms. Behaviorally, the SHR displays increased preference for immediate reinforcement, increased sensitivity to individual instances of reinforcement relative to integrated reinforcement history, and a steeper delay of reinforcement gradient compared to other rat strains. The SHR also shows less development of incentive to approach sensory stimuli, or cues, that predict reward after repeated cue-reward pairing. We consider the underlying neural mechanisms for these characteristics. It is well known that midbrain dopamine neurons are initially activated by unexpected reward and gradually transfer their responses to reward-predicting cues. This finding has inspired the dopamine transfer deficit (DTD) hypothesis, which predicts certain behavioral effects that would arise from a deficient transfer of dopamine responses from actual rewards to reward-predicting cues. We argue that the DTD predicts the altered responses to reinforcement seen in the SHR and individuals with ADHD. These altered responses to reinforcement in turn predict core symptoms of ADHD. We also suggest that variations in the degree of dopamine transfer may underlie variations in personality dimensions related to altered reinforcement sensitivity. In doing so, we highlight the value of rodent models to the study of human personality.
The constructs of motivation (or needs, motives, etc.) to explain higher-order behavior have burgeoned in psychology. In this article, we critically evaluate such high-level motivation constructs that many researchers define as causal determinants of behavior. We identify a fundamental issue with this predominant view of motivation, which we called the black-box problem. Specifically, high-level motivation constructs have been considered as causally instigating a wide range of higher-order behavior, but this does not explain what they actually are or how behavioral tendencies are generated. The black box problem inevitably makes the construct ill-defined and jeopardizes its theoretical status. To address the problem, we discuss the importance of mental computational processes underlying motivated behavior. Critically, from this perspective, motivation is not a unitary construct that causes a wide range of higher-order behavior --- it is an emergent property that people construe through the regularities of subjective experiences and behavior. The proposed perspective opens new avenues for future theoretical development, i.e., the examination of how motivated behavior is realized through mental computational processes.
Schizophrenia is associated with hypoactivation of reward sensitive brain areas during reward anticipation. However, it is unclear whether these neural functions are similarly impaired in other disorders with psychotic symptomatology or individuals with genetic liability for psychosis. If abnormalities in reward sensitive brain areas are shared across individuals with psychotic psychopathology and people with heightened genetic liability for psychosis, there may be a common neural basis for symptoms of diminished pleasure and motivation.
Methods
We compared performance and neural activity in 123 people with a history of psychosis (PwP), 81 of their first-degree biological relatives, and 49 controls during a modified Monetary Incentive Delay task during fMRI.
Results
PwP exhibited hypoactivation of the striatum and anterior insula (AI) during cueing of potential future rewards with each diagnostic group showing hypoactivations during reward anticipation compared to controls. Despite normative task performance, relatives demonstrated caudate activation intermediate between controls and PwP, nucleus accumbens activation more similar to PwP than controls, but putamen activation on par with controls. Across diagnostic groups of PwP there was less functional connectivity between bilateral caudate and several regions of the salience network (medial frontal gyrus, anterior cingulate, AI) during reward anticipation.
Conclusions
Findings implicate less activation and connectivity in reward processing brain regions across a spectrum of disorders involving psychotic psychopathology. Specifically, aberrations in striatal and insular activity during reward anticipation seen in schizophrenia are partially shared with other forms of psychotic psychopathology and associated with genetic liability for psychosis.
Adolescence is a key developmental period for the emergence of psychopathology. Reward-related brain activity increases across adolescence and has been identified as a potential neurobiological mechanism of risk for different forms of psychopathology. The reward positivity (RewP) is an event-related potential component that indexes reward system activation and has been associated with both concurrent and family history of psychopathology. However, it is unclear whether the RewP is also associated with higher-order psychopathology subfactors and whether this relationship is present across different types of reward.
Methods
In a sample of 193 adolescent females and a biological parent, the present study examined the association between adolescent and parental psychopathology subfactors and adolescent RewP to monetary and social reward.
Results
Results indicated that the adolescent and parental distress subfactors were negatively associated with the adolescent domain-general RewP. The adolescent and parental positive mood subfactors were negatively associated with the adolescent domain-general and domain-specific monetary RewP, respectively. Conversely, the adolescent and parental fear/obsessions subfactors were positively associated with the adolescent domain-general RewP. The associations between parental and adolescent psychopathology subfactors and the adolescent RewP were independent of each other.
Conclusions
The RewP in adolescent females is associated with both concurrent and parental psychopathology symptoms, suggesting that it indexes both severity and risk for higher-order subfactors.
Reward processing dysfunctions are considered a candidate mechanism underlying anhedonia and apathy in depression. Neuroimaging studies have documented that neurofunctional alterations in mesocorticolimbic circuits may neurally mediate these dysfunctions. However, common and distinct neurofunctional alterations during motivational and hedonic evaluation of monetary and natural rewards in depression have not been systematically examined. Here, we capitalized on pre-registered neuroimaging meta-analyses to (1) establish general reward-related neural alterations in depression, (2) determine common and distinct alterations during the receipt and anticipation of monetary v. natural rewards, and, (3) characterize the differences on the behavioral, network, and molecular level. The pre-registered meta-analysis (https://osf.io/ay3r9) included 633 depressed patients and 644 healthy controls and revealed generally decreased subgenual anterior cingulate cortex and striatal reactivity toward rewards in depression. Subsequent comparative analyses indicated that monetary rewards led to decreased hedonic reactivity in the right ventral caudate while natural rewards led to decreased reactivity in the bilateral putamen in depressed individuals. These regions exhibited distinguishable profiles on the behavioral, network, and molecular level. Further analyses demonstrated that the right thalamus and left putamen showed decreased activation during the anticipation of monetary reward. The present results indicate that distinguishable neurofunctional alterations may neurally mediate reward-processing alterations in depression, in particular, with respect to monetary and natural rewards. Given that natural rewards prevail in everyday life, our findings suggest that reward-type specific interventions are warranted and challenge the generalizability of experimental tasks employing monetary incentives to capture reward dysregulations in everyday life.
Social touch is an integral part of social relationships and has been associated with reward. Major depressive disorder (MDD) is characterized by severe impairments in reward processing, but the neural effects of social touch in MDD are still elusive. In this study, we aimed to determine whether the neural processing of social touch is altered in MDD and to assess the impact of antidepressant therapy.
Methods
Before and after antidepressant treatment, 53 MDD patients and 41 healthy controls underwent functional magnetic resonance imaging (fMRI) while receiving social touch. We compared neural responses to social touch in the reward network, behavioral ratings of touch comfort and general aversion to interpersonal touch in patients to controls. Additionally, we examined the effect of treatment response on those measures.
Results
Clinical symptoms decreased after treatment and 43.4% of patients were classified as responders. Patients reported higher aversion to interpersonal touch and lower comfort ratings during the fMRI paradigm than controls. Patients showed reduced responses to social touch in the nucleus accumbens, caudate nucleus and putamen than controls, both before and after treatment. Contrary to our hypotheses, these effects were independent of touch velocity. Non-responders exhibited blunted response in the caudate nucleus and the insula compared to responders, again irrespective of time.
Conclusions
These findings suggest altered striatal processing of social touch in MDD. Persistent dysfunctional processing of social touch despite clinical improvements may constitute a latent risk factor for social withdrawal and isolation.
Edited by
Deepak Cyril D'Souza, Staff Psychiatrist, VA Connecticut Healthcare System; Professor of Psychiatry, Yale University School of Medicine,David Castle, University of Tasmania, Australia,Sir Robin Murray, Honorary Consultant Psychiatrist, Psychosis Service at the South London and Maudsley NHS Trust; Professor of Psychiatric Research at the Institute of Psychiatry
Human studies have expanded insight about the lasting effects of adolescent cannabis use documenting structural and functional alterations in frontal and limbic regions of the brain, potentially relevant to behavioural vulnerability. Functional neuroimaging indicates that cannabis experience during adolescence is associated with perturbations in regions relevant to cognitive function such as working memory, attention, inhibitory control, and decision-making. Inconsistencies evident in the literature likely relate to variability in amount and frequency of cannabis use, potency, psychiatric comorbidity, and polysubstance use. Translational pre-clinical models help to elucidate how these factors contribute to protracted behavioural vulnerability of adolescent cannabis exposure.
Reinforcement learning (RL) is a computational framework for an active agent to learn behaviors on the basis of a scalar reward feedback. The theory of reinforcement learning was developed in the artificial intelligence community with intuitions from psychology and animal learning theory and mathematical basis in control theory. It has been successfully applied to tasks like game playing and robot control. Reinforcement learning gives a theoretical account of behavioral learning in humans and animals and underlying brain mechanisms, such as dopamine signaling and the basal ganglia circuit. Reinforcement learning serves as the “common language” for engineers, biologists, and cognitive scientists to exchange their problems and findings in goal-directed behaviors. This chapter introduces the basic theoretical framework of reinforcement learning and reviews its impacts in artificial intelligence, neuroscience, and cognitive science.
Abnormal reward functioning is central to anhedonia and amotivation symptoms of schizophrenia (SCZ). Reward processing encompasses a series of psychological components. This systematic review and meta-analysis examined the brain dysfunction related to reward processing of individuals with SCZ spectrum disorders and risks, covering multiple reward components.
Methods
After a systematic literature search, 37 neuroimaging studies were identified and divided into four groups based on their target psychology components (i.e. reward anticipation, reward consumption, reward learning, effort computation). Whole-brain Seed-based d Mapping (SDM) meta-analyses were conducted for all included studies and each component.
Results
The meta-analysis for all reward-related studies revealed reduced functional activation across the SCZ spectrum in the striatum, orbital frontal cortex, cingulate cortex, and cerebellar areas. Meanwhile, distinct abnormal patterns were found for reward anticipation (decreased activation of the cingulate cortex and striatum), reward consumption (decreased activation of cerebellum IV/V areas, insula and inferior frontal gyri), and reward learning processing (decreased activation of the striatum, thalamus, cerebellar Crus I, cingulate cortex, orbitofrontal cortex, and parietal and occipital areas). Lastly, our qualitative review suggested that decreased activation of the ventral striatum and anterior cingulate cortex was also involved in effort computation.
Conclusions
These results provide deep insights on the component-based neuro-psychopathological mechanisms for anhedonia and amotivation symptoms of the SCZ spectrum.
A leading theory of the negative symptoms of schizophrenia is that they reflect reduced responsiveness to rewarding stimuli. This proposal has been linked to abnormal (reduced) dopamine function in the disorder, because phasic release of dopamine is known to code for reward prediction error (RPE). Nevertheless, few functional imaging studies have examined if patients with negative symptoms show reduced RPE-associated activations.
Methods
Matched groups of DSM-5 schizophrenia patients with high negative symptom scores (HNS, N = 27) or absent negative symptoms (ANS, N = 27) and healthy controls (HC, N = 30) underwent fMRI scanning while they performed a probabilistic monetary reward task designed to generate a measure of RPE.
Results
In the HC, whole-brain analysis revealed that RPE was positively associated with activation in the ventral striatum, the putamen, and areas of the lateral prefrontal cortex and orbitofrontal cortex, among other regions. Group comparison revealed no activation differences between the healthy controls and the ANS patients. However, compared to the ANS patients, the HNS patients showed regions of significantly reduced activation in the left ventrolateral and dorsolateral prefrontal cortex, and in the right lingual and fusiform gyrus. HNS and ANS patients showed no activation differences in ventral striatal or midbrain regions-of-interest (ROIs), but the HNS patients showed reduced activation in a left orbitofrontal cortex ROI.
Conclusions
The findings do not suggest that a generalized reduction of RPE signalling underlies negative symptoms. Instead, they point to a more circumscribed dysfunction in the lateral frontal and possibly the orbitofrontal cortex.
Introduction to desire and how it relates to sex, including similarities and differences against other desires. Biology of desire and reward pathways in the brain. Reward transmitters such as dopamine and chemical messengers such as oxytocin.
How did Britain's most prominent armaments firms, Armstrongs and Vickers, build their businesses and sell armaments in Britain and overseas from 1855 to 1955? Joanna Spear presents a comparative analysis of these firms and considers the relationships they built with the British Government and foreign states. She reveals how the firms developed and utilized independent domestic strategies and foreign policies against the backdrop of imperial expansion and the two world wars. Using extensive new research, this study examines the challenges the two firms faced in making domestic and international sales including the British Government's commitment to laissez faire policies, prejudices within the British elite against those in trade, and departmental resistance to dealing with private firms. It shows the suite of strategies and tactics that the firms developed to overcome these obstacles to selling arms at home and abroad and how they built enduring relationships with states in Latin America, Asia, and the Middle East.
There is an increasing requirement for tools to assess and improve animal welfare in an objective and scientifically based manner. In our research a concept of welfare is applied which states that welfare is determined by the balance between positive and negative experiences. This concept implies that an interaction exists between stress systems and reward systems in the brain and, as a consequence: (I) negative experiences induce an increased sensitivity (ie need) for positive experiences; and (II) negative experiences can be compensated for by positive experiences. On this basis, two uses of reward-related behaviour can be hypothesised: (I) reward sensitivity may be used as a tool to assess the state of an animal in terms of welfare because it can indicate the current state of the balance that is dependent on previous (stressful) experiences; and (II) regular presentation of rewards may serve as a tool to counteract stress by shifting the balance to the positive side and, thus, to improve welfare. In order to investigate this, we used the rat as a model. Reward sensitivity was determined by the spontaneous behavioural response shown during expectation of a reward (ie anticipatory behaviour). A third (III) use of reward-related behaviour derives from the fact that anticipatory behaviour is influenced by the (rewarding) properties of the forthcoming reward (or other event) and, thus, may serve as a tool to assess the animal's perception of this reward/event. This paper presents a descriptive overview of the evidence obtained thus far for the three proposed uses of reward-related behaviour. The biological background of our concept of welfare can be generalised to all (vertebrate) species, and anticipatory behaviour can be evoked in a wide range of other species. Therefore, this tool for measuring and improving the welfare of captive animals has great potential and will contribute to a good quality of life for captive animals.
Risk and reward are negatively correlated in a wide variety of environments, and in many cases this trade off approximates a fair bet. Pleskac and Hertwig (2014) recently proposed that people have internalized this relationship and use it as the basis for probability estimation and subsequent choice under conditions of uncertainty. Specifically, they showed that risky options with high-value outcomes are inferred to have lower probability than options offering a less valuable reward. We report two experiments that test a simple corollary of this idea. In both studies, participants estimated the magnitude of prizes offered by lotteries with known win-probabilities. The relationship between estimates and probabilities followed the power relationship predicted by the risk-reward heuristic, albeit with a tendency to overestimate outcome magnitude. In addition, people’s estimates predicted their willingness to take the gamble. Our results provide further evidence that people have internalized the ecological relationship between risk and reward in financial lotteries, and we suggest that this relationship exerts a wide-ranging influence on decision-making.