No CrossRef data available.
Article contents
How uncertainty begets hope: A model of adaptive and maladaptive seeking behavior
Published online by Cambridge University Press: 19 March 2019
Abstract
The “incentive hope” model creatively explains hoarding and fat accumulation by foragers under uncertainty and food seeking when food cues are present but food is not. The model has difficulty explaining why animals driven by cues fare better than animals driven by food reward itself, why human obesity exists when food is abundant, and why people enjoy gambling and care about winning.
- Type
- Open Peer Commentary
- Information
- Copyright
- Copyright © Cambridge University Press 2019
References
Barrot, M., Marinelli, M., Abrous, D. N., Rougé-Pont, F., Le Moal, M. & Piazza, P. V. (2000) The dopaminergic hyper-responsiveness of the shell of the nucleus accumbens is hormone-dependent. European Journal of Neuroscience 12(3):973–79.Google Scholar
Berridge, K. C. (2007) The debate over dopamine's role in reward: The case for incentive salience. Psychopharmacology 191:391–431. doi: 10.1007/s00213-006-0578-x.Google Scholar
Brown, P. L. & Jenkins, H. M. (1968) Auto-shaping of the pigeon's key-peck. Journal of the Experimental Analysis of Behavior 11(1):1–8.Google Scholar
Burgdorf, J., Knutson, B., Panksepp, J. & Ikemoto, S. (2001) Nucleus accumbens amphetamine microinjections unconditionally elicit 50-kHz ultrasonic vocalizations in rats. Behavioral Neuroscience 115(4):940–44.Google Scholar
Fiorillo, C. D., Tobler, P. N. & Schultz, W. (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299(5614):1898–902. doi: 10.1126/science.1077349.Google Scholar
Gainsbury, S. M., Suhonen, N. & Saastamoinen, J. (2014) Chasing losses in online poker and casino games: Characteristics and game play of Internet gamblers at risk of disordered gambling. Psychiatry Research 217(3):220–25.Google Scholar
Goudriaan, A. E. & Clark, L. (2013) Neuroimaging in problem gambling. In: Biological research on addiction, ed. Miller, P. M., pp. 689–97. Elsevier.Google Scholar
Ladouceur, R., Sevigny, S., Blaszczynski, A., O'Connor, K. & Lavoie, M. E. (2003) Video lottery: Winning expectancies and arousal. Addiction 98(6):733–38.Google Scholar
Lee, H. P., Chae, P. K., Lee, H. S. & Kim, Y. K. (2007) The five-factor gambling motivation model. Psychiatry Research 150(1):21–32. doi: 10.1016/j.psychres.2006.04.005.Google Scholar
Mazur, J. E. (1987) An adjusting procedure for studying delayed reinforcement. In: Quantitative analyses of behavior, Vol. 5. The effect of delay and of intervening events on reinforcement value, ed. Commons, M. L., Mazur, J. E., Nevin, J. A. & Rachlin, H., pp. 55–73. Erlbaum.Google Scholar
Pravosudov, V. V. & Grubb, T. C. Jr. (1997) Management of fat reserves and food caches in tufted titmice (Parus bicolor) in relation to unpredictable food supply. Behavioral Ecology 8(3):332–39.Google Scholar
Robinson, T. E. & Flagel, S. B. (2009) Dissociating the predictive and incentive motivational properties of reward-related cues through the study of individual differences. Biological Psychiatry 65(10):869–73. doi: 10.1016/j.biopsych.2008.09.006.Google Scholar
Smith, A. P. & Zentall, T. R. (2016) Suboptimal choice in pigeons: Choice is primarily based on the value of the conditioned reinforcers rather than overall reinforcement rate. Journal of Experimental Psychology: Animal Learning and Cognition 42(2):212–20. http://dx.doi.org/10.1037/xan0000092.Google Scholar
Toce-Gerstein, M., Gerstein, D. R. & Volberg, R. A. (2003) A hierarchy of gambling disorders in the community. Addiction 98(12):1661–72.Google Scholar
Torres, C., Glueck, A. C., Conrad, S. E., Moron, I. & Papini, M. R. (2016) Dorsomedial striatum lesions affect adjustment to reward uncertainty, but not to reward devaluation or omission. Neuroscience 332:13–25. http://dx.doi.org/10.1016/j.neuroscience.2016.06.041.Google Scholar
Vucetic, Z. & Reyes, T. M. (2010) Central dopaminergic circuitry controlling food intake and reward: Implications for the regulation of obesity. Wiley Interdisciplinary Reviews: Systems Biology and Medicine 2(5):577–93. doi: 10.1002/wsbm.77.Google Scholar
Zack, M., Boileau, I., Payer, D., Chugani, B., Lobo, D. S., Houle, S., Wilson, A. A., Warsh, J. J. & Kish, S. J. (2015) Differential cardiovascular and hypothalamic pituitary response to amphetamine in male pathological gamblers versus healthy controls. Journal of Psychopharmacology 29(9):971–82. doi: 0269881115592338 [pii]10.1177/0269881115592338.Google Scholar
Target article
How foraging works: Uncertainty magnifies food-seeking motivation
Related commentaries (22)
A neural basis for food foraging in obesity
Beyond uncertainty: A broader scope for “incentive hope” mechanisms and its implications
Beyond “incentive hope”: Information sampling and learning under reward uncertainty
Complex social ecology needs complex machineries of foraging
Considerations for the study of “incentive hope” and sign-tracking behaviors in humans
Does the “incentive hope” hypothesis explain food-wasting behavior among humans? Yes and no
Extending models of “How Foraging Works”: Uncertainty, controllability, and survivability
Food security and obesity: Can passerine foraging behavior inform explanations for human weight gain?
Food seeking and food sharing under uncertainty
Food-seeking behavior has complex evolutionary pressures in songbirds: Linking parental foraging to offspring sexual selection
Foraging extends beyond food: Hoarding of mental energy and information seeking in response to uncertainty
Hoarding all of the chips: Slot machine gambling and the foraging for coins
Hope, exploration, and equilibrated action schemes
How uncertainty begets hope: A model of adaptive and maladaptive seeking behavior
Mechanistic models must link the field and the lab
Overlapping neural systems underlying “incentive hope” and apprehension
Random isn't real: How the patchy distribution of ecological rewards may generate “incentive hope”
Simulating exploration versus exploitation in agent foraging under different environment uncertainties
The value of uncertainty: An active inference perspective
Unpredictable homeodynamic and ambient constraints on irrational decision making of aneural and neural foragers
“How Foraging Works”: Let's not forget the physiological mechanisms of energy balance
“Incentive hope” and the nature of impulsivity in low-socioeconomic-status individuals
Author response
Incentive hope: A default psychological response to multiple forms of uncertainty