Skip to main content Accessibility help

We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.

Close cookie message
×
Hostname: page-component-cd9895bd7-p9bg8 Total loading time: 0 Render date: 2024-12-26T15:17:12.640Z Has data issue: false hasContentIssue false

6 - Learning

Published online by Cambridge University Press:  18 May 2019

By
Mark E. Bouton  and
Robert A. Boakes
Edited by
Robert J. Sternberg  and
Wade E. Pickren
Robert J. Sternberg
Affiliation:
Cornell University, New York
Wade E. Pickren
Affiliation:
Ithaca College, New York
Get access

Summary

At the end of the nineteenth century, Darwinian interests in animal behavior converged with experimental psychology to give rise to systematic research on learning in animals. For the first half of the twentieth century, Ivan Pavlov’s study of conditioned reflexes was a major influence, but many American researchers maintained the behaviorist claim that all learning is based on stimulus–response (S–R) habits. A major critic of this dominant tradition emphasized spatial learning, suggesting that conditioning procedures produce expectancies rather than habits. Another kind of attack on S–R theory concentrated on its claim that learning processes were the same for all species. The comparative approach investigated ways in which, for example, the learning capacities of primates differed from those of rats or even goldfish. Other researchers investigated biological constraints on what animals can learn and the way that learning depends on a researcher’s choice of stimuli and responses, as in the study of conditioned taste aversions. Several key discoveries in the late 1960s laid the foundations for new associative theories of learning and a revival of interest in cognitive processes like attention. These approaches, together with breakthroughs in research on neural bases of behavior, have dominated research on animal learning ever since.

Keywords

learning theoriesevolutionbehaviorismcomparative psychologyneuroscienceclinical science
Type
Chapter
Information
The Cambridge Handbook of the Intellectual History of Psychology , pp. 135 - 164
Publisher: Cambridge University Press
Print publication year: 2019

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Amsel, A. (1962). Frustrative nonreward in partial reinforcement and discrimination learning: Some recent history and a theoretical extension. Psychological Review, 69, 306–328.Google Scholar
Atkinson, R. C., & Shiffrin, R. M. (1968). Human memory: A proposed system and its control processes. Psychology of Learning and Motivation, 2, 89–195.CrossRefGoogle Scholar
Balleine, B. W., & Dickinson, A. (1998). Goal-directed instrumental action: Contingency and incentive learning and their cortical substrates. Neuropharmacology, 37, 407–419.CrossRefGoogle ScholarPubMed
Balleine, B. W., & O’Doherty, J. P. (2010). Human and rodent homologies in action control: Corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology, 35, 48–69.CrossRefGoogle ScholarPubMed
Bechterev, V. M. (1913). La Psychologie Objective. Paris: Librairie Felix Alcan.Google Scholar
Berger, T. W., & Thompson, R. F. (1978). Neuronal plasticity in the limbic system during classical conditioning of the rabbit nictitating membrane response. I. The hippocampus. Brain Research, 145, 323–346.Google Scholar
Best, M.E., & Gemberling, G.A. (1977). Role of short-term processes in the conditioned stimulus preexposure effect and the delay of reinforcement gradient in long-delay taste-aversion learning. Journal of Experimental Psychology: Animal Behavior Processes, 3, 253–263.Google Scholar
Bijou, S. W., & Baer, D. M. (1961). Child Development: A Systematic and Empirical Theory. New York: Appleton-Century-Crofts.Google Scholar
Bitterman, M. E. (1965). Phyletic differences in learning. American Psychologist, 20, 396–410.CrossRefGoogle ScholarPubMed
Bitterman, M. E. (1996). Comparative analysis of learning in honeybees. Animal Learning & Behavior, 24, 123–141.Google Scholar
Black, A. H. (1959). Heart rate changes during avoidance learning in dogs. Canadian Journal of Psychology, 13, 229–242.Google Scholar
Boakes, R. A. (1977). Performance on learning to associate a stimulus with positive reinforcement. In Davis, H. & Hurwitz, H. M. B. (Eds.), Operant-Pavlovian interactions (pp. 67–97). Hillsdale, NJ: Lawrence Erlbaum.Google Scholar
Boakes, R. A. (1984). From Darwin to Behaviourism. Cambridge: Cambridge University Press.Google Scholar
Boakes, R. A., & Costa, D. S. J. (2014). Temporal contiguity in associative learning: Interference and decay from an historical perspective. Journal of Experimental Psychology: Animal Learning and Cognition, 40, 381–400.Google ScholarPubMed
Boakes, R. A., Poli, M., Lockwood, M. J., & Goodall, G. (1978). A study of misbehavior: Token reinforcement in the rat. Journal of the Experimental Analysis of Behavior, 29, 115–134.CrossRefGoogle ScholarPubMed
Bolles, R. C. (1970). Species-specific defense reactions and avoidance learning. Psychological Review, 77, 32–48.CrossRefGoogle Scholar
Bolles, R. C. (1972). The avoidance learning problem. In Bower, G. H. (Ed.), The Psychology of Learning and Motivation. New York: Academic Press.Google Scholar
Bolles, R. C., & Grossen, N. E. (1969). Effects of an informational stimulus on the acquisition of avoidance behavior in rats. Journal of Comparative and Physiological Psychology, 68, 90–99.Google Scholar
Bolles, R. C., & Riley, A. L. (1973). Freezing as an avoidance response: Another look at the operant-respondent distinction. Learning and Motivation, 4, 268–275.Google Scholar
Boring, E. G. (1950). A History of Experimental Psychology. New York: Appleton-Century-Crofts.Google Scholar
Bouton, M. E. (1988). Context and ambiguity in the extinction of emotional learning: Implications for exposure therapy. Behaviour Research and Therapy, 26, 137–149.Google Scholar
Bouton, M. E. (2004). Context and behavioral processes in extinction. Learning and Memory, 11, 485–494.Google Scholar
Bouton, M. E. (2016). Learning and Behavior: A Contemporary Synthesis (2nd ed.). Sunderland, MA: Sinauer.Google Scholar
Bouton, M. E., Mineka, S., & Barlow, D. H. (2001). A modern learning theory perspective on the etiology of panic disorder. Psychological Review, 108, 4–32.Google Scholar
Breland, K., & Breland, M. (1961). The misbehavior of organisms. American Psychologist, 16, 681–684.Google Scholar
Brett, L. P., Hankins, W. G., & Garcia, J. (1976). Pre-lithium aversions: III. Buteo hawks. Behavioral Biology, 17, 87–98.Google Scholar
Brogden, W. J., Lipman, E. A., & Culler, E. (1938). The role of incentive in conditioning and learning. American Journal of Psychology, 51, 109–117.CrossRefGoogle Scholar
Brown, P. L., & Jenkins, H. M. (1968). Auto-shaping of the pigeon’s key peck. Journal of the Experimental Analysis of Behavior, 11, 1–8.Google Scholar
Butler, R. A. (1954). Incentive conditions which influence visual exploration. Journal of Experimental Psychology, 48, 19–23.Google Scholar
Carew, T. J., Walters, E. T., & Kandel, E. R. (1981). Associative learning in Aplysia: Cellular correlates supporting a conditioned fear hypothesis. Science, 211, 501–504.Google Scholar
Catania, A. C. (1966). Concurrent operants. In Honig, W.K. (Ed.), Operant Behavior: Areas of Research and Application (pp. 213–270). New York: Appleton-Century-Crofts.Google Scholar
Chomsky, N. (1957). Syntactic Structures: Aspects of the Theory of Syntax. The Hague: Mouton.CrossRefGoogle Scholar
Chomsky, N. (1959). A review of B.F. Skinner’s Verbal Behavior. Language, 35, 26–58.Google Scholar
Clarke, J. C., Westbrook, R. F., & Irwin, J. (1979). Potentiation instead of overshadowing in the pigeon. Behavioral and Neural Biology, 25, 18–29.Google Scholar
Cook, R. G., & Wasserman, E. A. (2007). Learning and transfer of relational matching-to-sample by pigeons. Psychonomic Bulletin & Review, 14, 1107–1114.Google Scholar
Craske, M. G., Treanor, M., Conway, C. C., Zbozinek, T., & Vervliet, B. (2014). Maximizing exposure therapy: An inhibitory learning approach. Behaviour Research and Therapy, 58, 10–23.Google Scholar
Crespi, L. P. (1942). Quantitative variation of incentive and performance in the white rat. American Journal of Psychology, 55, 467–517.Google Scholar
Darwin, C. (1871). The Descent of Man, and Selection in Relation to Sex. London: John Murray.Google Scholar
De Houwer, J. (2009). The propositional approach to associative learning as an alternative for association formation models. Learning & Behavior, 37, 1–20.Google Scholar
De Toledo, L., & Black, A. H. (1966). Heart-rate changes during conditioned suppression in rats. Paper read at Eastern Psychological Association, New York.Google Scholar
Domjan, M. L., Lyons, R., North, N. C., & Bruell, J. (1986). Pavlovian conditioned approach behavior in male Japanese quail. Journal of Comparative Psychology, 100, 413–421.Google Scholar
Domjan, M. L., & Wilson, N. E. (1972). Speicificity of cue to consequences in aversion learning in the rat. Psychonomic Science, 26, 143–145.Google Scholar
Dworkin, B. R., & Miller, N. E. (1986). Failure to replicate visceral learning in the acute curarized rat preparation. Behavioral Neuroscience, 100, 299–314.CrossRefGoogle ScholarPubMed
Estes, W. K., & Skinner, B. F. (1941). Some quantitative properties of anxiety. Journal of Experimental Psychology, 29, 390–400.CrossRefGoogle Scholar
Everitt, B. J., & Robbins, T. W. (2005). Neural systems of reinforcement for drug addiction: From actions to habits to compulsion. Nature Neuroscience, 8, 1481–1489.Google Scholar
Eysenck, H. (1960). Behavior Therapy and the Neuroses. Oxford: Pergamon.Google Scholar
Ferster, C. B., & Skinner, B. F. (1957). Schedules of Reinforcement. New York: Appleton-Century-Crofts.Google Scholar
Gallistel, C. R., & Gibbon, J. (2000). Time, rate, and conditioning. Psychological Review, 107, 289–344.Google Scholar
Garcia, J., Erwin, F. R., & Koelling, R. A. (1966). Learning with prolonged delay of reinforcement. Psychonomic Science, 5, 121–122.Google Scholar
Garcia, J., Kimmeldorf, D. J., & Koelling, R. A. (1955). Conditioned aversion to saccharin resulting from gamma radiation. Science, 122, 157–158.Google Scholar
Garcia, J., & Koelling, R. A. (1966). Relation of cue to consequence in avoidance learning. Psychonomic Science, 4, 123–124.Google Scholar
Gardner, R. A., & Gardner, B. T. (1969). Teaching sign language to a chimpanzee. Science, 165, 664–672.Google Scholar
Gormezano, I. (1966). I. Classical conditioning. In Sidowski, J.B. (Ed.), Experimental Methods and Instrumentation in Psychology. New York: McGraw-Hill.Google Scholar
Gruber, H. E. (1974). Darwin on Man. London: Wildwood House.Google Scholar
Guttman, N., & Kalish, H. I. (1956). Discriminability and stimulus generalization. Journal of Experimental Psychology, 51, 79–88.Google Scholar
Hall, G., & Pearce, J. M. (1979). Latent inhibition of a CS during CS-US pairings. Journal of Experimental Psychology: Animal Behavior Processes, 5, 31–42.Google Scholar
Harlow, H. F. (1949). The formation of learning sets. Psychological Review, 56, 51–65.Google Scholar
Harlow, H. F. (1950). Learning and satiation of a response in intrinsically motivated complex puzzle performance by monkeys. Journal of Comparative and Physiological Psychology, 43, 289–294.Google Scholar
Hearst, E., & Jenkins, H. M. (1974). Sign-Tracking: The Stimulus-Reinforcer Relation and Directed Action. Austin, TX: Psychonomic Society.Google Scholar
Hebb, D. O. (1949). The Organization of Behavior. New York: Wiley.Google Scholar
Herman, L. M., Beach, F. A., Pepper, R. L., & Stalling, R. B. (1969). Learning-set formation in the bottlenose dolphin. Psychonomic Science, 14, 98–99.Google Scholar
Herrnstein, R. J. (1970). On the law of effect. Journal of the Experimental Analysis of Behavior, 13, 243–266.CrossRefGoogle ScholarPubMed
Higgins, S. T., Silverman, K., & Heil, S. H. (Eds.). (2008). Contingency Management in Substance Abuse Treatment. New York: Guilford Press.Google Scholar
Holland, P. C. (1977). Conditioned stimulus as a determinant of the form of the conditioned response. Journal of Experimental Psychology: Animal Behavior Processes, 3, 77–104.Google Scholar
Holland, P. C., & Gallagher, M. (1999). Amygdala circuitry in attentional and representational processes. Trends in Cognitive Sciences, 3, 65–73.Google Scholar
Holland, P. C., & Gallagher, M. (2004). Amygdala-frontal interactions and reward expectancy. Current Opinion in Neurobiology, 14, 148–155.Google Scholar
Holmes, N. M., Marchand, A. R., & Coutureau, E. (2010). Pavlovian to instrumental transfer: A neurobehavioural perspective. Neuroscience and Biobehavioral Reviews, 34, 1277–1295.Google Scholar
Hull, C. L. (1943). Principles of Behavior. New York: Appleton-Century-Crofts.Google Scholar
Hull, C. L. (1952). A Behavior System. New Haven, CT: Yale University Press.Google Scholar
James, W. (1890). Principles of Psychology. New York: Holt.Google Scholar
Jenkins, H. M. (1973). Effects of the stimulus-reinforcer relation on selected and unselected responses. In Hinde, R. A. & Stevenson-Hinde, J. (Eds.), Constraints on Learning. London: Academic Press.Google Scholar
Jenkins, H. M., & Harrison, R. H. (1960). Effect of discrimination training on auditory generalization. Journal of Experimental Psychology, 59, 246–253.Google Scholar
Jenkins, H. M., & Moore, B. R. (1973). The form of the autoshaped response with food or water reinforcers. Journal of the Experimental Analysis of Behavior, 20, 163–181.Google Scholar
Kamin, L. J. (1968). “Attention-like” processes in classical conditioning. In Jones, M. R. (Ed.), Miami Symposium on the Prediction of Behavior: Aversive Stimulation (pp. 9–33). Miami: University of Miami Press.Google Scholar
Kamin, L. J. (1969). Predictability, surprise, attention and conditioning. In Campbell, B. A. & Church, R. M. (Eds.), Punishment and Aversive Behavior (pp. 279–296). New York: Appleton-Century-Crofts.Google Scholar
Karpicke, J., Christoph, G., Peterson, G., & Hearst, E. (1977). Signal location and positive and negative conditioned suppression in the rat. Journal of Experimental Psychology: Animal Behavior Processes, 3, 105–118.Google Scholar
Katz, J. S., & Wright, A. A. (2006). Same/different abstract-concept learning by pigeons. Journal of Experimental Psychology: Animal Behavior Processes, 32, 8086.Google Scholar
Kim, J. J., Krupa, D. J., & Thompson, R. F. (1998). Inhibitory cerebello-olivary projections and blocking effect in classical conditioning. Science, 279, 570–573.Google Scholar
Konorski, J. (1967). Integrative Activity of the Brain: An Interdisciplinary Approach. Chicago: University of Chicago Press.Google Scholar
Konorski, J., & Miller, S. (1937a). Further remarks on two types of conditioned reflex. Journal of Genetic Psychology, 17, 405–407.Google Scholar
Konorski, J., & Miller, S. (1937b). On two types of conditioned reflex. Journal of Genetic Psychology, 16, 264–272.Google Scholar
Krechevsky, I. (1932). “Hypotheses” in rats. Psychological Review, 39, 516–532.Google Scholar
Kremer, E. F. (1978). The Rescorla-Wagner model: Losses in associative strength in compound conditioned stimuli. Journal of Experimental Psychology: Animal Behavior Processes, 4, 22–36.Google Scholar
Lashley, K. S. (1929). Brain Mechanisms and Intelligence. Chicago: University of Chicago Press.Google Scholar
Lashley, K. S., & Franz, S. I. (1917). The effects of cerebral destruction upon habit-formation and retention in the albino rat. Psychobiology, 1, 71–139.Google Scholar
Lawrence, D. H. (1949). Acquired distinctiveness of cues: I. Transfer between discriminations on the basis of familiarity with the stimulus. Journal of Experimental Psychology, 39, 770–784.Google Scholar
Lawrence, D. H. (1950). Acquired distinctiveness of cues: II. Selective association in a constant stimulus situation. Journal of Experimental Psychology, 40, 511–516.Google Scholar
Lindsley, O. R. (1960). Characteristics of the behavior of chronic psychotics as revealed by free-operant conditioning methods. Diseases of the Nervous System, 21 Supplement, 66–78.Google Scholar
LeDoux, J. (2015). Anxious: Using the Brain to Understand and Treat Fear and Anxiety. New York: Viking.Google Scholar
Lubow, R. E., & Moore, A. U. (1959). Latent inhibition: The effect of nonreinforced preexposure to the conditioned stimulus. Journal of Comparative and Physiological Psychology, 52, 415–419.CrossRefGoogle Scholar
Mackintosh, N. J. (1975). A theory of attention: Variations in the associability of stimuli with reinforcement. Psychological Review, 82, 276–298.Google Scholar
Macphail, E. M. (1987). The comparative psychology of intelligence. Behavioral and Brain Sciences, 10, 645–695.Google Scholar
Maier, S. F., & Seligman, M. E. P. (2016). Learned helplessness at fifty: Insights from neuroscience. Psychological Review, 123, 349–367.Google Scholar
McClelland, J. L., & Rumelhart, D. E. (1985). Distributed memory and the representation of general and specific information. Journal of Experimental Psychology: General, 114, 159–188.Google Scholar
Miller, N. E. (1948). Studies of fear as an acquirable drive: I. Fear as motivation and fear-reduction as reinforcement in the learning of new responses. Journal of Experimental Psychology, 38, 89–101.Google Scholar
Milton, A. L., & Everitt, B. J. (2012). The persistence of maladaptive memory: Addiction, drug memories, and anti-relapse treatments. Neuroscience and Biobehavioral Reviews, 36, 1119–1139.Google Scholar
Mineka, S., & Zinbarg, R. (2006). A contemporary learning theory perspective on the etiology of anxiety disorders: It’s not what you thought it was. American Psychologist, 61, 10–26.Google Scholar
Moon, L. E., & Harlow, H. F. (1955). Analysis of oddity learning by rhesus monkeys. Journal of Comparative and Physiological Psychology, 48, 188–194.CrossRefGoogle ScholarPubMed
Morgan, C. L. (1894). An Introduction to Comparative Psychology. London: Scott.Google Scholar
Morris, R. G. M. (1981). Spatial localization does not require the presence of local cues. Learning and Motivation, 12, 239–260.Google Scholar
Mowrer, O. H. (1947). On the dual nature of learning: A reinterpretation of “conditioning” and “problem-solving.” Harvard Educational Review, 17, 102–150.Google Scholar
Mowrer, O. H., & Lamoreaux, R. R. (1942). Avoidance conditioning and signal duration: A study of secondary motivation and reward. Psychological Monographs, 54 (Whole No. 247).Google Scholar
Myers, K. M., & Davis, M. (2007). Mechanisms of fear extinction. Molecular Psychiatry, 12, 120–150.Google Scholar
Öhman, A., & Mineka, S. (2001). Fears, phobias, and preparedness: Toward an evolved module of fear and fear learning. Psychological Review, 108, 483–522.Google Scholar
O’Keefe, J., & Dostrovsky, J. (1971). The hippocampus as a spatial map: Preliminary evidence from unit activity in the freely-moving rat. Brain Research, 34, 171–175.Google Scholar
O’Keefe, J., & Nadel, L. (1978). The Hippocampus as a Cognitive Map. Oxford: Oxford University Press.Google Scholar
Olds, J., & Milner, P. (1954). Positive reinforcement produced by electrical stimulation of spetal area and other regions of rat brain. Journal of Comparative and Physiological Psychology, 47, 419–427.Google Scholar
Overmier, J. B., & Leaf, R. C. (1965). Effects of discriminative Pavlovian fear conditioning upon previously or subsequently acquired avoidance responding. Journal of Comparative and Physiological Psychology, 60, 213–217.Google Scholar
Overmier, J. B., & Seligman, M. E. P. (1967). Effects of inescapable shock upon subsequent escape and avoidance behavior. Journal of Comparative and Physiological Psychology, 63, 23–33.Google Scholar
Pavlov, I. (1927 ). Conditioned Reflexes. Translated by Anrep, G. V.. Oxford: Oxford University Press.Google Scholar
Pearce, J. M. (1994). Discrimination and categorization. In Mackintosh, N. J. (Ed.), Animal Learning and Cognition (pp. 109–134). San Diego: Academic Press.Google Scholar
Pearce, J. M., Colwill, R. M., & Hall, G. (1978). Instrumental conditioning of scratching in the laboratory rat. Learning & Motivation, 9, 255–271.Google Scholar
Pearce, J. M., & Hall, G. (1980). A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychological Review, 87, 532–552.Google Scholar
Pearce, J. M., & Mackintosh, N. J. (2010). Two theories of attention: A review and a possible integration. In Mitchell, C. J. & Le Pelley, M. E. (Eds.), Attention and Associative Learning (pp. 11–39). New York: Oxford University Press.Google Scholar
Premack, D. (1971). Language in chimpanzees? Science, 172, 808–822.Google Scholar
Rescorla, R. A. (1966). Predictability and number of pairings in Pavlovian fear conditioning. Psychonomic Science, 4, 383–384.Google Scholar
Rescorla, R. A. (1967). Pavlovian conditioning and its proper control procedures. Psychological Review, 74, 71–80.Google Scholar
Rescorla, R. A. (1968). Probability of shock in the presence and absence of CS in fear conditioning. Journal of Comparative and Physiological Psychology, 66, 1–5.Google Scholar
Rescorla, R. A. (1969). Establishment of a positive reinforcer through contrast with shock. Journal of Comparative and Physiological Psychology, 67, 504–509.Google Scholar
Rescorla, R. A. (1971). Variation in the effectiveness of reinforcement and nonreinforcement following prior inhibitory conditioning. Learning and Motivation, 2, 113–123.Google Scholar
Rescorla, R. A. (1980). Simultaneous and successive associations in sensory preconditioning. Journal of Experimental Psychology: Animal Behavior Processes, 6, 207–216.Google Scholar
Rescorla, R. A., & Lolordo, V. M. (1965). Inhibition of avoidance behavior. Journal of Comparative and Physiological Psychology, 59, 406–412.Google Scholar
Rescorla, R. A., & Solomon, R. L. (1967). Two-process learning theory: Relationships between Pavlovian conditioning and instrumental learning. Psychological Review, 74, 151–182.Google Scholar
Rescorla, R. A., & Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In Black, A. H. & Prokasy, W. F. (Eds.), Classical Conditioning II: Current Research and Theory (pp. 64–99). New York: Appleton-Century-Crofts.Google Scholar
Revusky, S. (1971). The role of interference in association over a delay. In Honig, W. K. & James, P. H. R. (Eds.), Animal Memory (pp. 155–213). New York: Academic Press.CrossRefGoogle Scholar
Revusky, S. (1977). Learning as a general proess with an emphasis on data from feeding experiments. In Milgram, N. H., Krames, L., & Alloway, T. M. (Eds.), Food Aversion Learning (pp. 1–71). New York: Plenum.Google Scholar
Romanes, G. (1882). Animal Intelligence. London: Kegan Paul, Trench & Co.Google Scholar
Romanes, G. (1884). Mental Evolution in Animals. New York: Appleton.Google Scholar
Rusiniak, K. W., Hankins, W. G., Garcia, J., & Brett, L. P. (1979). Flavor-illness aversions: Potentiation of odor by taste in rats. Behavioral and Neural Biology, 25, 1–17.Google Scholar
Savage-Rumbaugh, S., Murphy, J., Sevcik, R. A., Brakke, K. E., Williams, S. L., Rumbaugh, D. M., & Bates, E. (1993). Language comprehension in ape and child. Monographs of the Society for Research in Child Development, 58, 1–252.Google Scholar
Schlosberg, H. (1937). The relationship between success and the laws of conditioning. Psychological Review, 44, 379–394.Google Scholar
Schultz, W., & Dickinson, A. (2000). Neuronal coding of prediction errors. Annual Review of Neuroscience, 23, 473–500.Google Scholar
Seligman, M. E. P. (1975). Helplessness: On Depression, Development, and Death. San Francisco: Freeman.Google Scholar
Seligman, M. E. P., & Maier, S. F. (1967). Failure to escape traumatic shock. Journal of Experimental Psychology, 74, 1–9.Google Scholar
Sheffield, F. D. (1965). The relation between classical conditioning and instrumental learning. In Prokasy, W. F. (Ed.), Classical Conditioning: A Symposium. (pp. 302–322). New York: Appleton-Century-Crofts.Google Scholar
Shettleworth, S. J. (1975). Reinforcement and the organization of behavior in golden hamsters: Hunger, environment and food reinforcement. Journal of Experimental Psychology: Animal Behavior Processes, 104, 56–87.Google Scholar
Shettleworth, S. J. (1998). Cognition, Evolution and Behavior. New York: Oxford University Press.Google Scholar
Skinner, B. F. (1938). The Behavior of Organisms: An Experimental Analysis. New York: Appleton-Century.Google Scholar
Skinner, B. F. (1950). Are theories of learning necessary? Psychological Review, 57, 193–216.Google Scholar
Skinner, B. F. (1953). Science and Human Behavior. New York: Macmillan.Google Scholar
Skinner, B. F. (1957). Verbal Behavior. New York: Appleton-Century-Crofts.Google Scholar
Skinner, B. F. (1958). Teaching machines. Science, 128, 969–977.Google Scholar
Spence, K. W. (1936). The nature of discrimination learning in animals. Psychological Review, 43, 427–449.Google Scholar
Spence, K. W. (1951). Theoretical interpretations of learning. In Stevens, S. S. (Ed.), Handbook of Experimental Psychology (pp. 690–729). New York: Wiley.Google Scholar
Spence, K. W. (1956). Behavior Theory and Conditioning. New Haven, CT: Yale University Press.Google Scholar
Sutherland, N. S., & Mackintosh, N. J. (1971). Mechanisms of Animal Discrimination Learning. New York: Academic Press.Google Scholar
Terrace, H. S. (1963). Discrimination with and without “errors.” Journal of the Experimental Analysis of Behavior, 6, 1–27.Google Scholar
Terrace, H. S., Petitto, L. A., Sanders, R. J., & Bever, T. G. (1979). Can an ape create a sentence? Science, 206, 891–902.Google Scholar
Thorndike, E. L. (1898). Animal intelligence: An experimental study of the associative processes in animals. Psychological Monographs, 2.Google Scholar
Thorndike, E. L. (1911). Animal Intelligence: Experimental Studies. New York: Macmillan.Google Scholar
Tinbergen, N. (1951). The Study of Instinct. Oxford: Oxford University Press.Google Scholar
Tolman, E. C. (1932). Purposive Behavior in Animals and Men. New York: Century.Google Scholar
Trapold, M. A., & Overmier, J. B. (1972). The second learning process in instrumental learning. In Black, A. H. & Prokasy, W. F. (Eds.), Classical Conditioning II: Current Research and Theory (pp. 427–452). New York: Appleton-Century-Crofts.Google Scholar
Wagner, A. R. (1969). Stimulus validity and stimulus selection in associative learning. In Mackintosh, N. J. & Honig, W. K. (Eds.), Fundamental Issues in Associative Learning (pp. 90–122). Halifax, NS: Dalhousie University Press.Google Scholar
Wagner, A. R. (1978). Expectancies and the priming of STM. In Hulse, S. H., Fowler, H., & Honig, W. K. (Eds.), Cognitive Processes in Animal Behavior (pp. 177–209). Hillsdale, NJ: Lawrence Erlbaum.Google Scholar
Wagner, A. R. (1981). SOP: A model of automatic memory processing in animal behavior. In Spear, N. E. & Miller, R. R. (Eds.), Information Processing in Animals: Memory Mechanisms (pp. 5–47). Hillsdale, NJ: Lawrence Erlbaum.Google Scholar
Wagner, A. R. (2003). Context-sensitive elemental theory. Quarterly Journal of Experimental Psychology B: Comparative and Physiological Psychology, 56B, 7–29.Google Scholar
Wagner, A. R., & Brandon, S. E. (1989). Evolution of a structured connectionist model of Pavlovian conditioning (AESOP). In Klein, S. B. & Mowrer, R. R. (Eds.), Contemporary Learning Theories: Pavlovian Conditioning and the Status of Traditional Learning Theory (pp. 149–190). Hillsdale, NJ: Lawrence Erlbaum.Google Scholar
Warren, J. M. (1965). Primate learning in comparative perspective. In Schrier, A. M., Harlow, H. F., & Stollnitz, F. (Eds.), Behavior of Non-Human Primates. (Vol. 1, pp. 249–281). New York: Academic Press.Google Scholar
Wasserman, E. A. (1973). Pavlovian conditioning with heat reinforcement produces stimulus-directed pecking in chicks. Science, 181, 875–877.Google Scholar
Wasserman, E. A. (1984). Animal intelligence: Understanding the minds of animals through their behavioral “ambassadors.” In Roitblat, H. L., Bever, T. G., & Terrace, H. S. (Eds.), Animal Cognition (pp. 45–60). Hillsdale, NJ: Lawrence Erlbaum.Google Scholar
Wasserman, E. A., & Zentall, T. R. (2006). Comparative Cognition: Experimental Explorations of Animal Intelligence. Oxford: Oxford University Press.Google Scholar
Watson, J. B. (1913). Psychology as the behaviorist views it. Psychological Review, 20, 158–177.Google Scholar
Watson, J. B. (1924). Behaviorism. New York: Norton.Google Scholar
Watson, J. B., & Rayner, R. (1920). Conditioned emotional reactions. Journal of Experimental Psychology, 3, 1–14.Google Scholar
Weisman, R. G., & Litner, J. S. (1969). Positive conditioned reinforcement of Sidman avoidance behavior in rats. Journal of Comparative and Physiological Psychology, 68, 597–603.Google Scholar
Williams, D. R., & Williams, H. (1969). Auto-maintenance in the pigeon: Sustained pecking despite contingent non-reinforcement. Journal of the Experimental Analysis of Behavior, 12, 511–520.Google Scholar
Wolpe, J. (1948). An approach to the problem of neurosis based on the conditioned response: An experimental and theoretical study. Master’s thesis, University of the Witwatersrand, South Africa.Google Scholar
Wolpe, J. (1958). Psychotherapy by Reciprocal Inhibition. Stanford: Stanford University Press.Google Scholar

Save book to Kindle

To save this book to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×