Hostname: page-component-cd9895bd7-dzt6s Total loading time: 0 Render date: 2024-12-28T18:01:33.119Z Has data issue: false hasContentIssue false

An Interactionist Approach to Cognitive Debiasing

Published online by Cambridge University Press:  04 May 2020

Steven Bland*
Affiliation:
Huron University College, London, Ontario, Canada
*

Abstract

This paper examines three programmatic responses to the problem of cognitive bias: virtue epistemology, epistemic paternalism, and epistemic collectivism. Each of these programmes focuses on a single level of epistemic analysis: virtue theorists on individuals, paternalists on environments, and collectivists on groups. I argue that this is a mistake in light of the fact that cognitive biases arise from interactions between these three domains. Consequently, epistemologists should spend less time defending these programmes, and more time coordinating them. This paper offers empirically based arguments for the interactionist approach, and contends that its adoption is an essential step for minimizing bias in empirical science.

Type
Article
Copyright
Copyright © The Author, 2020. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Ahlstrom-Vij, K. (2013). Epistemic Paternalism: A Defense. New York, NY: Palgrave Macmillan.CrossRefGoogle Scholar
Alfano, M. (2016). ‘Friendship and the Structure of Trust.’ In Masala, A. and Webber, J. (eds), From Personality to Virtue: Essays in the Psychology and Ethics of Character, pp. 186206. Oxford: Oxford University Press.CrossRefGoogle Scholar
Armor, D.A. and Taylor, S.E. (2002). ‘When Predictions Fail: The Dilemma of Unrealistic Optimism.’ In Gilovich, T., Griffin, D. and Kahneman, D. (eds), Heuristics and Biases: The Psychology of Intuitive Judgment, pp. 334–47. Cambridge: Cambridge University Press.CrossRefGoogle Scholar
Augustinova, M. (2008). ‘Falsification Cueing in Collective Reasoning: Example of the Wason Selection Task.’ European Journal of Social Psychology 38(5), 770–85.CrossRefGoogle Scholar
Baron, R.S., Hoppe, S.I., Kao, C.F., Brunsman, B., Linneweh, B. and Rogers, D. (1996). ‘Social Corroboration and Opinion Extremity.’ Journal of Experimental Social Psychology 32, 537–60.CrossRefGoogle ScholarPubMed
Benjamin, D.J., Berger, J.O., Johannesson, M. et al. (2018). ‘Redefine Statistical Significance.Nature Human Behaviour 2(1), 610.CrossRefGoogle ScholarPubMed
Bland, S. (Forthcoming). ‘Interactionism, Debiasing, and the Division of Epistemic Labour.’ Forthcoming in Alfano, M., Klein, C. and De Ridder, J. (eds), Social Virtue Epistemology. London: Routledge.Google Scholar
Bonner, S.E., Baumann, M.R. and Dalal, R.S. (2002). ‘The Effects of Member Expertise on Group Decision Making and Performance.’ Organizational Behavior and Human Decision Processes 88, 719–36.CrossRefGoogle Scholar
Cassam, Q. (2015). ‘Stealthy Vices.’ Social Epistemology Review and Reply Collective 4, 1925.Google Scholar
Casscells, W., Schoenberger, A. and Grayboys, T. (1978). ‘Interpretation by Physicians of Clinical Laboratory Results.’ New England Journal of Medicine 299, 9991001.CrossRefGoogle ScholarPubMed
Center for Open Science (2020a). ‘TOP Guidelines.’ https://cos.io/top/.Google Scholar
Center for Open Science (2020b). ‘Registered Reports.’ https://cos.io/rr/.Google Scholar
Cohen, J. (1962). ‘The Statistical Power of Abnormal-Social Psychological Research: A Review.’ Journal of Abnormal and Social Psychology 65(3), 145–53.CrossRefGoogle ScholarPubMed
Cristea, I.A. and Ioannidis, J.P.A. (2018). ‘P-values in Display Items are Ubiquitous and Almost Invariably Significant: A Survey of Top Science Journals.’ PLoS ONE 13(5), e0197440. doi:10.1371/journal.pone.0197440.CrossRefGoogle ScholarPubMed
Davis, J.H. (1973). ‘Group Decisions and Social Interactions: A Theory of Social Decision Schemes.’ Psychological Review 80(2), 97125.CrossRefGoogle Scholar
Dunning, D., Meyerowitz, J.A. and Holzberg, A.D. (2002). ‘Ambiguity and Self-evaluation: The Role of Idiosyncratic Trait Definition in Self-serving Assessments of Ability.’ In Gilovich, T., Griffin, D. and Kahneman, D. (eds), Heuristics and Biases: The Psychology of Intuitive Judgment, pp. 324–33. Cambridge: Cambridge University Press.CrossRefGoogle Scholar
Ehrlinger, J., Gilovich, T. and Ross, L. (2005). ‘Peering into the Bias Blind Spot: Peoples’ Assessments of Bias in Themselves and Others.’ Personality and Social Psychology Bulletin 31(5), 680–92.CrossRefGoogle Scholar
Errington, T.M., Iorns, E., Gunn, W.T., Fraser, E., Lomax, J. and Nosek, B.A. (2014). ‘An Open Investigation of the Reproducibility of Cancer Biology Research.ELife 3(December), e043333. doi: 10.7554/eLife.04333.CrossRefGoogle ScholarPubMed
Evans, J.St.B.T. (2011). ‘Reason is for Thinking, Not Just for Arguing.’ Behavioral and Brain Sciences 34(2), 77–9.CrossRefGoogle Scholar
Fanelli, D. (2010). ‘Do Pressures to Publish Increase Scientists’ Bias? An Empirical Support from US States Data.PLoS ONE 5(4). doi: 10.1371/journal.pone.0010271.CrossRefGoogle ScholarPubMed
Fanelli, D. (2012). ‘Negative Results are Disappearing from Most Disciplines and Countries.’ Scientometrics 90(3), 891904.CrossRefGoogle Scholar
Fishkin, J.S. (2009). When the People Speak: Deliberative Democracy and Public Consultation. Oxford: Oxford University Press.Google Scholar
Fong, G.T., Krantz, D.H. and Nisbett, R. (1986). ‘The Effects of Statistical Training on Thinking about Everyday Problems.’ Cognitive Psychology 18, 253–92.CrossRefGoogle Scholar
Frankish, K. (2011). ‘Reasoning, Argumentation, and Cognition.’ Behavioral and Brain Sciences 34(2), 7980.CrossRefGoogle Scholar
Frantz, C. (2006). ‘I AM Being Fair: The Bias Blind Spot as a Stumbling Block to Seeing Both Sides.’ Basic and Applied Social Psychology 28(2), 157–67.CrossRefGoogle Scholar
Fraser, H., Parker, T., Nakagawa, S., Barnett, A. and Fidler, F. (2018). ‘Questionable Research Practices in Ecology and Evolution.PLoS ONE, 13(7). doi: 10.1371/journal.pone.0200303.CrossRefGoogle ScholarPubMed
Gigerenzer, G. (1991). ‘How to Make Cognitive Illusions Disappear.’ European Review of Social Psychology 2, 83115.CrossRefGoogle Scholar
Gigerenzer, G. (1996). ‘The Psychology of Good Judgment: Frequency Formats and Simple Algorithms.’ Medical Decision Making 16, 273–80.CrossRefGoogle ScholarPubMed
Gigerenzer, G. (2018). ‘Statistical Rituals: The Replication Delusion and How We Got There.’ Advances in Methods and Practices in Psychological Science 1(2), 198218.CrossRefGoogle Scholar
Gigerenzer, G. and Hoffrage, U. (1995). ‘How to Improve Bayesian Reasoning Without Instruction: Frequency Formats.’ Psychological Review 102, 684704.CrossRefGoogle Scholar
Gigerenzer, G., Todd, P.M. and the ABC Research Group (1999). Simple Heuristics That Make Us Smart. New York, NY: Oxford University Press.Google Scholar
Gigerenzer, G., Kraus, S. and Vitouch, O. (2004). ‘The Null Ritual: What You Always Wanted to Know about Null Hypothesis Testing but Were Afraid to Ask.’ In Kaplan, D. (ed.), Handbook on Quantitative Methods in the Social Sciences, pp. 391408. Thousand Oaks, CA: Sage.Google Scholar
Gigone, D. and Hastie, R. (1993). ‘The Common Knowledge Effect: Information Sharing and Group Judgements.’ Journal of Personality and Social Psychology 56, 959–74.CrossRefGoogle Scholar
Habermas, J. (1990). Moral Consciousness and Communicative Action. Cambridge, MA: MIT Press.Google Scholar
Hertwig, R. and Gigerenzer, G. (1999). ‘The “Conjunction Fallacy” Revisited: How Intelligent Inferences Look Like Reasoning Error.’ Journal of Behavioral Decision Making 12, 275305.3.0.CO;2-M>CrossRefGoogle Scholar
John, L.K., Loewenstein, G. and Prelec, D. (2012). ‘Measuring the Prevalence of Questionable Research Practices with Incentives for Truth Telling.’ Psychological Science 23(5), 524–32.CrossRefGoogle ScholarPubMed
Kahan, D.M. (2013). ‘Ideaology, Motivated Reasoning, and Cognitive Reflection.’ Judgment and Decision Making 8, 407–24.Google Scholar
Kahan, D.M., Peters, E., Dawson, E.C. and Slovic, P. (2017). ‘Motivated Numeracy and Enlightened Self-government.’ Behavioural Public Policy 1(1), 5486.CrossRefGoogle Scholar
Kahneman, D. (2011). Thinking Fast and Slow. London: Penguin Books.Google Scholar
Kenyon, T. and Beaulac, G. (2014). ‘Critical Thinking Education and Debiasing.’ Informal Logic 34(4), 341–63.Google Scholar
Kerr, N.L. (1998). ‘HARKing: Hypothesizing After the Results are Known.’ Personality and Social Psychology Review 2(3), 196217.CrossRefGoogle ScholarPubMed
Kicinski, M. (2013). ‘Publication Bias in Recent Meta-analyses.PLoS ONE 8(11). doi: 10.1371/journal.pone.0081823.CrossRefGoogle ScholarPubMed
Kihlstrom, J. (2013). ‘The Person-situation Interaction.’ In Carlston, D. (ed.), The Oxford Handbook of Social Cognition, pp. 786806. Oxford: Oxford University Press.Google Scholar
Klein, R.A., Ratliff, K.A., Vianello, M. et al. (2014). ‘Investigating Variation in Replicability: A ‘Many Labs’ Replication Project.’ Social Psychology 45(3), 142–52.CrossRefGoogle Scholar
Kunda, Z. (1990). ‘The Case for Motivated Reasoning.’ Psychological Bulletin 108(3), 480–98.CrossRefGoogle ScholarPubMed
Lakens, D., Adolfi, F.G., Albers, C.J. et al. (2018). ‘Justify your Alpha.’ Nature Human Behaviour 2(3), 168–71.CrossRefGoogle Scholar
Laughlin, P.R. and Ellis, A.L. (1986). ‘Demonstrability and Social Combination Processes on Mathematical Intellective Tasks.’ Journal of Experimental Social Psychology 22(3), 177–89.CrossRefGoogle Scholar
Lehman, D.R., Lempert, R.O. and Nisbett, R.E. (1988). ‘The Effects of Graduate Training on Reasoning: Formal Discipline and Thinking about Everyday-life Events.’ American Psychologist 43(6), 431–42.CrossRefGoogle Scholar
Lehman, D.R. and Nisbett, R.E. (1990). ‘A Longitudinal Study of the Effect of Undergraduate Training on Reasoning.’ Developmental Psychology 26(6), 952–60.CrossRefGoogle Scholar
Longino, H. (1990). Science as Social Knowledge: Values and Objectivity in Scientific Inquiry. Princeton, NJ: Princeton University Press.CrossRefGoogle Scholar
Lorenz, J., Rauhut, H. and Schweitzer, F. (2011). ‘How Social Influences can Undermine the Wisdom of Crowd Effect.’ Proceedings of the National Academy of Sciences USA 108, 9020–5.CrossRefGoogle Scholar
Meehl, P.E. (1967). ‘Theory-testing in Psychology and Physics: A Methodological Paradox.’ Philosophy of Science 34(2), 103–15.CrossRefGoogle Scholar
Meehl, P.E. (1978). ‘Theoretical Risks and Tabular Asterisks: Sir Karl, Sir Ronald, and the Slow Progress of Soft Psychology.’ Journal of Consulting and Clinical Psychology 46(4), 806–34.CrossRefGoogle Scholar
Mercier, H. and Sperber, D. (2011). ‘Why do Humans Reason? Arguments for an Argumentative Theory.’ Behavioral and Brain Sciences 34(2), 5774.CrossRefGoogle ScholarPubMed
Mercier, H. and Sperber, D. (2017). The Enigma of Reason. Cambridge, MA: Harvard University Press.Google Scholar
Mill, J.S. (2003 [1859]). On Liberty. New Haven, CT: Yale University Press.Google Scholar
Moshman, D. and Geil, M. (1998). ‘Collaborative Reasoning: Evidence for Collective Rationality.’ Thinking and Reasoning 4(3), 231–48.Google Scholar
Munafò, M.R., Nosek, B.A., Bishop, D.V.M., Button, K.S., Chambers, C.D., du Sert N., Percie, Simonsohn, U., Wagenmakers, E.J., Ware, J.J. and Ioannidis, J.P.A. (2017). ‘A Manifesto for Reproducible Science.Nature Human Behaviour 1(1), 0021. doi: 10.1038/s41562-016-0021.CrossRefGoogle ScholarPubMed
Nisbett, R.E. and Wilson, T.D. (1977). ‘Telling More than We can Know: Verbal Reports on Mental Processes.’ Psychological Review 84(3), 231–59.CrossRefGoogle Scholar
Nosek, B.A., Alter, G., Bank, G.C. et al. (2015). ‘Promoting an Open Research Culture.’ Science 348, 1422–5.CrossRefGoogle ScholarPubMed
Nosek, B.A., Ebersole, C.R., DeHaven, A.C. and Mellor, D.T. (2018). ‘The Preregistration Revolution.’ Proceedings of the National Academy of Sciences USA 115(11), 2600–6.CrossRefGoogle ScholarPubMed
Open Science Collaboration (2015). ‘Estimating the Reproducibility of Psychological Science.’ Science 349(6251), 943–51.Google Scholar
Popper, K. (2002 [1996]). The Open Society and Its Enemies. Fifth Edition. New York, NY: Routledge.CrossRefGoogle Scholar
Pronin, E. (2007). ‘Perception and Misperception of Bias in Human Judgment.’ Trends in Cognitive Sciences 11(1), 3743.CrossRefGoogle ScholarPubMed
Pronin, E., Lin, D. and Ross, L. (2002). ‘The Bias Blind Spot: Perceptions of Bias is Self Versus Others.’ Personality and Social Psychology Bulletin 28, 369–81.CrossRefGoogle Scholar
Pronin, E., Gilovich, T. and Ross, L. (2004). Objectivity in the Eye of the Beholder: Divergent Perceptions of Bias in Self Versus Others. Psychological Review 111, 781–99.CrossRefGoogle ScholarPubMed
Ritchart, R. and Perkins, D.N. (2005). ‘Learning to Think: The Challenges of Teaching Thinking.’ In Holyoak, K. and Morrison, R. (eds), The Cambridge Handbook of Thinking and Reasoning, pp. 775802. Cambridge: Cambridge University Press.Google Scholar
Roberts, R.C. and West, R. (2015). ‘Natural Epistemic Defects and Corrective Virtues.’ Synthese 192, 2557–76.CrossRefGoogle Scholar
Rosenthal, R. (1993). ‘Cumulating Evidence.’ In Keren, G. and Lewis, C. (eds), A Handbook for Data Analysis in the Behavioral Sciences: Methodological Issues, pp. 519–59. Hillsdale, NJ: Lawrence Erlbaum.Google Scholar
Samuelson, P.L. and Church, I.M. (2015). ‘When Cognition Turns Vicious: Heuristics and Biases in Light of Virtue Epistemology.’ Philosophical Psychology 28(8), 1095–113.CrossRefGoogle Scholar
Sanna, L., Stocker, S. and Schwarz, N. (2002). ‘When Debiasing Backfires: Accessible Content and Accessibility Experiences in Debiasing Hindsight.’ Journal of Experimental Psychology: Learning, Memory, and Cognition 28(3), 497502.Google ScholarPubMed
Schmidt, S. (2009). ‘Shall We Really do it Again? The Powerful Concept of Replication is Neglected in the Social Sciences.’ Review of General Psychology 13(2), 90100.CrossRefGoogle Scholar
Sedikides, C., Horton, R.S. and Gregg, A.P. (2007). ‘The Why's The Limit: Curtailing Self-enhancement with Explanatory Introspection.’ Journal of Personality 75, 783824.CrossRefGoogle ScholarPubMed
Sedlmeier, P. and Gigerenzer, G. (1989). ‘Do Studies of Statistical Power Have an Effect on the Power of Studies?’ Psychological Bulletin 105, 309–16.CrossRefGoogle Scholar
Skorburg, J.A. (2017). ‘Lessons and New Directions for Extended Cognition from Social and Personality Psychology.’ Philosophical Psychology 30(4), 458–80.CrossRefGoogle Scholar
Skorburg, J.A. and Alfano, M. (2019). ‘Psychological Science and Virtue Epistemology: Intelligence as an Interactionist Virtue.’ In Battaly, H. (ed.), The Routledge Handbook of Virtue Epistemology, pp. 433–45. New York, NY: Routledge.Google Scholar
Stanovich, K.E. (2011). Rationality and the Reflective Mind. Oxford: Oxford University Press.Google Scholar
Sterling, T.D. (1959). ‘Publication Decisions and their Possible Effects on Inferences Drawn from Tests of Significance – or Vice Versa.’ Journal of the American Statistical Association 54(285), 30–4.Google Scholar
Sullivan, E., Sondag, M., Rutter, I., Meulemans, W., Cunningham, S., Speckmann, B. and Alfano, M. (Forthcoming). ‘Can Real Social Epistemic Networks Deliver the Wisdom of Crowds?’ In Lambrozo, T., Knobe, J. and Nichols, S. (eds), Oxford Studies in Experimental Philosophy. Oxford: Oxford University Press.Google Scholar
Sunstein, C. (2003). ‘The Law of Group Polarization.’ In Fishkin, J.S. and Laslett, P. (eds), Debating Deliberative Democracy, pp. 80101. Oxford: Blackwell.CrossRefGoogle Scholar
Sunstein, C. (2009). Going to Extremes: How Like Minds Unite and Divide. Oxford: Oxford University Press.Google Scholar
Szucs, D. and Ionnidis, J.P.A. (2017). ‘Empirical Assessment of Published Effect Sizes and Power in the Recent Cognitive Neuroscience and Psychological Literature.PLOS Biology 15(3). doi: 10.1371/journalpbio.2000797.CrossRefGoogle Scholar
Tetlock, P. (2005). Expert Political Judgment. Princeton, NJ: Princeton University Press.Google Scholar
Tetlock, P. and Gardner, D. (2015). Superforecasting: The Art and Science of Prediction. Toronto: Signal.Google Scholar
Trout, J.D. (2005). ‘Paternalism and Cognitive Bias.’ Law and Philosophy 24, 393434.CrossRefGoogle Scholar
Tversky, A. and Kahneman, D. (1974). ‘Judgement under Uncertainty: Heuristics and Biases.’ Science 185(4157), 1124–31.CrossRefGoogle ScholarPubMed
Vazire, S. (2018). ‘Implications of the Credibility Revolution for Productivity, Creativity, and Progress.’ Perspectives on Psychological Science 13(4), 411–17.CrossRefGoogle ScholarPubMed
Willingham, D.T. (2008). ‘Critical Thinking: Why is it so Hard to Teach?’ Arts Education Policy Review 109(4), 2132.CrossRefGoogle Scholar
Wilson, T.D. (2002). Strangers to Ourselves: Discovering the Adaptive Unconscious. Cambridge, MA: Harvard University Press.Google Scholar
Wilson, T.D., Centerbar, D.B. and Brekke, N. (2002). ‘Mental Contamination and the Debiasing Problem.’ In Gilovich, T., Griffin, D. and Kahneman, D. (eds), Heuristics and Biases: The Psychology of Intuitive Judgment, pp. 185200. Cambridge: Cambridge University Press.CrossRefGoogle Scholar