Hostname: page-component-cd9895bd7-gxg78 Total loading time: 0 Render date: 2024-12-26T16:05:05.922Z Has data issue: false hasContentIssue false

Not feeling right about uncertainty monitoring

Published online by Cambridge University Press:  18 July 2023

Ian R. Newman
Affiliation:
Department of Psychology and Health Studies, University of Saskatchewan, Saskatoon, SK, Canada ian.newman@usask.ca; valerie.thompson@usask.ca
Valerie A. Thompson
Affiliation:
Department of Psychology and Health Studies, University of Saskatchewan, Saskatoon, SK, Canada ian.newman@usask.ca; valerie.thompson@usask.ca

Abstract

De Neys proposed a “switch” model to address what he argued to be lacuna in dual-process theory, in which he theorized about the processes that initiate and terminate analytic thinking. We will argue that the author neglected to acknowledge the abundant literature on metacognitive functions, specifically, the meta-reasoning framework developed by Ackerman and Thompson (2017), that addresses just those questions.

Type
Open Peer Commentary
Copyright
Copyright © The Author(s), 2023. Published by Cambridge University Press

The meta-reasoning framework (Ackerman & Thompson, Reference Ackerman and Thompson2017) differentiates between object-level processes that are responsible for thinking, reasoning, and deciding, and the meta-level process that monitors and controls them. Part of this theory addresses the processes that initiate and terminate analytic thinking, the so-called switch function proposed by De Neys. In the meta-reasoning model, the feeling of rightness (Thompson, Reference Thompson, Evans and Frankish2009; Thompson, Prowse Turner, & Pennycook, Reference Thompson, Prowse Turner and Pennycook2011, Reference Thompson, Prowse Turner, Pennycook, Ball, Brack, Ophir and Ackerman2013) has been proposed as one way that intuitive responses can be monitored and analytic processes initiated.

Thompson argued that system 1 processing is accompanied by a metacognitive experience, a feeling of rightness or certainty that the response(s) generated by system 1 are correct (Thompson, Reference Thompson, Evans and Frankish2009). The relative strength of one's feeling of rightness determines the probability one will switch to and engage system 2; when the feeling is strong, the response is often accepted with little system 2 analysis. Conversely, when the feeling of rightness is weak, system 2 is often engaged. In other words, the feeling of rightness is a cue to either accept the outcome of system 1 processing or “switch” to system 2 processing. Thompson also proposed potential determinants of the strength of a feeling of rightness, such as fluency of processing (speed and ease of response generation) and, importantly, the presence of conflicting responses (Thompson & Johnson, Reference Thompson and Johnson2014; Thompson et al., Reference Thompson, Prowse Turner and Pennycook2011).

Although De Neys briefly acknowledged that his working model could be integrated with the feeling of rightness (sect. 4.4), he neglected a broad and well-established model to propose an explanation for a narrower range of phenomena. The meta-reasoning framework (Ackerman & Thompson, Reference Ackerman and Thompson2017) is a multifaceted framework that encompasses a variety of monitoring and control processes, in addition to a “switch” mechanism. Thus, De Neys's proposal fleshed out the specific case of monitoring for conflict in the broader meta-reasoning framework. We also note the similarity between monitoring feelings of rightness and “uncertainty monitoring,” where one can think about “uncertainty” as the inverse of confidence or feeling of rightness.

De Neys also argued that leading switch accounts presuppose exclusivity, where certain types of responses (e.g., a normatively correct response) are exclusively generated by one system or the other. Thompson and Newman (Reference Thompson and Newman2020) noted that the exclusivity assumption has been long abandoned in dual-process theorizing (Evans, Reference Evans2019; Evans & Stanovich, Reference Evans and Stanovich2013; Stanovich, Reference Stanovich2018; Thompson, Reference Thompson2011) and have obtained evidence in support of this in our own lab (Newman, Gibb, & Thompson, Reference Newman, Gibb and Thompson2017). Most importantly, the feeling of rightness does not depend on the normative qualities of the response generated and, therefore, does not rely on an exclusivity assumption to be instantiated. Essentially, the claim that leading switch accounts presuppose exclusivity is not consistent with current metacognitive models.

We agree with De Neys that many of the processes that monitor our cognitions are likely “system 1” in character: They should not demand working memory resources and their origins are likely not subject to introspection (Koriat, Reference Koriat, Zelazo, Moscovitch and Thompson2007). However, we think there are several important differences between the uncertainty monitoring mechanisms proposed by De Neys and the types of monitoring mechanisms that are common in the metacognitive literature. First, although their origins may not be subject to introspection, their outputs are thought to enter awareness. We have hypothesized that feelings of rightness are felt subjectively (Thompson et al., Reference Thompson, Prowse Turner and Pennycook2011), meaning one is consciously aware, at least to some degree, that they have these feelings. Alternatively, it is not clear that uncertainty monitoring has the same properties.

This difference is subtle but crucial. From a metacognitive perspective, one can be aware of when they feel their response is completely right, completely wrong, or somewhere in between. From an uncertainty monitoring perspective, it seems that one is only aware when one feels a sufficient degree of uncertainty – either from a weakly generated response or two (or more) conflicting responses relatively similar in strength. Therefore, there is no mechanism by which an individual could be aware of when they feel extremely right or wrong, nor for how such feelings could cue the engagement of system 2. Finally, we note that although most monitoring is likely to be implicit, there is also a role for explicit beliefs about oneself, the task, the types of behaviours that constitute good reasoning, and so on (Ackerman, Reference Ackerman2019; Jost, Kruglanski, & Nelson, Reference Jost, Kruglanski and Nelson1998; Koriat, Reference Koriat, Zelazo, Moscovitch and Thompson2007). Thus, not all monitoring processes can be lumped under the “system 1” rubric.

Of most relevance, De Neys's proposed model cannot explain the phenomenon of being highly certain that something is wrong (i.e., feeling of wrongness), such as when a firefighter has a sudden but strong feeling that something is amiss and they must get out of the building immediately (Klein, Calderwood, & Clinton-Cirocco, Reference Klein, Calderwood and Clinton-Cirocco2010). Similarly, I could ask you: Is Edinburgh the capital of Botswana? You may not know the actual capital of Botswana (it is Gaborone), but you likely would have a remarkably strong feeling that it is definitely not Edinburgh. Similarly, one may have a strong feeling of error about a response one has given (Ackerman & Thompson, Reference Ackerman and Thompson2017; Fernandez Cruz, Arango-Muñoz, & Volz, Reference Fernandez Cruz, Arango-Muñoz and Volz2016). Both dimensions of the spectrum are important because a strong feeling about a response (whether it be rightness or wrongness or error; Ackerman & Thompson, Reference Ackerman and Thompson2017) is a cue that action is necessary (Thompson, Reference Thompson, Galbraith, Lucas and Over2017).

De Neys provided a detailed analysis of how reasoners monitor for conflict. However, conflict monitoring is just one part of the role that metacognitive monitoring plays. Moreover, the proposal failed to acknowledge the more comprehensive framework developed by Ackerman and Thompson. It is ultimately an oversimplification of an existing framework that substitutes uncertainty for feeling of rightness, uncertainty monitoring for metacognitive monitoring, and an uncertainty criterion for the diminishing criterion model of confidence (Ackerman, Reference Ackerman2014). We agree with much of the criticism and questions raised by De Neys here (both directly and indirectly) and acknowledge that they are important, but note that frameworks, such as the meta-reasoning framework of Ackerman and Thompson (Reference Ackerman and Thompson2017), already exist to answer them.

Financial support

This work is supported by a Discovery Grant from the Natural Sciences and Engineering Research Council of Canada (NSERC) to Valerie A. Thompson.

Competing interest

None.

References

Ackerman, R. (2014). The diminishing criterion model for metacognitive regulation of time investment. Journal of Experimental Psychology: General, 143(3), 13491368. https://doi.org/10.1037/a0035098CrossRefGoogle ScholarPubMed
Ackerman, R. (2019). Heuristic cues for meta-reasoning judgments: Review and methodology. Psihologijske Teme, 28(1), 120. https://doi.org/10.31820/pt.28.1.1CrossRefGoogle Scholar
Ackerman, R., & Thompson, V. A. (2017). Meta-reasoning: Monitoring and control of thinking and reasoning. Trends in Cognitive Sciences, 21(8), 607617. https://doi.org/10.1016/j.tics.2017.05.004CrossRefGoogle ScholarPubMed
Evans, J. St. B. T. (2019). Reflections on reflection: The nature and function of type 2 processes in dual-process theories of reasoning. Thinking & Reasoning, 25(4), 383415. https://doi.org/10.1080/13546783.2019.1623071CrossRefGoogle Scholar
Evans, J. St. B. T., & Stanovich, K. E. (2013). Dual-process theories of higher cognition: Advancing the debate. Perspectives on Psychological Science, 8(3), 223241. https://doi.org/10.1177/1745691612460685CrossRefGoogle ScholarPubMed
Fernandez Cruz, A. L., Arango-Muñoz, S., & Volz, K. G. (2016). Oops, scratch that! Monitoring one's own errors during mental calculation. Cognition, 146, 110120. https://doi.org/10.1016/j.cognition.2015.09.00CrossRefGoogle ScholarPubMed
Jost, J. T., Kruglanski, A. W., & Nelson, T. O. (1998). Social metacognition: An expansionist review. Personality and Social Psychology Review, 2(2), 137154. https://doi.org/10.1207/s15327957pspr0202_6CrossRefGoogle ScholarPubMed
Klein, G., Calderwood, R., & Clinton-Cirocco, A. (2010). Rapid decision making on the fire ground: The original study plus a postscript. Journal of Cognitive Engineering and Decision Making, 4(3), 186209. https://doi.org/10.1518/155534310X12844000801203CrossRefGoogle Scholar
Koriat, A. (2007). Metacognition and consciousness. In Zelazo, P. D., Moscovitch, M., & Thompson, E. (Eds.), The Cambridge handbook of consciousness (pp. 289325). Cambridge University Press.Google Scholar
Newman, I. R., Gibb, M., & Thompson, V. A. (2017). Rule-based reasoning is fast and belief-based reasoning can be slow: Challenging current explanations of belief-bias and base-rate neglect. Journal of Experimental Psychology: Learning, Memory, and Cognition, 43(7), 11541170. https://doi.org/10.1037/xlm0000372Google ScholarPubMed
Stanovich, K. E. (2018). Miserliness in human cognition: The interaction of detection, override and mindware. Thinking & Reasoning, 24(4), 423444. https://doi.org/10.1080/13546783.2018.1459314CrossRefGoogle Scholar
Thompson, V. A. (2009). Dual-process theories: A metacognitive perspective. In Evans, J. S. B. T. & Frankish, K. (Eds.), In two minds: Dual processes and beyond (pp. 171195). Oxford University Press.10.1093/acprof:oso/9780199230167.003.0008CrossRefGoogle Scholar
Thompson, V. A. (2011). Normativism versus mechanism. Behavioral and Brain Sciences, 34(5), 272273. https://doi.org/10.1017/S0140525X11000574CrossRefGoogle Scholar
Thompson, V. A. (2017). Certainty and action. In Galbraith, N., Lucas, E., & Over, D. E. (Eds.), The thinking mind: A festschrift for Ken Manktelow (pp. 6682). Routledge.Google Scholar
Thompson, V. A., & Johnson, S. C. (2014). Conflict, metacognition, and analytic thinking. Thinking & Reasoning, 20(2), 215244. https://doi.org/10.1080/13546783.2013.869763CrossRefGoogle Scholar
Thompson, V. A., & Newman, I. R. (2020). Working memory, autonomy, and dual process theories: A roadmap. In S. Elqayam, I. Douven, J. S. B. Evans, & N. Cruz (Eds.), Logic and uncertainty in the human mind: A tribute to David E. Over (pp. 227242). Routledge.10.4324/9781315111902-14CrossRefGoogle Scholar
Thompson, V. A., Prowse Turner, J. A., & Pennycook, G. (2011). Intuition, reason, and metacognition. Cognitive Psychology, 63(3), 107140. https://doi.org/10.1016/j.cogpsych.2011.06.001CrossRefGoogle ScholarPubMed
Thompson, V. A., Prowse Turner, J. A. P., Pennycook, G., Ball, L. J., Brack, H., Ophir, Y., & Ackerman, R. (2013). The role of answer fluency and perceptual fluency as metacognitive cues for initiating analytic thinking. Cognition, 128(2), 237251. https://doi.org/10.1016/j.cognition.2012.09.012CrossRefGoogle ScholarPubMed