Hostname: page-component-78c5997874-ndw9j Total loading time: 0 Render date: 2024-11-10T15:20:31.704Z Has data issue: false hasContentIssue false
  • English
  • Français

Replies to commentaries on the generalizability crisis

Published online by Cambridge University Press:  10 February 2022

Tal Yarkoni Open the ORCID record for Tal Yarkoni [Opens in a new window]
Tal Yarkoni*
Affiliation:
Department of Psychology, The University of Texas at Austin, Austin, TX 78712-1043, USA tyarkoni@gmail.com
Get access Rights & Permissions [Opens in a new window]

Abstract

The 38 commentaries on the target article span a broad range of disciplines and perspectives. I have organized my response to the commentaries around three broad questions: First, how serious are the problems discussed in the target article? Second, are there are other, potentially more productive, ways to think about the issues that the target article framed in terms of generalizability? And third, what, if anything, should we collectively do about these problems?

Type
Author's Response
Information
Behavioral and Brain Sciences , Volume 45 , 2022 , e40
Check for updates
Copyright
Copyright © The Author(s), 2022. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

The “Author's Response” was edited, with my permission, for tone and content by Dr. Barbara Finlay.

References

Adolph, K. E., Eppler, M. A., & Gibson, E. J. (1993). Crawling versus walking infants’ perception of affordances for locomotion over sloping surfaces. Child Development 64(4), 1158–1174.CrossRefGoogle ScholarPubMed
Frank, M. C., Bergelson, E., Bergmann, C., Cristia, A., Floccia, C., Gervain, J.…, Yurovsky, D. (2017). A collaborative approach to infant research: Promoting reproducibility, best practices, and theory-building. Infancy 22(4), 421–435.CrossRefGoogle ScholarPubMed
Grosz, M. P., Rohrer, J. M., & Thoemmes, F. (2020). The taboo against explicit causal inference in nonexperimental psychology. Perspectives on Psychological Science: A Journal of the Association for Psychological Science 15(5), 1243–1255.CrossRefGoogle ScholarPubMed
Grünwald, P. (2005). A tutorial introduction to the minimum description length principle. In Grünwald, P., Myung, I.J., and Pitt, M. (Eds.), Advances in minimum description length: Theory and applications (pp. 3–81). MIT Press.CrossRefGoogle Scholar
Rocca, R., & Yarkoni, T. (in press). Putting psychology to the test: Rethinking model evaluation through benchmarking and prediction. PsyArXiv. https://doi.org/10.31234/osf.io/e437b.Google Scholar
Rohrer, J. M. (2018). Thinking clearly about correlations and causation: Graphical causal models for observational data. Advances in Methods and Practices in Psychological Science 1(1), 27–42.CrossRefGoogle Scholar
Schooler, J. W., & Engstler-Schooler, T. Y. (1990). Verbal overshadowing of visual memories: Some things are better left unsaid. Cognitive Psychology 22(1), 36–71.CrossRefGoogle ScholarPubMed
Yarkoni, T. (2012a). Designing next-generation platforms for evaluating scientific output: What scientists can learn from the social web. Frontiers in Computational Neuroscience 6(October), 72.CrossRefGoogle Scholar
Yarkoni, T. (2012b). Psychoinformatics: New horizons at the interface of the psychological and computing sciences. Current Directions in Psychological Science 21(6), 391–397.CrossRefGoogle Scholar
Yarkoni, T. (2020). Implicit realism impedes progress in psychology: Comment on Fried (2020). Psychological Inquiry 31(4):326–333.CrossRefGoogle Scholar
Yarkoni, T., & Westfall, J. (2017) Choosing prediction over explanation in psychology: Lessons from machine learning. Perspectives on Psychological Science: A Journal of the Association for Psychological Science 12(6):1100–1122.CrossRefGoogle ScholarPubMed