Money, lies, and replicability: On the need for empirically grounded experimental practices and interdisciplinary discourse

Abstract

This response reinforces the major themes of our target article. The impact of key methodological variables should not be taken for granted. Rather, we suggest grounding experimental practices in empirical evidence. If no evidence is available, decisions about design and implementation ought to be subjected to systematic experimentation. In other words, we argue against empirically blind conventions and against methodological choices based on beliefs, habits, or rituals. Our approach will neither inhibit methodological diversity nor constrain experimental creativity. More likely, it will promote both goals.