Hostname: page-component-5f745c7db-8qdnt Total loading time: 0 Render date: 2025-01-06T06:51:10.880Z Has data issue: true hasContentIssue false

Instructions

Published online by Cambridge University Press:  01 January 2025

David J. Freeman*
Affiliation:
Department of Economics, Simon Fraser University, 8888 University Dr, Burnaby, BC V5S 1A6, Canada
Erik O. Kimbrough
Affiliation:
Smith Institute for Political Economy and Philosophy, Chapman University, One University Drive, Orange, CA 92866, USA
Garrett M. Petersen
Affiliation:
Department of Economics, Simon Fraser University, 8888 University Dr, Burnaby, BC V5S 1A6, Canada
Hanh T. Tong
Affiliation:
Department of Economics, Simon Fraser University, 8888 University Dr, Burnaby, BC V5S 1A6, Canada

Abstract

A survey of instruction delivery and reinforcement methods in recent laboratory experiments reveals a wide and inconsistently reported variety of practices and limited research evaluating their effectiveness. Thus, we experimentally compare how methods of delivering and reinforcing experiment instructions impact subjects’ comprehension and retention of payoff-relevant information. We report a one-shot individual decision task in which non-money-maximizing behavior can be unambiguously identified and find that such behavior is prevalent in our baseline treatment which uses plain, but relatively standard experimental instructions. We find combinations of reinforcement methods that can eliminate half of non-money-maximizing behavior, and we find that we can induce a similar reduction via enhancements to the content of instructions. Residual non-money-maximizing behavior suggests that this may be an important source of noise in experimental studies.

Type
Methodology Paper
Copyright
Copyright © 2018 Economic Science Association

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

Electronic supplementary material The online version of this article (https://doi.org/10.1007/s40881-018-0059-0) contains supplementary material, which is available to authorized users.

References

Alekseev, A., Charness, G., Gneezy, U. (2017). Experimental methods: When and why contextual instructions are important. Journal of Economic Behavior and Organization, 134, 4859. 10.1016/j.jebo.2016.12.005CrossRefGoogle Scholar
Bigoni, M., Dragone, D. (2012). Effective and efficient experimental instructions. Economics Letters, 117(2), 460463. 10.1016/j.econlet.2012.06.049CrossRefGoogle Scholar
Cassar, A., Friedman, D. (2004). Economics lab: An intensive course in experimental economics, London: Routledge 10.4324/9780203356845CrossRefGoogle Scholar
Chen, R., Chen, Y., & Riyanto, Y. (2018). Public knowledge in coordination games: Learning from non-replication. Working Paper.Google Scholar
Converse, J., Presser, S. (1986). Survey questions: Handcrafting the standadized questionnaire, Thousand Oaks: Sage 10.4135/9781412986045CrossRefGoogle Scholar
Davis, D. D., Holt, C. A. (1993). Experimental economics, Princeton: Princeton University Press.CrossRefGoogle Scholar
Fouraker, L. E., Siegel, S. (1963). Bargaining behavior, New York: McGraw-Hill.Google Scholar
Friedman, D., Sunder, S. (1994). Experimental methods: A primer for economists, Cambridge: Cambridge University Press 10.1017/CBO9781139174176CrossRefGoogle Scholar
Gill, D., Prowse, V. (2012). A structural analysis of disappointment aversion in a real effort competition. American Economic Review, 102(1), 469503. 10.1257/aer.102.1.469CrossRefGoogle Scholar
Hertwig, R., Ortmann, A. (2001). Experimental practices in economics: A methodological challenge for psychologists? Behavioral and Brain Sciences, 24(3), 383403.CrossRefGoogle ScholarPubMed
Imai, K., Keele, L., Yamamoto, T. (2010). Identification, inference, and sensitivity analysis for causal mediation effects. Statistical Science, 25(1), 5171. 10.1214/10-STS321CrossRefGoogle Scholar
Ramalingam, A., Morales, A., Walker, J. (2018). Instruction length and content: Effects on punishment behaviour in public goods games. Journal of Behavioral and Experimental Economics, 73, 6673. 10.1016/j.socec.2018.01.008CrossRefGoogle Scholar
Smith, V. L. (1982). Microeconomic systems as an experimental science. The American Economic Review, 72(5), 923955.Google Scholar
Supplementary material: File

Freeman et al. supplementary material

Freeman et al. supplementary material
Download Freeman et al. supplementary material(File)
File 2 MB