We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.
To save content items to your account,
please confirm that you agree to abide by our usage policies.
If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account.
Find out more about saving content to .
To save content items to your Kindle, first ensure no-reply@cambridge.org
is added to your Approved Personal Document E-mail List under your Personal Document Settings
on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part
of your Kindle email address below.
Find out more about saving to your Kindle.
Note you can select to save to either the @free.kindle.com or @kindle.com variations.
‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi.
‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.
This chapter provides an accessible introduction to experimental methods for social and behavioral scientists. We cover the process of experimentation from generating hypotheses through to statistical analyses. The chapter discusses classical issues (e.g., experimental design, selecting appropriate samples) but also more recent developments that have attracted the attention of experimental researchers. These issues include replication, preregistration, online samples, and power analyses. We also discuss the strengths and weaknesses of experimental methods. We conclude by noting that, for many research questions, experimental methods provide the strongest test of hypothesized causal relationships. Furthermore, well-designed experiments can elicit the same mental processes as in the real world; this typically makes them generalizable to new people and real-life situations.
In the volume’s afterword, the founder of the Discourse–Pragmatic Variation and Change Research network assesses how the field has expanded over recent decades, and offers suggestions for its future development. The afterword discusses the strengths of this volume, including the breadth and diversity of topics covered. It calls for further studies of discourse–pragmatic variation in contact settings, for cross–linguistic comparisons, and for studying languages other than English, arguing that such analyses will facilitate exploration of how discourse–pragmatic variation and change manifests across languages. It also recommends an expansion of data sources, methodological approaches and theoretical frameworks, arguing that such expansion will diversify the kind of research questions discourse variationists can be pursue.
Psycholinguists often use experimental tasks of word recognition as a window onto understanding how we process words. Here, we review results with the lexical decision task that show sensitivity to morphological structure in that word recognition task. We then highlight the limitations of assuming that evidence of morphological processing is best interpreted as evidence that lexical entries are decomposed into constituent morphemes. Further, when target words follow primes formed from the same stem and presented at brief durations so as to tap into early processing in the lexical decision task, we argue that finding no difference between semantically transparent and opaque pairs in individual priming experiments is not sufficient to conclude that early analysis proceeds without regard to a word’s semantic properties. We familiarize the reader with the intricacies of the priming methodology for the lexical decision task and the claim that target recognition benefits from structural priming based on repetition of a stem morpheme in prime and target in . Inwe then discuss how outcomes change with processing time for the prime and its implication for the claim that when processing time for the prime is curtailed, morphological processing is insensitive to semantics. We argue instead that morphological priming cannot be attributed solely to the letter sequence that constitutes the stem in part because stem repetition accounts downplay the role of differences and similarities of whole-word targets with words other than just its prime. Inwe provide evidence that challenges an account of early morphological processing based on the form but not the semantic consequences of shared morphology between prime and target. In , we summarize meta-analytic results with funnel plots to ascertain the reliability of early effects of semantic similarity among morphological relatives in lexical decision, thus refuting support for a decomposition account that is semantically blind and based on stem form. Finally, in , we touch upon the power of tuning form-with-semantics models across languages and writing systems that differ with respect to their morphological structure and neighborhood density measures by emphasizing patterning distributed across words rather than local decomposition into morphemes. As an alternative throughout, we align results with models in which analysis of wordform and meaning are interdependent, rather than two independent and sequential processes, thus discounting the privileged role reserved for the stem.
Competing models of lexical access propose contrasting roles for morphological structure in word recognition. Whole-word models suggest that there are no separate representations for morphemes (e.g., Tyler et al. ); decomposition models posit that words are recognized by accessing their constituent morphemes (e.g., Taft et al. ); and hybrid models incorporate both pathways to recognition (e.g., Bertram et al. ). The relative productivity of a word’s derivational affixes may also play a role: words with unproductive affixes are processed holistically whereas words with productive derivational affixes are processed as a function of their morphemes (e.g., Balling and Baayen ). In this paper, we examine the role of the Semitic consonantal root, known to be a route for lexical retrieval, and its interaction with relative binyan productivity. Extending the methodology developed by Wray () for Jordanian Arabic, we investigate the Semitic language Maltese. Based on two auditory lexical decision experiments, we find a reverse base frequency effect in a productive binyan (words with more frequent roots are recognized more slowly than words with less frequent roots), and in two less productive binyanim we find no base frequency effect. This supports the validity of models in which morphological decomposition is relevant strictly for productive affixes.
The present study explores the learnability of complex morphological patterns, specifically number and gender categories. The typology of morphological systems suggests that infrequent, complex, and structurally marked categories such as the dual are more likely to show neutralization or syncretism than unmarked categories. In two artificial language learning experiments, adult English speakers were exposed to a language with noun class categories both for gender and number. Results suggest that syncretism of gender across dual forms allows for greater learnability of the dual form. However, overall learnability was not affected by whether syncretism occurred in the singular, dual, or plural. These results further the understanding of the cognitive mechanisms that shape complex morphological patterns.
When do voters punish corrupt politicians? Heterogeneous views about the importance of corruption can determine whether or not increased information enhances accountability. If partisan cleavages correlate with the importance voters place on corruption, then the consequences of information may vary by candidate, even when voters identify multiple candidates as corrupt. We provide evidence of this mechanism from a field experiment in a mayoral election in Brazil where a reputable interest group declared both candidates corrupt. We distributed fliers in the runoff mayoral election in São Paulo. Informing voters about the challenger's record reduced turnout by 1.9 percentage points and increased the opponent's vote by 2.6 percentage points. Informing voters about the incumbent's record had no effect on behavior. We attribute this divergent finding to differences in how each candidate's supporters view corruption. Using survey data and a survey experiment, we show that the challenger's supporters are more willing to punish their candidate for corruption, while the incumbent's supporters lack this inclination.
Anaphora play a key role in syntactic theorizing, but experimental investigations of coreference – especially when using acceptability judgments – involve unique methodological challenges. Given that non-linguist participants are unlikely to be familiar with linguistic notations such as the use of subscripts, how can researchers indicate the coreference relation whose acceptability is being assessed? In other words, if a researcher wants to test whether a particular coindexation relation is acceptable, how can this information be conveyed to participants? Ignoring this issue can yield uninterpretable data. This chapter provides an in-depth discussion of different methods for indicating coreference when researchers want to elicit acceptability judgments from participants who are not trained linguists. The chapter also discusses other approaches relevant for anaphora, including antecedent-choice tasks and real-time methods (self-paced reading, eye-tracking), and explains how they differ in terms of the kind of data they yield and thus the kinds of hypotheses they can be used to investigate.
This chapter examines the role of experimentation within the social identity approach to the study of identity. The main question of interest concerns the ways in which experimental methods give particular shape to how identity is understood within this tradition. We will examine the historical, theoretical, and practical development of the social identity approach and of experimentation in psychology, and then show how the two have converged so as to create an insightful, and yet simultaneously limited and at times even problematic, understanding of identity. This particular constellation of theoretical assumptions and practical methods has produced an impressive body of important research. It has also led to the establishment and entrenchment of theoretical and methodological biases of which researchers often seem to be unaware, but which nevertheless considerably influence the study of identity within the social identity tradition. Thus, in light of the rich output of the social identity approach, the chapter examines some of the limitations of that tradition and attempts to draw researchers’ attention to the theoretical and methods-based biases of which they may not be aware. In this way, the chapter is an attempt to explore how experimental methods and theory have interacted within the social identity tradition to both the benefit and detriment of our understanding of identity.
At present, much of the research on bilingual cognition focuses on late second language learners of a small number of languages. In this fascinating book, Evangelia Adamou widens the net by integrating advances in the field of bilingualism with the study of endangered languages. Drawing on recent studies from Europe and Latin America, she demonstrates that experimental psycholinguistic methods can be successfully applied outside the lab and, conversely, how data from these understudied populations provide new insights into the adaptive capacities of the bilingual mind. Adamou shows how bilinguals manage competing conceptualizations of time and space, how their grammars and language mixing patterns adapt to cognitive constraints such as the need for simplification, and how language processing concurrently adapts to their complex bilingual experience. Combining statistical analyses with detailed linguistic and ethnographic information, this essential book will appeal to scholars of bilingualism, cognitive sciences, language endangerment, and language contact.
Recent research suggests widespread misperception about the political views of others. Measuring perceptions often relies on instruments that do not separate uncertainty from inaccuracy. We present new experimental measures of second-order political beliefs. To carefully measure political (mis)perceptions, we have subjects report beliefs as probabilities. To encourage accuracy, we provide micro-incentives for each response. To measure learning, we provide information sequentially about the perception of interest. We illustrate our method by applying it to perceptions of vote choice in the 2016 presidential election. Subjects made inferences about randomly selected American National Election Study (ANES) respondents. Before and after receiving information about the other, subjects reported a probabilistic belief about the other’s vote. We find that perceptions are less biased than in previous work on second-order beliefs. Accuracy increased most with the delivery of party identification and report of a most important problem. We also find evidence of modest egocentric and different-trait bias.
Experimental political science has changed. In two short decades, it evolved from an emergent method to an accepted method to a primary method. The challenge now is to ensure that experimentalists design sound studies and implement them in ways that illuminate cause and effect. Ethical boundaries must also be respected, results interpreted in a transparent manner, and data and research materials must be shared to ensure others can build on what has been learned. This book explores the application of new designs; the introduction of novel data sources, measurement approaches, and statistical methods; the use of experiments in more substantive domains; and discipline-wide discussions about the robustness, generalizability, and ethics of experiments in political science. By exploring these novel opportunities while also highlighting the concomitant challenges, this volume enables scholars and practitioners to conduct high-quality experiments that will make key contributions to knowledge.
How does an individual's criminal record shape interactions with the state and society? This article presents evidence from a nationwide field experiment in the United States, which shows that prospective applicants with criminal records are about 5 percentage points less likely to receive information from college admission offices. However, this bias does not extend to race: there is no difference in response rates to Black and White applicants. The authors further show that bias is all but absent in public bureaucracies, as discrimination against formerly incarcerated applicants is driven by private schools. Examining why bias is stronger for private colleges, the study demonstrates that the private–public difference persists even after accounting for college selectivity, socio-economic composition and school finances. Moving beyond the measurement of bias, an intervention designed to reduce discrimination is evaluated: whether an email from an advocate mitigates bias associated with a criminal record. No evidence is found that advocate endorsements decrease bureaucratic bias.
The use of deception is common in elite correspondence audit studies. Elite audit studies are a type of field experiment used by researchers to test for discrimination against vulnerable populations seeking to access government resources. These studies have provided invaluable insights, but they have done so at the cost of using deception. They have relied on identity, activity, and motivation deception. In addition, they request unnecessary work. Is there a less deceptive alternative? In this article, I present results from a field experiment with state legislative offices that minimize the use of deception. Consistent with elite correspondence audit studies, I find evidence of discrimination against Hispanics among state legislative offices. In addition, I find that discrimination is mitigated when subjects believe their behavior will be public knowledge. This suggests that discrimination can be mitigated through increased monitoring. This article advances the discussion on how to minimize the use of deception in elite field experimentation and how to mitigate discrimination against vulnerable populations.
The success of protests depends on whether they favorably affect public opinion: nonviolent resistance can win public support for a movement, but regimes counter by framing protest as violent and instigated by outsiders. The authors argue that public perceptions of whether a protest is violent shift based on the framing of the types of action and the identities of participants in those actions. The article distinguishes between three dimensions: (1) threat of harm, (2) bearing of arms and (3) identity of protesters. Using survey experiments in Israel and the United States, the study finds support for framing effects. Threat of harm has the largest positive effect on perceptions of violence and support for repression. Surprisingly, social out-groups are not perceived as more violent, but respondents favor repressing them anyway. Support for repressing a nonthreatening out-group is at least as large as support for repressing a threatening in-group. The findings link contentious action and public opinion, and demonstrate the susceptibility of this link to framing.
Recent work on legislative politics has documented complex patterns of interaction and collaboration through the lens of network analysis. In a largely separate vein of research, the field experiment—with many applications in state legislatures—has emerged as an important approach in establishing causal identification in the study of legislative politics. The stable unit treatment value assumption (SUTVA)—the assumption that a unit's outcome is unaffected by other units' treatment statuses— is required in conventional approaches to causal inference with experiments. When SUTVA is violated via networked social interaction, treatment effects spread to control units through the network structure. We review recently developed methods that can be used to account for interference in the analysis of data from field experiments on state legislatures. The methods we review require the researcher to specify a spillover model, according to which legislators influence each other, and specify the network through which spillover occurs. We discuss these and other specification steps in detail. We find mixed evidence for spillover effects in data from two previously published field experiments. Our replication analyses illustrate how researchers can use recently developed methods to test for interference effects, and support the case for considering interference effects in experiments on state legislatures.
In the present study, children's early ability to organise words into sentences was investigated using the Weird Word Order procedure with Spanish-speaking children. Spanish is a language that allows for more flexibility in the positions of subjects and objects, with respect to verbs, than other previously studied languages (English, French, and Japanese). As in prior studies (Abbot-Smith et al., 2001; Chang et al., 2009; Franck et al., 2011; Matthews et al., 2005, 2007), we manipulated the relative frequency of verbs in training sessions with two age groups (three- and four-year-old children). Results supported earlier findings with regard to frequency: children produced atypical word orders significantly more often with infrequent verbs than with frequent verbs. The findings from the present study support probabilistic learning models which allow higher levels of flexibility and, in turn, oppose hypotheses that defend early access to advanced grammatical knowledge.
During the eurozone crisis, technocratic governments were appointed in several eurozone countries, becoming in the eyes of many the embodiment of the EU's democratic deficit. In spite of the central place that these technocratic governments occupy in the scholarly debate, however, we have remarkably little evidence on Europeans’ attitudes towards technocracy, and technocratic governments are under-studied from an empirical standpoint. We contribute to the very limited empirical literature on this topic by using a novel natural experiment design, in the context of the 2011 Italian crisis that led to the appointment of the Monti technocratic cabinet. We hypothesize that the effect of technocratic appointments on citizens’ satisfaction with democracy is a priori uncertain, and it depends on the balance of a trade-off between reduced input participation and increased output effectiveness. Overall, the results point to citizens’ attitudes towards technocracy being more complex than often assumed in the debate.
Recent scholarly work has discovered that modest changes in the framing of the titles and summaries of ballot measures can have dramatic effects on voter approval. This work expands upon these findings by exploring the effect of language specificity on support for ballot propositions that require the voter to pay for the measure with tax dollars. Although extensive research has explored ballot measure language complexity (e.g., position on the ballot, electoral effects, and prepossessed knowledge have all been shown to play a role in the outcome for propositions), left unanswered is the role of detailed language in altering support. Utilizing original experimental data, this work explores the framing effects of increasing specificity of proposed use of tax expenditures on support for ballot questions. Ultimately, this research finds that propositions providing more information to voters substantially increases the likelihood of support for those measures. Moreover, this increased specificity also bolsters certainty as to how the money will be spent, and intensifies how strongly voters feel about the issues being considered.
In England and Wales less than half of the adult population report that they have a will, with similarly low numbers found in other jurisdictions. Dying intestate can have profound implications on the family relationships, housing security, finances, employment, health and welfare of those who are left behind. Social policy initiatives designed to educate the public on the implications of intestacy offer a potential solution but remain difficult to evaluate. This article explores the results of a public legal education experiment embedded in a longitudinal panel survey. The experiment was designed to explore: (1) the impact of information provision on will creation; and, (2) how ‘opportunistic experiments’ embedded in longitudinal surveys might support public legal education (PLE) evaluation. Whilst the impact of the information intervention in this study was not found to be statistically significant, the methodology points to the possibility of testing more bespoke and substantial initiatives in the future.
Intuitive thinking would argue that political or ideological orientation does not correlate with nonpolitical decisions, and certainly not with nonideological cognitive tasks. However, that is what happens in some cases. Previous neuropolitics studies have found that liberals are more adept at dealing with novel information than conservatives. This finding suggests that conservatives and liberals possess different cognitive skills. For the purposes of this article, two studies were executed to test whether this difference remained in alternative environmental settings. To this end, two novel cognitive tasks were designed in which one type of ideology or another was privileged according to the cognitive environment created by the tasks. Experimental findings indicate that liberals committed fewer errors than conservatives in one kind of cognitive environment, while conservatives scored higher in another.