We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.
To save content items to your account,
please confirm that you agree to abide by our usage policies.
If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account.
Find out more about saving content to .
To save content items to your Kindle, first ensure no-reply@cambridge.org
is added to your Approved Personal Document E-mail List under your Personal Document Settings
on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part
of your Kindle email address below.
Find out more about saving to your Kindle.
Note you can select to save to either the @free.kindle.com or @kindle.com variations.
‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi.
‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.
Field research refers to research conducted with a high degree of naturalism. The first part of this chapter provides a definition of field research and discusses advantages and limitations. We then provide a brief overview of observational field research methods, followed by an in-depth overview of experimental field research methods. We discuss randomization schemes of different types in field experimentation, such as cluster randomization, block randomization, and randomized rollout or waitlist designs, as well as statistical implementation concerns when conducting field experiments, including spillover, attrition, and noncompliance. The second part of the chapter provides an overview of important considerations when conducting field research. We discuss the psychology of construal in the design of field research, conducting non-WEIRD field research, replicability and generalizability, and how technological advances have impacted field research. We end by discussing career considerations for psychologists who want to get involved in field research.
In light of findings from research on informal foreign/second language (L2) learning, with a focus on English as a target language and using the concept of extramural English (EE), this position paper argues that learners’ engagement in EE (through activities such as watching television or films or playing digital games) constitutes an important individual difference (ID) variable that needs to be included in studies that aim to measure L2 English proficiency or development. In addition, it is suggested that if EE as an ID variable is left out in such studies in the future, the rationale for exclusion should be clearly stated. This position paper also discusses research instruments and methods used in this area of research, the benefits and drawbacks of different methods, and identifies research gaps and under-researched learner groups. Further, it is argued that in some contexts, EE has replaced classroom activities as the starting point for and foundation of learning English.
Chapter 9 examines how speech acts associated with ritual can be examined in a replicable way. The chapter makes an argument against ‘identifying’ new so-called ‘ritual speech acts’ ad libitum because such a procedure shuts the door on studying speech acts through which ritual is realised in a replicable way. Instead, it is a more productive practice to identify and describe one’ subject of analysis with the aid of a finite typology of speech acts. The next task is to consider how this speech act is realised in a particular ritual frame. Chapter 9 provides a case study of the ritual phenomenon of ‘admonishing’ in a corpus of ancient Chinese texts. Admonishing represents a ritual realisation type of the Attitudinal speech act category Suggest (do-x)/(not-to-do-x).
Chapters 10 and 11 provide a solution for the study of interactionally complex ritual phenomena, by systematically breaking them down into replicable pragmatic units of analysis. The complexity of a ritual phenomenon can either mean that a phenomenon is too broad to be discussed as a single ritual, i.e., it represents a form of ritual behaviour which spans across many different ritual contexts, or it represents a particular context and related ritual frame which triggers ritual behaviour but cannot be subsumed under a single ritual heading from the pragmatician’s point of view. Chapter 11 focuses on the second type of difficulty: it proposes a discourse-analytic approach through which seemingly ad hoc and erratic interactional ritual behaviour in a single complex ritual frame can be studied in a replicable way. As a case study, the chapter will examine ritual bargaining in Chinese markets. While bargaining is a ritual in the popular sense of the word, it is problematic from the pragmatician’s point of view to refer to bargaining as a ritual, without considering whether and how it manifests itself in recurrent patterns of ritual language use.
Chapter 8 considers the relationship between expressions, the smallest unit of pragmatic analysis, and ritual. The chapter will provide a bottom–up, corpus-based and replicable approach through which expressions associated with structurally or functionally ritual speech acts are used to indicate awareness of the different ritual frame. Structurally ritual speech acts include speech acts like Greet and Leave-Take which occur in ritual parts of an interaction, while functionally ritual speech acts encompass speech acts like Request and Apologise which tend to be realised in a ritual way in many contexts. The chapter points out that the relationship between expressions and interaction ritual can be best captured through a contrastive pragmatic lens because the contrastive view allows the researcher to consider how strongly a pragmatically important expression tends to indicate a functionally or structurally ritual speech act when pitted against a comparable expression in another – preferably typologically distant – linguaculture. The chapter provides a case study of Chinese and English expressions associated with the ritually performed speech act Apologise as a case study.
Chapters 10 and 11 provide a solution for the study of interactionally complex ritual phenomena, by systematically breaking them down into replicable pragmatic units of analysis. The complexity of a ritual phenomenon can either mean that a phenomenon is too broad to be discussed as a single ritual, i.e., it represents a form of ritual behaviour which spans across many different ritual contexts, or it represents a particular context and related ritual frame which triggers ritual behaviour but cannot be subsumed under a single ritual heading from the pragmatician’s point of view. Chapter 10 focuses on the first of these cases: it explores the ritual phenomenon of self-denigration in Chinese. Self-denigration occurs in many different contexts of Chinese ritual practices and ceremonies, and if one attempts to describe its pragmatic features by relying on data drawn from a single context one unavoidably risks oversimplifying it. Rather, in the study of such a ritual phenomenon one should consider how it is used in different interpersonal scenarios with varying power and intimacy and in different phases of an interaction.
The majority of research papers in computer-assisted language learning (CALL) report on primarily quantitative studies measuring the effectiveness of pedagogical interventions in relation to language learning outcomes. These studies are frequently referred to in the literature as experiments, although this designation is often incorrect because of the approach to sampling that has been used. This methodological discussion paper provides a broad overview of the current CALL literature, examining reported trends in the field that relate to experimental research and the recommendations made for improving practice. It finds that little attention is given to sampling, even in review articles. This indicates that sampling problems are widespread and that there may be limited awareness of the role of formal sampling procedures in experimental reasoning. The paper then reviews the roles of two key aspects of sampling in experiments: random selection of participants and random assignation of participants to control and experimental conditions. The corresponding differences between experimental and quasi-experimental studies are discussed, along with the implications for interpreting a study’s results. Acknowledging that genuine experimental sampling procedures will not be possible for many CALL researchers, the final section of the paper presents practical recommendations for improved design, reporting, review, and interpretation of quasi-experimental studies in the field.
A ‘control’ provides a point of clinical comparison for a new intervention, allowing researchers and clinicians to draw more confident conclusions about the effectiveness or potential harm of a given, often novel, therapy. Although this aspect of a trial's design provides the basis from which interventional impact is measured, it is often less closely examined. This commentary appraises a Cochrane Review that compares various controls in common use in modern psychiatric research and aims to characterise their effects on the outcomes of that research.
This chapter understands the Linguistic Landscape (LL) as a flow of discourse in time. LL units are structured as texts, materials, and discourse, but the LL only unfolds when these units engage the sign instigator and the sign viewer in discourse in the public eye. Using the foodscape as a focal point, the boundaries between the LL and other social practices are examined. A review of LL research methodology examines the role of photographs and the photographer’s point of view, fieldwork approaches that include interviews and reflexive ethnography, and the position of quantitative analysis. The chapter discusses relationships between the material LL and online linguistic landscapes (OLL), examining language displays in the OLL and ways in which users transcend the apparent boundaries between the two. Pointing out the long history of representing the LL in literature, the chapter discusses James Joyce’s Ulysses for its portrayal of the outer forms of the LL and its representation of the inner world of characters who move through the LL. Recommendations are made for further expansion of the field geographically, temporally, materially, and ethnographically.
With more than 1,200 publications over the past two decades, experimental mobile-assisted language learning (MALL) studies targeting second/foreign language (L2) acquisition outcomes are certainly not lacking in quantity. Their research quality, on the other hand, has often been brought into question, most notably with regard to the adequacy of their assessment instruments and statistical analyses. Yet limiting the determination of research quality to the evaluation of testing procedures, and the statistical analysis of the results they produce, ignores the critical relevance of the underlying research parameters that generate the results in the first place. A comprehensive evaluation of quantitative experimental L2 acquisition MALL research quality, encompassing design as well as assessment instruments and statistical analysis, thus remains to be undertaken. The present investigation endeavors to do so based on an extensive compilation of 737 MALL studies published between 2000 and 2021. The research quality of these publications is evaluated according to four main parameters: language acquisition moderators, treatment intervention conditions, assessment instruments, and statistical analysis. These are applied according to a modified version of the Checklist for the Rigor of Education-Experiment Designs (CREED), which classifies research design quality into five levels: low, medium-low, medium, medium-high, high. With over three quarters of all studies falling within the low category, the result leaves much to be desired. Since the modified CREED algorithm developed here can equally be applied to studies from their inception, it offers a way forward to improve the research quality of future experimental MALL studies.
The chapter ’Going on Pawtrol’ describes how to conduct linguistic research using the cat examples from the original research done for this book. It looks at methodological issues, like research design, research methods, sampling methods, data collection, wordlists, and surveys. The chapter also discusses ethics in relation to the protection of research participants and the research, touching on the laws in place to protect people’s privacy and data and the ethical guidelines established for researchers.
Empirical studies in economics traditionally use a limited range of methods, usually based on particular types of regression analysis. Increasingly, sophisticated regression techniques require the availability of appropriate data sets, often longitudinal and typically collected at a national level. This raises challenges for researchers seeking to investigate issues requiring data that are not typically included in regular large-scale data. It also raises questions of the adequacy of relying mainly or solely on regression analysis for investigating key issues of economic theory and policy. One way of addressing these issues is to employ a mixed-methods research framework to investigate important research questions. In this article, we provide an example of applying a mixed-methods design to investigate the employment decisions of mature age women working in the aged care sector. We outline the use of a coherent and robust framework to allow the integrated collection and analysis of quantitative and qualitative data. Drawing on particular examples from our analysis, we show how a mixed-methods approach facilitates richer insights, more finely grained understandings of causal relationships and identification of emergent issues. We conclude that mixed-methods research has the capacity to provide surprises and generate new insights through detailed exploratory data analysis.
Chapter 1 examines the conceptual and methodological foundations that underlie this volume. Conceptually, it delineates transnational ‘law’ as consisting simply of that collection of transnational institutions and practices with which persons with legal training are increasingly engaged. The purpose of this volume, correspondingly, is to facilitate such engagement: to help the legal actor better understand what to look for and what the implications are of what she finds when she encounters such institutions and practices. Its methodology involves identifying the various ‘facets’ of transnational institutions and practices that are of most interest to persons working from the perspective of law (e.g., regulatory activities, governance structures); exploring how different regulatory regimes structure these facets in different ways so as to serve different regulatory purposes; and investigating how a regime’s structuring of that facet affects what the other facets of that regime can and cannot do effectively and, beyond that, the reach and shape of the regime’s overall legitimacy.
Co-evolution accounts have generally been used to describe how problems and solutions both change during the design process. More generally, problems and solutions can be considered as analytic categories, where change is seen to occur within categories or across categories. There are more categories of interest than just problems and solutions, for example, the participants in a design process (such as members of a design team or different design teams) and categories defined by design ontologies (such as function-behaviour-structure or concept-knowledge). In this paper, we consider the co-evolution of different analytic categories (not just problems and solutions), by focussing on how changes to a category originate either from inside or outside that category. We then illustrate this approach by applying it to data from a single design session using three different systems of categorisation (problems and solutions, different designers and function, behaviour and structure). This allows us to represent the reciprocal influence of change within and between these different categories, while using a common notation and common approach to graphing quantitative data. Our approach demonstrates how research traditions that are currently distinct from each other (such as co-evolution, collaboration and function-behaviour-structure) can be connected by a single analytic approach.
The diversity of design research studies and their associated methods and reporting style make it difficult for the design research community of practice to leverage its work into further advancing the field. We illustrate how a structured multilevel analysis of diverse studies creates a canonical model that allows for the transfer of insight between studies, enhances their comprehension, and supports improved study designs. The benefits of such an approach will increase if different stakeholders adopt such structured approaches to enrich the design research community of practice.
This paper explores the thorny mingling of law with qualitative social science methodologies through the lens of the 2010–11 Supreme Court of British Columbia Charter Reference on polygamy, which was conducted to determine whether the criminalization of polygamy was consistent with the Canadian Charter of Rights and Freedoms. The Reference reveals how the marginalization of qualitative research(ers) effectively controlled whose voices were to be heard and whose were to be silenced in the broader project of sovereign intervention into family formation. With specific focus on Professor Angela Campbell, who provided expert opinion testimony in the Reference, this paper reflects on two important questions: when social science is invoked in legal settings, whose knowledge is legitimized, and who benefits from this legitimization? Drawing upon the longstanding feminist project of deconstructing assumptions of value-neutrality in all science, this paper considers how qualitative, feminist research(ers) may be inherently at odds with law’s quest for (rational) “truth.”
This chapter details how data are gathered, analyzed, and debated in a way which distinguishes citizen sociolinguistics from typical social science methodology, exemplifying and discussing several distinctions: The tools used to gather data are often misuses of other data tools like dialect surveys, language quizzes, or Google Translate; objective “accuracy” is less important than “likes” or popularity; sharing data is commonplace and necessary, given the importance of popularity for validity; transcripts are not kept in a locked drawer, but openly circulated; transcription of talk (often using phonetic spelling, emojis, or creative punctuation) is not “accurate” or “inaccurate” but is a form of interpretation in itself; making friends with research participants is not creepy overstepping but the essence of citizen sociolinguistic inquiry and a serendipitous way in which findings are disseminated. Validity, then, is built through participation in this community, rather than appeal to another knowledge base (such as published academic research). This chapter concludes with a short guide for fostering and exploring everyday conversations about language, whether fomented by curiosity and wonderment or critique and arrest.
In any given interaction, what counts as smart or insightful or correct, can be produced through feedback loops: Face-to-face, nods of agreement suggest we have the right answer. Online, the “best answer” moves to the top of Yahoo Answers, the “top definition” is the first seen in Urban Dictionary, and the most-viewed hits for “succinct pronunciation?” moves to the top of a google search. All the other answers drift further down your screen. This chapter illustrates both the positive and negative effects of feedback loops on how we talk about language and how we function as citizens. We’ll look at how feedback loops have the potential both to create a reality through the senses of shared identity and positive affiliation they can create and to put up barriers that keep people isolated from others’ ideas. Then, we’ll look closely at one case at Duke University in which citizen sociolinguists were able to disrupt entrenched social norms by breaking down those feedback loops and exposing different assumptions behind the ways we use language.
Machine learning (ML) provides the ability to examine massive datasets and uncover patterns within data without relying on a priori assumptions such as specific variable associations, linearity in relationships, or prespecified statistical interactions. However, the application of ML to healthcare data has been met with mixed results, especially when using administrative datasets such as the electronic health record. The black box nature of many ML algorithms contributes to an erroneous assumption that these algorithms can overcome major data issues inherent in large administrative healthcare data. As with other research endeavors, good data and analytic design is crucial to ML-based studies. In this paper, we will provide an overview of common misconceptions for ML, the corresponding truths, and suggestions for incorporating these methods into healthcare research while maintaining a sound study design.
The introduction provides a guide for readers and sets out the research methodology of the book. Evident is the structural nature of the racism undergirding the predatory lending scams in the 2000s, along with the inertia over a decade later that precludes help for individuals that have been victimized. Institutional policies in private financial institutions and public bodies provide little redress for many individuals victimized by predatory lending, exacerbating the racial wealth gap. The chapter introduces the need for a normative shift in lending practices that embeds accountability. It introduces the plight of mortgagors in three of the cities hardest hit by the subprime crisis, and recounts stories of loss and of the frustration of their legal advocates. We introduce several critically important questions. What are the intergenerational harms caused by the continuing crisis and what mechanisms might be available to change that trajectory? What structurally can be accomplished in an era of deregulatory priority? What are the current implications for middle class and working class Americans of all races with respect to the most recent developments?