Pointing plays a significant role in communication and language development. However, in spoken languages pointing has been viewed as a non-verbal gesture, whereas in sign languages, pointing is regarded to represent a linguistic unit of language. This study compared the use of pointing between seven bilingual hearing children of deaf parents (Kids of Deaf Adults [KODAs]) interacting with their deaf parents and five hearing children interacting with their hearing parents. Data were collected in 6-month intervals from the age of 1;0 to 3;0. Pointing frequency among the deaf parents and KODAs was significantly higher than among the hearing parents and their children. In signing dyads pointing frequency remained stable, whereas in spoken dyads it decreased during the follow-up. These findings suggested that pointing is a fundamental element of parent-child interaction, regardless of the language, but is guided by the modality, gestural and linguistic features of the language in question.

When people speak, they gesture. However, is the audience watching a speaker who is sensitive to this link? We translated the body movements of politicians into stick-figure animations and separated the visual from the audio channel. We then asked participants to match a selection of five audio tracks (including the correct one) with the stick-figure animations. The participants made correct decisions in 65% of all cases (chance level of 20%). Matching voices with animations was less difficult when politicians showed expansive movements and spoke with a loud voice. Thus, people are sensitive to the link between motion cues and vocal cues, and this link appears to become even more apparent when a speaker shows expressive behaviors. Future work will have to refine and validate the methods applied and investigate how mismatches between communication channels affect the impressions that people form of politicians.

In parliamentary committee oversight hearings on fiscal policy, monetary policy, and financial stability, where verbal deliberation is the focus, nonverbal communication may be crucial in the acceptance or rejection of arguments proffered by policymakers. Systematic qualitative coding of these hearings in the 2010–15 U.K. Parliament finds the following: (1) facial expressions, particularly in the form of anger and contempt, are more prevalent in fiscal policy hearings, where backbench parliamentarians hold frontbench parliamentarians to account, than in monetary policy or financial stability hearings, where the witnesses being held to account are unelected policy experts; (2) comparing committees across chambers, hearings in the House of Lords committee yield more reassuring facial expressions relative to hearings in the House of Commons committee, suggesting a more relaxed and less adversarial context in the former; and (3) central bank witnesses appearing before both the Lords and Commons committees tend toward expressions of appeasement, suggesting a willingness to defer to Parliament.

Research investigating the influence and character of nonverbal leader displays has been carried out in a systematic fashion since the early 1980s, yielding growing insight into how viewers respond to the televised facial display behavior of politicians. This article reviews the major streams of research in this area by considering the key ethological frameworks for understanding dominance relationships between leaders and followers and the role nonverbal communication plays in politics and social organization. The analysis focuses on key categories of facial display behavior by examining an extended selection of published experimental studies considering the influence of nonverbal leader behavior on observers, the nature of stimuli shown to research participants, range of measures employed, and make-up of participant pools. We conclude with suggestions for future research.

Absent from most analyses of political news are detailed assessments of the candidates' nonverbal behavior, which has been shown experimentally to have considerable persuasive influence. Unlike attractiveness and other relatively stable aspects of appearance, facial displays are highly variable and reveal important moment-to-moment information about the emitter's internal state. In this paper we argue that facial displays are influential elements within political news and examine the character of televised candidate displays over four presidential election cycles. The analysis considers coverage of major party nominees shown during the general elections of 1992, 1996, 2000, and 2004 on the major broadcast networks (ABC, CBS, and NBC). To motivate our hypotheses, we draw on the biopolitics literature that has identified three classes of displays relevant to the study of nonverbal political behavior: happiness/reassurance, anger/threat, and fear/evasion. The analysis focuses on the relationship between the display types shown in election coverage, the context in which the displays are shown, and candidate standings in the polls.

The smiles and affiliative expressions of presidential candidates are important for political success, allowing contenders to nonverbally connect with potential supporters and bond with followers. Smiles, however, are not unitary displays; they are multifaceted in composition and signaling intent due to variations in performance. With this in mind, we examine the composition and perception of smiling behavior by Republican presidential candidates during the 2012 preprimary period. In this paper we review literature concerning different smile types and the muscular movements that compose them from a biobehavioral perspective. We then analyze smiles expressed by Republican presidential candidates early in the 2012 primary season by coding facial muscle activity at the microlevel using the Facial Action Coding System (FACS) to produce an inventory of politically relevant smile types. To validate the subtle observed differences between smile types, we show viewers a series of short video clips to differentiate displays on the basis of their perceived reassurance, or social signaling. The discussion considers the implications of our findings in relation to political evaluation and communication efficacy.

Three-dimensional synthetic worlds introduce possibilities for nonverbal communication in computer-mediated language learning. This paper presents an original methodological framework for the study of multimodal communication in such worlds. It offers a classification of verbal and nonverbal communication acts in the synthetic world Second Life and outlines relationships between the different types of acts that are built into the environment. The paper highlights some of the differences between the synthetic world's communication modes and those of face-to-face communication and exemplifies the interest of these for communication within a pedagogical context.

We report on the application of the methodological framework to a course in Second Life which formed part of the European project ARCHI21. This course, for Architecture students, adopted a Content and Learning Integrated Learning approach (CLIL). The languages studied were French and English. A collaborative building activity in the students’ L2 is considered, using a method designed to organise the data collected in screen recordings and to code and transcribe the multimodal acts. We explore whether nonverbal communication acts are autonomous in Second Life or whether interaction between synchronous verbal and nonverbal communication exists. Our study describes how the distribution of the verbal and nonverbal modes varied depending on the pre-defined role the student undertook during the activity. We also describe the use of nonverbal communication to overcome verbal miscommunication where direction and orientation were concerned. In addition, we illustrate how nonverbal acts were used to secure the context for deictic references to objects made in the verbal mode. Finally, we discuss the importance of nonverbal and verbal communication modes in the proxemic organisation of students and the impact of proxemic organisation on the quantity of students’ verbal production and the topics discussed in this mode.

This paper seeks to contribute to some of the methodological reflections needed to better understand the affordances of synthetic worlds, including the verbal and nonverbal communication opportunities Second Life offers, how students use these and their impact on the interaction concerning the task given to students.

Difficulties in social communication in individuals with Klinefelter syndrome (XXY chromosomal pattern) have largely been attributed to deficits in left hemisphere-mediated, language functions. This study examined the ability of XXY men to decode emotions from tone of voice, a pragmatic aspect of social communication that may be associated with right hemisphere functioning. A total of 26 XXY men and 20 men from the general population completed tasks involving emotion discrimination in speech, based on verbal content or tone of voice. The XXY group displayed relative difficulties in discriminating emotions in tone of voice, and, to a lesser extend, in verbal content. This finding suggests that the XXY chromosomal pattern may not only be associated with difficulties in semantic aspects of language, but with prosodic aspects, as well. Our findings may contribute to the development of more comprehensive models addressing the role of the X chromosome in normal and abnormal development of social communication. (JINS, 2007, 13, 1065–1070.)

Studies of patients with brain damage, as well as studies with normal subjects have revealed that the right hemisphere is important for recognizing emotions expressed by faces and prosody. It is unclear, however, if the knowledge needed to perform recognition of emotional stimuli is organized by modality or by the type of emotion. Thus, the purpose of this study is to assess these alternative a priori hypotheses. The participants of this study were 30 stroke patients with right hemisphere damage (RHD) and 31 normal controls (NC). Subjects were assessed with the Polish adaptation of the Right Hemisphere Language Battery of Bryan and the Facial Affect Recognition Test based on work of Ekman and Friesen. RHD participants were significantly impaired on both emotional tasks. Whereas on the visual-faces task the RHD subjects recognized happiness better than anger or sadness, the reverse dissociation was found in the auditory-prosody test. These results confirm prior studies demonstrating the role of the right hemisphere in understanding facial and prosodic emotional expressions. These results also suggest that the representations needed to recognize these emotional stimuli are organized by modality (prosodic-echoic and facial-eidetic) and that some modality specific features are more impaired than others. (JINS, 2006, 12, 774–781.)

Past research has shown that lesions in the left cerebral hemisphere often result in aphasia, while lesions in the right hemisphere frequently impair the production of emotional prosody and facial expression. At least 3 processing deficits might account for these affective symptoms: (1) failure to understand the conditions that evoke emotional response; (2) inability to experience emotions; (3) disruption in the capacity to encode non-verbal signals. To better understand these disorders and their underlying mechanisms, we investigated spontaneous affective communication in right hemisphere damaged (RHD) stroke patients with aprosody and left hemisphere damaged (LHD) stroke patients with aphasia. Nine aprosodic RHD patients and 14 aphasic LHD patients participated in a videotaped interview within a larger treatment protocol. Two naïve raters viewed segments of videotape and rated facial expressivity. Verbal affect production was tabulated using specialized software. Results indicated that RHD patients smiled and laughed significantly less than LHD patients. In contrast, RHD patients produced a greater percentage of emotion words relative to total words than did LHD patients. These findings suggest that impairments in emotional prosodic production and facial expressivity associated with RHD are not induced by affective–conceptual deficits or an inability to experience emotions. Rather, they likely represent channel-specific nonverbal encoding abnormalities. (JINS, 2005, 11, 677–685.)

This study was designed to test the prediction that adolescents with autism would have specific limitations in imitating the “style” of another person's actions. In a series of original tasks that tested the delayed imitation of novel nonsymbolic actions, 16 participants with autism and 16 nonautistic participants group-matched for age and verbal ability were proficient in copying goal-directed actions, but in 3 out of 4 tasks, strikingly fewer participants with autism imitated with style with which the demonstrator executed the actions. An additional finding was that on 2 conditions that involved copying self-orientated actions, only 5 of the participants with autism but 15 of the 16 nonautistic participants spontaneously adopted the orientation-to-self on at least 1 occasion. The results are discussed with reference to theories concerning imitation deficits in autism, and with regard to the proposal that autism involves an impairment in intersubjective contact between affected individuals and others (Hobson, 1989, 1993; Rogers & Pennington, 1991).

Children with autism are known to have difficulties in sharing attention with others. Yet one joint attention behaviour, the ability to follow another person's head turn and gaze direction, may be achieved without necessarily sharing attention. Why, then, should autistic children have difficulties with it? In this study we examined the extent of this difficulty by testing school-aged autistic children across three different contexts; experiment, observation, and parent interview. We also tested whether the ability to orient to another person's head and gaze could be facilitated by increasing children's attention to environmental targets and social cues. Results for experiment and observation demonstrate that a sizeable proportion of children with autism did not have difficulties with following another's head turn. There was a difference between children with high and low verbal mental ages, however. Whereas children with higher mental ages (over 48 months) were able to orient spontaneously to another person's head turn, children with lower mental ages had difficulties with this response. When cues were added (pointing, language) or when feedback from targets was given, however, their performance improved. Parent interview data indicated that children with autism, whatever their mental age, began to follow head turn and gaze direction years later than typically developing children. Developments in attention and language are proposed as possible factors to account for this developmental delay.