Hostname: page-component-78c5997874-fbnjt Total loading time: 0 Render date: 2024-11-10T09:58:41.047Z Has data issue: false hasContentIssue false

Populism and emotions: a comparative study using Machine Learning

Published online by Cambridge University Press:  11 May 2023

Manuela Caiani*
Affiliation:
Faculty of Political and Social Sciences, Scuola Normale Superiore, Palazzo Strozzi, Piazza degli Strozzi, Florence 50123, Italy
Jessica Di Cocco
Affiliation:
Department of Political and Social Sciences, European University Institute, Badia Fiesolana, Via della Badia dei Roccettini 9, Fiesole 50014 (Florence), Italy Department of Political Science, Luiss Guido Carli, Viale Romania 32, Roma 00197, Italy
*
*Corresponding author. Email: manuela.Caiani@sns.it

Abstract

This study aims to unpack the mobilization of emotions in the political discourse of populist and non-populist parties and above all, across ‘varieties of populism’ (right wing vs. left wing or hybrid). Is there an empirical connection between emotions and populism? Are all types of populisms alike with regards to the emotional appeals within their political discourse? Focusing on Italy as a crucial case for populist communication and using a novel methodological approach based on supervised machine learning, it systematically investigates the intensity and trends of specific emotions in political discourses (institutional and informal, i.e. leaders’ speeches) of all Italian political parties over the last 20 years, for a corpus of more than 13,000 sentences analysed. The findings confirm that (i) populists tend to use more (and a broader repertoire of) emotional appeals than non-populist parties; however (ii) overall, there is an increase in the use of these appeals in the Italian political party discourse over time, especially in terms of negative emotions; and, most importantly, (iii) different types of emotions are mobilized by different types of populisms. Right wing populism mainly uses negative emotions while left wing or hybrid populism employs positive emotional appeals. The communication arena (party manifestoes vs. speeches) nevertheless does matter in the degree and types of emotions mobilized by political actors. This study identifies important implications for research on emotional appeals in politics, populist communication and political campaigning, and populist contagion from an emotion-based perspective.

Type
Research Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © The Author(s), 2023. Published by Cambridge University Press on behalf of the Società Italiana di Scienza Politica

Introduction

This study aims to explore the presence and types of emotions in the populist political discourse, and above all, across the ‘varieties of populisms’: right wing, left wing or hybrid (Zulianello, Reference Zulianello2020). Often in academia and beyond, it is noted that there is a special connection between emotions and populism (Nguyen, Reference Nguyen2019), and that populist parties and leaders have an additional emotional ingredient among their political communication tools (Canovan, Reference Canovan1999) and that emotional appeals are a recurrent characteristic of populist speeches, language, and style (Alvares and Dahlgren, Reference Alvares and Dahlgren2016; Bossetta, Reference Bossetta2017; Ernst et al., Reference Ernst, Blassnig, Engesser, Büchel and Esser2019a, Reference Ernst, Esser, Blassnig and Engesser2019b). These appeals are one of the essential drivers of populism (Kenny, Reference Kenny2017) an aid in ‘framing injustice’ and in creating a populist collective identity (Cossarini and Vallespin, Reference Cossarini and Vallespín2019). Many scholars have also credited emotions for the electoral success of populists. This specific type of communication is characterized by ‘emotion-eliciting appeals rather than rational argument’ (Hameleers et al., Reference Hameleers, Bos, de Vreese, Aalberg, Esser, Reinemann, Strömbäck and Vreese2016; Wirz, Reference Wirz2018). Indeed, studies have shown the role of emotions in increasing ‘populist attitudes’ of citizens and in favouring the propensity for the vote to populist parties (Rico et al., Reference Rico, Guinjoan and Anduiza2017; Vasilopoulos et al., Reference Vasilopoulos, George and Foucault2018, Reference Vasilopoulos, George, Nicholas and Foucault2019).

However, compared to other subfields of populism research (e.g. definitions, causes, measurements, etc., for an overview, see Manucci, Reference Manucci2022), the presumed link between populism and emotional communication still merits attention, especially for what concerns a ‘systematic empirical scrutiny’ (Widmann, Reference Widmann2021). Moreover, comparative studies across varieties of populisms and different types of emotions remain scarce and are often conducted more in the normative-theoretical than empirical realm (see the theoretical framework by Salmeila and Von Scheve, Reference Salmeila and von Scheve2018).

This study aims to unpack the role of emotions in the political discourse of populist and non-populist parties and above all, across ‘varieties of populism’ (right wing vs. left wing or hybrid). Is there an empirical connection between emotions and populist parties’ discourse? Have non-populist parties increasingly adopted the populist ‘emotional appeal’ style of communication? Are different types of emotional appeals, generally used by different types of populisms?

Focusing on Italy as a ‘crucial’ case study for the analysis of populism, due to its endurance in the political party system and its varieties, and using a novel methodological approach based on supervised machine learning Footnote 1, the study systematically investigates the presence, intensity and trends of different types of emotions (i.e. anger, distrust, hate against outgroups, hope, joy) in the discourses of populist vs. non-populist political parties over the last 20 years in Italian politics (from 2000 to 2020). More in particular, analysing the political discourse (institutional vs. more informal, i.e. electoral manifestoes vs. leaders’ speeches) of all the Italian political parties (with a corpus of more than 13,000 sentences analysed), and combining quantitative and qualitative data, it shows the similarities and differences among various populistsFootnote 2, and among populists and non-populist parties, in terms of the use of various types of emotions in their rhetoric as well as different communication arenas.

We start from the assumption that there is an increasing strand of literature which addresses populism as a political communication style that also takes emotions into account (just to mention a few, Crabtree et al., Reference Crabtree, College, Golder, Gschwend and Indriđason2018; Nai, Reference Nai2021; Widmann, Reference Widmann2021). Moreover, some of these studies also focus on the Italian case (e.g. Bracciale et al., Reference Bracciale, Andretta and Martella2021; Martella and Bracciale, Reference Martella and Bracciale2022). However, they mainly focus on the social media communication (i.e. Facebook and Twitter) of a limited number of Italian leaders, during specific electoral campaigns (i.e. 2018). Our study, which is an attempt to translate the Salmela and von Scheve conceptual framework into a machine learning analysis, is positioned within this growing field of research, building on it and attempting to offer an empirical and methodological contribution to it. Previous studies (e.g. Ernst et al., Reference Ernst, Blassnig, Engesser, Büchel and Esser2019a, Reference Ernst, Esser, Blassnig and Engesser2019b; Bracciale et al., Reference Bracciale, Andretta and Martella2021) stress that populists use emotional language by expressing ‘discrete’ positive (e.g., happiness, contentment, hope, pride, trust) or negative (e.g., anger, hate, uneasiness, sadness, fear, regret, affection) emotions.

Disentangling varying types of emotions predominant in the political discourse of a specific type of party or ‘party families’, such as populists, or varieties of populism, may be important given that emotions have been found to be ‘key strategic styles’ for attracting voters attention (ibid., Boussalis and Coan, Reference Boussalis and Coan2021Footnote 3). Moreover, looking at the populist phenomenon in terms of its communication style with a focus on emotions seems particularly relevant as it may affect the overall political communication of a political system (ibid., Ernst et al., Reference Ernst, Blassnig, Engesser, Büchel and Esser2019a, Reference Ernst, Esser, Blassnig and Engesser2019b). For this reason, our cross time study, over a large timespan, on a ‘most likely’ case study for populism and populist political communication, may thus have important implications for research on emotional appeals in politics, populist communication and political campaigning, as well as studies on the ‘populist contagion’ (Widmann, Reference Widmann2021; 11).

Following the literature review on populism and emotions (section 2) and a section on data and method (3), we turn to the discussion building on the empirical analysis (4, 5). In the conclusion, we problematize our findings to future research (6). We argue that not only are Italian populists consistently found to be more ‘emotional’ than non-populists, but also that the prominence of emotions in the overall Italian political party discourse has increased in recent years and, significantly, that the types of emotions mobilized (both positive and negative) vary considerably depending on the party ideological alignment (and the communication arena).

Theory and analytical guidelines: populism/populisms and varieties of emotions

First, both populism and the role of affective politics are two prominent topics in the academic debate in recent decades (Neuman et al., Reference Neuman, Marcus, Crigler and MacKuen2007; Hameleers et al., Reference Hameleers, Bos, de Vreese, Aalberg, Esser, Reinemann, Strömbäck and Vreese2016; Arias-Maldonado, Reference Arias-Maldonado2017). Emotions are considered to play a role in defining and influencing cognitive processes and value judgements on politics, including citizens’ electoral preferences (Bakker et al., Reference Bakker, Schumacher and Roodujin2021). They also have a role in mobilization, recruitment and collective political actors’ endurance (e.g. on social movements, see Jasper Reference Jasper2011), as well as in social and political in group/outgroup identification (Sindic and Condor, Reference Sindic and Condor2014), an aspect particularly resonant in populism.

Second, those studies looking at the nexus between populism and emotions have underlined the role of emotions in boosting populist attitudes and an increasing propensity to vote for these parties has been emphasized (Bakker et al., Reference Bakker, Rooduijn and Schumacher2016; Rico et al., Reference Rico, Guinjoan and Anduiza2017; Vasilopoulos et al., Reference Vasilopoulos, George and Foucault2018; Reference Vasilopoulos, George, Nicholas and Foucault2019). Emotions, and the emotive content of political campaign messages (Utych, Reference Utych2018) may influence the political behaviour (e.g. Vasilopoulos et al. (Reference Vasilopoulos, George, Nicholas and Foucault2019) – on the role of fear and anger on the vote for the radical right); as well as citizens’ attitudes and opinions (e.g. Vasilopoulou and Wagner (Reference Vasilopoulou and Wagner2017) – on fear, anger and enthusiasm on attitudes towards European integration), since they also affect how people process information (e.g. Kuhne and Schemer (Reference Kuhne and Schemer2015) – on the role of fear for new voters for the populist radical right). For example, Widmann (Reference Widmann2021), on the basis of press releases and twitter communications of all the major parties in Austria, Germany and Switzerland (from 2016 to 2018) showed that populists use significantly more negative emotional appeals than non-populist parties. Similarly, Crabtree et al. (Reference Crabtree, College, Golder, Gschwend and Indriđason2018), focusing on election manifestoes from the 1980s up to 2012 in various European countries, including Italy, explain the type of electoral campaign run by political parties, showing that the level of positive sentiment used depends on their incumbency status, their policy position, and the objective economic conditions (for a similar study, see Kosmidis et al., Reference Kosmidis, Sara, Eamonn and Whitefield2019). Finally, Nguyen (Reference Nguyen2019), comparing panel data from Austria and Germany, investigates the relationship between anger and anxiety on the one hand, and support for populist parties on the other; and Wirz (Reference Wirz2018) focusing on German-speaking regions in Europe, shows that populist appeals do indeed elicit emotions and that this increases the persuasiveness of the appeals. Most of these studies offer valuable insights when examining the Italian case. We build on and update them, and moving beyond the focus of only one type of populism (i.e. right wing), while not focusing selectively on some electoral campaigns or on the Internet sphere.

Third, with regards to specific, different types of emotions, populism has been linked to various emotions like hope, anger and resentment (Wagner, Reference Wagner2014Footnote 4; Rico et al., Reference Rico, Guinjoan and Anduiza2017; Salmeila and Von Scheve, Reference Salmeila and von Scheve2018). Emotions mobilized by populists can be differentiated into the so-called ‘negative’, such as fear, anger, emergency, and insecurity feelings (Alvares and Dahlgren, Reference Alvares and Dahlgren2016; Caiani and Graziano Reference Caiani and Graziano2016; Hameleers et al., Reference Hameleers, Bos, de Vreese, Aalberg, Esser, Reinemann, Strömbäck and Vreese2016) or the ‘positive’, such as enthusiasm, pride, and hope (Wirz, Reference Wirz2018; Ernst et al., Reference Ernst, Esser, Blassnig and Engesser2019b; Bracciale et al., Reference Bracciale, Andretta and Martella2021).

Studies have also centred on the association of specific types of emotions with different political ideologies, such as ‘conservative or liberal thinking’ (Taber and Young, Reference Taber, Young, Huddy, Levy and Sears2013). In this regard, fear, nostalgia Footnote 5 and anger, are considered essential components in reactionary views and anti-liberal political parties (Hochschild, Reference Hochschild2018), but even (especially anger) in radical left wing politics (Cossarini and Vallespín, Reference Cossarini and Vallespín2019; Magni, Reference Magni2017). Anger, has been connected to insecurity and seen as a reaction to citizens’ vulnerabilities (Salmeila and von Scheve, Reference Salmeila and von Scheve2018). Those populist messages provoking anger aim to ‘deflect shame-induced anger and hatred away from the self and instead toward the political and cultural establishment and various ‘Others’’ (Salmela and von Scheve, Reference Salmeila and von Scheve2018: 443). Insecurities or resentment, understood as complex affective states that intertwine in the web of past, present and future (Bonansinga, Reference Bonansinga2020), have been linked to feelings of social disintegration, economic insecurity, relative deprivation and powerlessness (Abts et al., Reference Abts, Dalle Mulle and Laermans2019) and considered a strong predictor of (right wing) ethno-populism, anti-immigrant attitudes and welfare chauvinism (Abts and Kochuyt, Reference Abts and Kochuyt2013), even in times of economic prosperity (Mols and Jetten, Reference Mols and Jetten2016). However, through the use of anger, populists might also tap into discourses on morality and injustice (e.g. against neo-liberalism), as many left wing populist leaders do (Rico et al., Reference Rico, Guinjoan and Anduiza2017).

So-called positive emotions, like pride and joy, are often assigned by populists to the notion of honesty of the ordinary man (Bonansinga, Reference Bonansinga2020). The populist left would especially relay on them in its political communication, due to its ideal of participation from below and collaborative sentiments which enable the transformation of shame into high-energy, active emotions, such as also indignation and anger (ibid., 446).

While repressed shame, resentment, anger and hate targeted at other generic groups would lead to, and be mobilized mainly by right wing populism; acknowledged shame, indignation, but also joy and pride, would be favoured and mobilized more typically by the populist left (Salmeila and Von Scheve, Reference Salmeila and von Scheve2018: 449). This differentiation has also been applied to understand the emergence and success of different types of populisms in structurally and socially similar conditions (e.g. of modernization, globalization, etc.) related to crises (Brubaker, Reference Brubaker2017). In this regard, a concept elaborated, though not tested empirically, is the ‘emotional opportunity structure’ (Salmeila and Von Scheve, Reference Salmeila and von Scheve2018: 438), which shows how structural factors may interact with (individual and collective) emotions to set the terrain for populist entrepreneurs, who, in turn, often exploit such opportunities for their political gain. Indeed, conditions refer not only to structural factors, but rather are ‘constituted and maintained by social and cultural processes that render (certain) emotions more visible, desirable, and acceptable than others’ (ibid., 439). This analytical lens seems particularly fruitful in investigating the Italian case, as its (similar) contextual ‘emotional opportunities’ can be exploited in different ways by different varieties of populism. In this study, we look at the actors who may connect the macro level causes with the macro level outcomes.

Against the background of this scholarship in this study we will focus on five main (‘positive’ and ‘negative’) emotions (see also Bracciale et al., Reference Bracciale, Andretta and Martella2021; Nai, Reference Nai2021) generally attributed to populism: fear and insecurity; anger; hate against outgroup (i.e. generic others)Footnote 6; indignation against neoliberalism; joy and pride (for the definition and operationalization of the specific emotions we analyse, see the method section and table A in the appendix), elaborating the following assumptions: i. that the populist Italian political discourse is more emotional than the non-populist one (hyp.1); ii. that all in all, Italian political parties use of emotions in their political discourse will increase over time (hyp.2, or the ‘populistisation’ of the political discourse with regards to emotions); and, finally, that, iii. different types of populist parties (i.e. right wing vs left wing/hybrid) will tend to mobilize different types of emotions in their political discourse (hyp. 3).

Some of these assumptions are not new (i.e. see the reflections on the difference between Widmann's results and the Italian context, e.g. Bracciale et al., Reference Bracciale, Andretta and Martella2021; Martella and Bracciale, Reference Martella and Bracciale2022), however we expanded on them by focusing on a broad(er) timeframe, on varieties of populists and communication arenas (institutional vs. informal). In particular, while our first and third expectations are based on insights derived from the literature review illustrated above, the second is a broader interpretation of the so-called ‘contagion effect’ of populism – in terms of emotions. Populist parties are considered to have a contagion effect on the mainstream parties, polarizing or radicalizing the content of the political debate (Iyengar et al., Reference Iyengar, Lelkes, Levendusky, Malhotra and Westwood2019), beyond increasing the salience of specific issues (Akkerman, Reference Akkerman2015), so that mainstream parties would react to the success of populist parties by, among other things, adopting a populist rhetoric (Schwörer, Reference Schwörer2021). Finally, although this is an exploratory research effort, we are also guided by the hypothesis that we should expect populist features to grow (i.e. the ‘emotional appeal style’) due to the presence – since 2008 – of an ‘exogenous shock’ such as the financial and economic crisis. Moreover, in this regard (and beyond the general trend), as emotions can be influenced by the (cultural) context (Lim, Reference Lim2016), Italy seems to provide a perfect setting to clarify, beyond the context (i.e. ‘ceteris paribus’), specificities (in the ‘agency’) of varieties of populisms.

Method and sources

Italy appears as a paradigmatic case to such a study on populist communication, as it offers a great variety of populisms throughout its history – (i.e. left wing and right wing, even centrist; ‘fourth types’, Biancalana, Reference Biancalana, Blokker and Anselmi2020; Verzichelli and Castaldo, Reference Verzichelli and Castaldo2020) and has been considered a ‘laboratory’ and ‘showcase’ of populism, for its success and endurance (Albertazzi et al., Reference Albertazzi, Giovannini and Seddone2018; Hamdaoui, Reference Hamdaoui2021)Footnote 7.

To investigate the presence and types of (‘complex’, although discrete) emotions mobilized in the political discourse by populist actors in Italy, we analysed the national party manifestos and leaders’ speeches of all the political parties (populist and non-populist) in the country (for details on the parties included in the analysis, see table B and B2 in the appendix), across the left – right wing ideological spectrum, over the last two decades (2000–2020)Footnote 8. We took into account both the institutional (i.e. manifestoes) and more informal political communication (i.e. leaders’ speeches during electoral campaigns, party rallies and congresses, talk shows)Footnote 9. Our unit of analysis is the sentenceFootnote 10 comprising a final corpus of 13,530.

The sentiment analysis approach usually relies on dictionary-based approaches (e.g. Widmann, Reference Widmann2021)Footnote 11. However, this approach may be insufficient to intercept complex emotions, like those in which we are interested and that can be considered the ‘features of the populist communication styles’ (Ernst et al., Reference Ernst, Blassnig, Engesser, Büchel and Esser2019a)Footnote 12.

In supervised machine learning, still scarcely applied to measure aspects of populism (see Di Cocco and Monechi, Reference Di Cocco and Monechi2022), the researcher in contrast ‘trains’ an algorithm, simulating coders’ activity (for more information on this ‘training’, see appendix table C)Footnote 13. In order to train the algorithm, we derived emotional scores per sentence using a Random Forest (RF) classification algorithm (Breiman, Reference Breiman2001)Footnote 14, adopting a bag-of-words approach after text pre-processing. In terms of our procedure, first of all, we went through a manual coding process involving 15% of the Italian corpus (totalling 1917 sentences), randomly selected, in which the presence of an emotion was assessed and a type attributedFootnote 15.

Specifically, based on the extant literature, we focused on five broad emotions particularly relevant to populism (see table A in the appendix): a. ‘hate against outgroup (i.e. generic others)’, mainly referred to the hostility towards immigrants, ethnic and social minorities (e.g. homosexuals, Roma people, Muslims); b.‘anger’ towards political opponents, judicial and intellectual elites, or the ‘others’ in the Manichaean perspective of the society; c. ‘fear and insecurity’, referred to uncertainty, dissatisfaction and insecurity with the economic dimension and wellbeing; d. ‘joy and pride’, which include any emotional feelings connected with pride and cheerfulness regarding political topics or achievements and the Italian political situation; and, finally, e. ‘indignation and victims of neoliberalism’, which refers in particular to the feeling of losing out as a result of globalization and neoliberalism, but also to the opposition of these economic processes.

Secondly, on the remaining part of our dataset we implemented the automated coding process based on machine learning. We trained five different models, one for each emotion. The goal was to obtain classifiers to assign class labels to chunks of texts where different classes represent different emotions. We used 70% of the corpus sentences for training the model, 20% for validating and tuning the model parameters, and the remaining 10% to build the score and test its predictive power. The models predict whether a sentence could be classified as including that specific emotion (Y = 1) or not (Y = 0). We finally obtained our emotional scores measuring the probability that a specific emotion is found over the years. To validate the results, we measured the accuracy on the validation test (see table E and F in the appendix). For all the types of emotions we obtained good average precision scores and AuROCs, considering the complexity of the emotions classified and the standard positive-neutral-negative classification- which makes our approach particularly effective (performing better than existing alternatives to measure emotions and populism)Footnote 16.

Empirical analysis: ‘emotional populism’, emotional times

When looking at the presence and intensity of emotions (i.e. aggregate emotional level) in the political discourse of Italian political parties over the last two decades, our data suggest that, overall, the populist political communication is more emotional than the non-populist. (Figure 1a and b).

Figure 1. The overall emotional level (i.e. presence of emotions) in the populist vs. not -populist party political discourse in Italy (2000–2020). (a) aggregated. (b) by type of communication arena (electoral manifestoes vs. speeches).

Note: The scores showed in the figures represent the percentages of ‘emotional sentences’ per year, and have to be considered as a proxy of a political actors’ emotional level. For example, a score of 0.122 (i.e. the emotional score of populists in 2016–20 fig.1a) means that 12.2% of the codified sentences of the Italian populist political discourse in 2016–2020 contained emotions (at least one among the five broad emotions analysed in this study).

Populist parties (and leaders) generally make more frequent (and broader) use of emotions than non-populists, especially since the 2008 economic crisisFootnote 17. This trend is constant over time, with minimal fluctuations and it also holds true when distinguishing among arenas of communication (electoral manifestoes vs. speeches) – although, on the whole, the informal arena of speeches is characterized by higher emotional levels for both the populist and non-populist parties. However, as a comparison, non-populist Italian parties have generally increased their use of emotional tones over time in their electoral manifestoes (especially since 2008), almost on a par with the populist levels by the end of our timeframeFootnote 18. These findings suggest that studies on emotions and political discourse should be based on different sources, to better intercept variations of the political style and to be in line with current research on the populist communication and social media, which emphasizes how informal arenas of communication are particularly conducive in the mobilization of emotions (Aalberg et al., Reference Aalberg, Esser, Reinemann, Strömbäck and de Vreese2017).

Moreover, looking at Figure 2, which shows the presence and levels of specific emotions in the populist and non-populist political discourse, we see that, for both actors there is an increase in the use of all types of emotions analysed over the years (i.e. hate against outgroup, anger, fear and insecurity, joy and pride, indignation).

Figure 2. Different types of emotions in the populist vs. not -populist party political discourse in Italy (2000–2020).

Note: In the figures, the label hate refers to ‘hate against outgroup’; indignation’ to ‘indignation against neoliberalism’. The scores showed in the figures represent the percentages of ‘emotional sentences’ per year, and have to be considered as a proxy of a political actors’ emotional level related to the specific emotion.

The levels of emotions are, overall, higher between 2016–2020 than at the beginning of our analysis (2000)Footnote 19. However, since the majority of the emotions we analysed are negative, this result seems to corroborate the relationship between populism and polarization of the political debate.

In particular, hate (i.e. hostility against various types of ‘outgroups’, such as social and ethnic minorities, immigrants, gypsies, homosexuals)Footnote 20 increases over the years, although with fluctuations (after a peak in 2008 it slightly decreases, at first, for both types of actors before increasing again) always remaining higher in the populist political discourse. On the other hand, anger against other generic groupsFootnote 21 (i.e. mainly political elites and adversaries) increases over the years for all actors, but particularly since 2008 in the populist political discourse – remaining constantly higher than among the non-populistsFootnote 22. Finally, fear and insecurity, which also appear more frequently mobilized in the discourse of the populist Italian partiesFootnote 23, are significantly prevalent among the non-populist actors too in the most recent years.

In sum, our data point out that overall the Italian political parties’ use of emotions increases over time and that the discourse of populist parties seems to be characterized by some recurring emotions: they are in particular anger against political opponents and hostility towards minorities (hate). The new populist era, at least in the Italian case, seems to be mainly populated by negative emotions, especially among the populists. Moreover, this picture remains true when we differentiate by communication arenas (as figure A in the appendix shows).

With a closer look from our qualitative analysis, we can see that hate usually assumes an immigration-oriented dimension. For instance, in his speeches Salvini frequently reiterates the hostility towards migrants (e.g. the ‘law and the control of borders’, ‘the expulsion of hundreds of thousands of illegal immigrants’, 2018, speech)Footnote 24, mobilizing this emotion by framing the political discourse around the idea that some outgroups receive more attention than neglected in-groups (i.e. deserving vs. undeserving people). He often stresses ‘the unequal and unfair treatment of Italian citizens (election speeches, 2013, 2018), intercepting a resentment strongly connected to feelings of economic insecurity and powerlessness (Abts et al., Reference Abts, Dalle Mulle and Laermans2019). However, the targeted outgroups have changed over time. For example, between 2006–2008, when the Northern League was a federalist and separatist political party, its speeches mainly focused on ‘Padania's independence’ and opposition to ‘Southern Italian regions and people’. Conversely, in 2013, and even more in 2018, under Matteo Salvini's leadership, the enemies were no longer from the South but were now ‘foreign people’ (‘concrete problems are work, food (…) not the discussions about the citizenship for immigrants’ children’; 2013, TV speech).Footnote 25 Indeed, during the 2018 electoral campaign, Salvini often stresses the need to ‘campaign on truth, honesty and seriousness. No miraculous promises (…)’, but instead towards ‘a total control of borders, with mass expulsions for the hundreds of thousands of illegal immigrants in Italy’Footnote 26.

Anger often includes anger towards political opponents and the government. Critical examples of this emotion are the speeches of Beppe Grillo'sFootnote 27, in which he delegitimizes the Italian political class as ‘the people who go there [in parliament] to fuck us again’ (2013)’Footnote 28, who ‘have occupied the Parliament all their lives’ (2013)Footnote 29. However, it also included frequent claims over the years referring to anger towards an ambiguous, not specified or easily identifiable ‘Other’ (e.g. ‘they’/‘them’), typical of the populist ‘conspiracy’ discourse in various European countries (Pirro and Taggart, Reference Pirro and Taggart2022).

Fear and insecurity target both the national and the European level of governance, and even the global levels, in the appeals of populist leaders. For example, Salvini often emphasizes that European treaties ‘condemn Italy to hunger and poverty’ and that the solution is ‘to stop financing the EU’, which is for Italians ‘only a damage’Footnote 30, a ‘sacrifice policies enriching few and ruining many’.Footnote 31 Different leaders, however, tend to mobilize this emotion by making reference to different aspects of it. For example, sometimes (as seen in many speeches of the leader of Fratelli d'Italia party, Giorgia Meloni – not classified as a populist party in this study) fear and insecurity are coupled with a feeling of ‘political powerlessness’ or ‘inefficiency’ (e.g. talking about Fornero laws, the ‘dichotomy between first-class workers in Italy and second-class workers’ is stressed, or a ‘hyper-protected generation and one that will never be guaranteed’, 2013)Footnote 32. At times, this emotional category includes more insecurity about economic instability (especially in left wing populist discourses). Less common, do we see fear and insecurity linked to feelings of nostalgia, where a rhetoric of fear-insecurity-evoking’ is prevalent.

Claims conveying joy and pride are present in the Italian political debate too (although accounting for less than 10% of the total sentences of populists’ communication). Examples are discourses which emphasize ‘pride’, ‘enthusiasm’, ‘faith and values’, ‘[our young people]’, ‘being passionate’, ‘courageous’, ‘grateful’, ‘excited’, etc. (for examples see speeches of the radical right-wing politician Daniela Satanchè in which this emotion is quite present, e.g. 2008Footnote 33), or the electoral campaign in 2013 of the Democratic party (‘we are able to put on our shoulders a concrete alternative to the right!’ speech of Bersani).Footnote 34 Beppe Grillo and his party has appeared to mobilize this emotion more frequently, as in the case of one of his famous speeches where ‘the discovery’ of ‘the path towards a better future’ is stressed, which is described as ‘honest, concrete, supportive and happy’ (2013, speech).Footnote 35

As for indignation related to neoliberalism (e.g. ‘victims of..’), Italian populist political parties and leaders seem to mobilize it mainly as a collective ‘action frame’, namely by a framing of the political discourse where the economic and political elites are blamed, and a call for political action (usually ‘new’, from the people) is made – referring to acknowledged shame and allowing for self-identifying as victims of neoliberalism ('this old man is ashamed, he feels like a failure for losing his job. …Footnote 36’). In the same vein, there was a strong emphasis placed on ‘the effects of globalisation’ on the Eurozone, in the 2018 5SM electoral manifesto, a process that ‘escaped the initial good intentions, betraying its own founding values’, which embeds ‘clearly distorting elements of a globalising mechanism’, ‘widens the gap between institutions and citizens’.

Varieties of populism(s) and different types of emotions

Our data over 20 years of Italian political discourses, show that specific types of emotions which distinguish populist parties leaning towards different ideologies (left wing or hybrid vs. right wingFootnote 37). Indeed, as Figure 3 shows (see also fig. B in the appendix), if we consider populists depending on their (hosting) ideology, outgroup hostility is mainly mobilized by right wing populist parties and leaders, in line with the literature on right-wing populism, which link its emergence and success to the cultural dimension crisis (Kriesi, Reference Kriesi2018).

Figure 3. Different types of emotions in the political discourse of varieties of populism (lef wing, right wing, hybrid, i.e. ‘other’), Italy (2008–2020).

Note: In the figures, the label hate refers to ‘hate against outgroup’; indignation’ to ‘indignation against neoliberalism’. The Italian party ‘Potere al Popolo’ has been classified as Left wing populism (see also Di Cocco and Monechi, Reference Di Cocco and Monechi2022); the party Lega as Right wing populism; and, finally, the 5SM party as hybrid (i.e. ‘other’) (see also Mosca and Tronconi, Reference Mosca and Tronconi2019). The scores showed in the figures represent the percentages of emotional sentences per year, per emotion, per type of populism, and have to be considered as a proxy of a political actors’ emotional level.

As we see in many discourses of Salvini addressing the EU this sentiment is frequently evoked, stressing that ‘[regarding immigration policies] another Europe is necessary which is independent from Brussels’, ‘crazy’ and ‘criminal’ on the management of these issues, 2013, speech.Footnote 38

Anger is mainly used by left wing and hybrid populists, similarly to joy and pride. On the contrary, when looking at fear and insecurity, the picture appears less clear cut among different types of populisms. The usage of this emotion in political discourses seems divided equally among various actors: before 2012 it features mainly in right wing populism, and afterwards in left wing (and hybrid) populism. Looking more in depth at our qualitative data we see however that this emerging emotion does not often exclude a reference to anger against others (for example the ‘political caste’, as in many claims of the 5SM) or indignation against neoliberalism. As always, the empirical reality is more complex than any classification. For instance, during the 2013 national electoral campaign, the leader of the 5SM, Beppe Grillo often emphasized that ‘banks cannot fail because it is an oxymoron and a lie, while thousands and hundreds of families fail with their savings’.Footnote 39 Similarly, Di Battista (5SM), talking about access to educational opportunities in the country, emphatically stresses the dimension of insecurity and fear for the lower classes.Footnote 40.

Finally, when considering feelings of indignation against neoliberalism, although this emotion is (in absolute terms) less mobilized than the others in the Italian political discourse, it is above all found in the discourse of left wing (and partly hybrid) populism, such as the 5SM and Potere al Popolo – supporting the expectation in literature that left wing populists are more joyful than other parties along the ideological spectrum. For example, talking about the 2018 election polls, Carofalo (representative of the party Potere al Popolo) emphatically stresses that his party is ‘building something huge today (…), with assemblies in 150 cities in Italy’, and was ‘optimistic’ to enter the Parliament.Footnote 41 Similarly, the 5SM political discourse is often characterized by the rhetoric of joyful ‘rebellion’, positive ‘expectations’, ‘hope’, as well as ‘pride of being part of a sovereign people who can promote a change’ in the society (e.g. the ‘Let's take our lives together democratically, rebel’, speech).Footnote 42

In sum, as our qualitative analysis indicates, in the emotional appeals of right wing populists fear is mainly related to the discourse on powerlessness and déclassement, hate against out-groups while anger is directed against the corrupt political and cultural elites, failing to protect peoples’ interest and favouring outgroups at the expense of the ingroup or against those who have a ‘good life’ without having to work hard (such as politicians and managers, welfare recipients and refugees, the long-term unemployed, as well as ethnic, cultural, and sexual minorities). On the other hand, in left wing populist discourses, anger is more often framed towards the domestic and foreign political establishment implementing austerity politics for instance or as being responsible for enforcing politics that increases injustice, inequality, and precariousness.

Conclusions

Since the 1990s, many social scientists have considered Italy as a fertile testing ground for populist communication or even a populist ‘paradise’ (Tarchi, Reference Tarchi2015). In this article, we looked at this case in terms of emotions and populism, with a descriptive effort (across types of emotions, type of populisms, time and types of communication arenas) that seems to offer an empirical and methodological contribution to this field of enquiry. In sum: Why is populist communication intrinsically emotional? And what are we still lacking in terms of our theoretical understanding about the links between populism and emotions? Our study includes some of these answers in particular in terms of the different emotions used by different types of populisms, and the role of different platforms, or communication arenas, where the political debate takes place.

First, confirming our easiest hypothesis (n. 1), our study showed that Italian populist parties, like pre-existing ones in other countries and on social media (Béland, Reference Béland2020), adopt a more emotional political discourse than non-populists (consistently over time and regardless of the communication arena). This is however coupled with the evidence that, as similarly suggested by studies on the populism communication in social media (e.g. Engesser et al., Reference Engesser, Fawzi and Larsson2017), the more informal arena of speeches seems more conducive, overall, to the use of emotions (see similarly Widmann (Reference Widmann2021) on Italy regarding social media messages of political parties).

Second, if this is the characteristic of (Italian) emotional populism, confirming and integrating Bracciale et al. (Reference Bracciale, Andretta and Martella2021) (who focused on Italian populist communication on social media), we also found that emotions are increasingly adopted by Italian political parties and leaders as communicative tools to command attention and gain consent. Another important finding of this study (confirming our hypothesis n.2) is indeed that non-populist Italian parties have also increased their emotional appeals over time. We can therefore argue that the (Italian) political field in general is becoming more emotional, with mainly populist political speeches increasing the general level of hostility against various relevant ‘outgroups’ in the Italian political discourse – in line with the polarization of the political debate potential of populism (also in line with evidences on emotional rhetoric in German state Parliaments (Valentim and Widmann, Reference Valentim and Widmann2023)). These findings might also align to previous studies which emphasized for the Italian case how the ‘exogenous shock’ of the 2008 financial and economic crisis, seems to have favoured the growth of populist features among the Italian political parties (Caiani and Graziano, Reference Caiani and Graziano2016).

A third relevant finding is the broad correlation found between different types of emotions and types of populisms, in line with our third expectation. In particular (partly in contrast to Bracciale et al., Reference Bracciale, Andretta and Martella2021), we have found a strong association between negative emotions and right wing populism and positive emotions and left wing populists. These findings confirm the idea that politicians use different emotions systematically for different purposes (Widmann, Reference Widmann2021). However, beyond this general trend, our qualitative analysis also showed some nuances: Left wing populist parties may also mobilize negative emotions (e.g. fear or anger) but in a different way; joy and pride are also used with right wing populism. Indeed, as the qualitative analysis showed, anger is mainly characterized by anti-elitism, whereas fear and insecurity are often both linked to the socio-economic dimension and the cultural backlash.

Although limited in scope, these findings can also be read as complementary to previous work theorizing different causes behind different types of populism (Kriesi, Reference Kriesi2018). If different crises (economic, political or cultural-backlash) are ‘performed’ (Moffitt, Reference Moffitt2015) and amplified by (different types of) populisms (Pirro and Taggart, Reference Pirro and Taggart2022), our findings may suggest that emotions can be understood as the ‘mechanisms’ (Jasper, Reference Jasper2011) linking macro causes to macro effects.

As for the Italian case, against the background of the same context of political and ‘emotional opportunities’, a different framing of different types of crises by varieties of populists can be helped by the different emotions mobilized. Understanding the link between populism and emotions could therefore provide not only important insights into the activation of populist attitudes (Hawkins et al., Reference Hawkins, Carlin, Littvay and Kaltwasser2018), but also illuminate a crucial mechanism for the way in which populist parties (of different types) maintain support over time.

Beyond providing an updated trajectory of the phenomenon in Italy, our study could elucidate similar trends in other countries, as populist actors and leaders, as shown by previous work, tend to behave similarly with regards to political campaign styles and emotions in particular, across various regions of the World (Gerstlè and Nai, Reference Gerstlé and Nai2019).

Furthermore, methodologically, our original approach to emotion detection based on supervised machine learning, which combines the strength (and richness of nuances) of manual and automated method for text analysis typical of natural language processing, is a useful test exercise for future studies, as it can capture emotions related to populism in a systematic and accurate way. What this method is unable to do, and what in fact we did not do in this study was, beyond differentiating which party was more emotive-populist in which periods, was to explore the ‘why’. Future qualitative and historically driven studies should explore, perhaps starting from our systematic empirical overview, how the populist emotive communication has ‘travelled’ and materialized historically in the defined time-loops over the last 20 years in Italy, and how it has been shaped by specific political trajectories of Italian politics.

Finally, at the end of the story, we can also re-read all these results under a different light. Moving from a radical democratic theory perspective, we could contend that by using a Laclauian framework which sees politics as equal to hegemony as equal to populism, one can conclude that populist actors are no different from other political actors: emotions and affects are always central to any political identity (Eklundh, Reference Eklundh2019). In this regard, we could argue that the division between the emotional and rational in politics serves to sediment exclusionary practices against newcomers and challengers of the status quo (ibid.).

Funding

This research received no specific grant from any public or private funding agency.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/ipo.2023.8.

Data

The replication dataset is available at https://doi.org/10.7910/DVN/HRN6TP.

Acknowledgements

We thank Bernardo Monechi for his feedback and suggestions on the methodological part of the research that led to this manuscript. We also thank Enrico Padoan for his insightful comments on the nexus between populism and emotions.

Competing interests

The authors declare none.

Footnotes

1 With this approach we position our study within the strand of literature using automated text analysis to investigate sentiments and emotions in political communication. Unlike other valuable contributions (e.g. Haselmayer and Jenny, Reference Haselmayer and Jenny2017; Rauh, Reference Rauh2018), our approach does not rely on dictionaries but on a broader emotional coding.

2 Acknowledging the complexity of the terminological debate, we follow the ideational approach in this study (Hawkins, Reference Hawkins2018) and the most diffused classifications of populist parties in Europe (see the PoPuList, Rooduijn et al., Reference Roodujin, Van Kessel, Froio, Pirro, De Lange, Halikiopoulou, Lewis, Mudde and Taggart2019) and varieties of them (Mudde, Reference Mudde, Rovira Kaltwasser, Taggart, Espejo and Ostiguy2016; Ivaldi et al., Reference Ivaldi, Lanzone and Woods2017; Caiani and Graziano, Reference Caiani and Graziano2021). Whereas left wing populisms identify the people in socio-economic terms, such as the working class exploited by the bourgeois elite, right wing populisms refer to the ethnic nation. Right wing populist parties tend to mobilize along ethno-nationalistic issues, while left wing populist parties do so on the economic/inequality cleavage. However, the boundaries between types of populisms are less clear cut in empirical reality (Rooduijn and Akkerman, Reference Rooduijn and Akkerman2017), and hybrid types abound (Zulianello, Reference Zulianello2020).

3 Especially the negative emotions.

4 In his survey conducted in the UK in 2015.

5 Nostalgia, for example, is associated with mainly right wing, nationalist populist ideology in the evocation of an ‘imaginary past’, which represents a secure homeland compared to the unstable present (Kenny, Reference Kenny2017).

6 Also Wirz (Reference Wirz2018), stresses that ‘an important element of populist anger appeals is the attribution of blame to the elite or out-groups, as anger is elicited when an adverse situation is caused by others (Ellsworth and Smith, Reference Ellsworth and Smith1988)’.

7 Even the mainstream, center-left Partito Democratico (PD) had a populist phase at the time Matteo Renzi was Prime Minister and Secretary of the party (Hamdaoui, Reference Hamdaoui2021). More recently, in the 2018 national elections, the 5SM – after its astonishing electoral debut in 2013 (winning 27% of electoral votes) – obtained 32% of the votes. In the same year, the right wing League (formerly the ‘Northern League’), refashioned in its core-ideology and leadership, achieved an unprecedented 17% (and 34% in the 2019 European elections) (Biorcio and Natale, Reference Biorcio and Natale2018). Together, they formed an ‘all populist government’, the choice of populism for Italian politics. Since the fall of that coalition and the subsequent alliance between 5SM and the PD, the 5SM has been facing a sharp and steady electoral decline while Matteo Salvini, the leader of the Lega, has been the main figure of populist politics in Italy, up until the elections in September 2022.

8 The electoral manifestoes have been retrieved in Manifesto Project Database (MPD) https://manifesto-project.wzb.eu/, while the specific sources of the speeches are provided in the footnotes.

9 The leaders’ speeches were retrieved though data mining, by using key words (e.g. ‘name of the leader’ + ‘election year’--only the first page of each Google/You Tube search in our time frame-2006/2018 was analysed assuming that videos exhibiting higher viewing rates have also broader public coverage and greater importance for all party supporters). They mainly consisted of: political speeches during party rallies; political meetings; electoral campaigns; speeches to the nation and TV talk shows. Each speech was manually transcribed and classified according to the party and year. We did not include speeches drawn from social media (e.g. Twitter, Facebook) or party blogs having only become more popular in recent years, and not all leaders or parties rely on them extensively for their political communication.

10 Differently than other studies measuring populism (e.g. Hawkins, Reference Hawkins2018), our unit of analysis is not the speeches, rather the sentences. This enabled us to have more units of observation, even when analysing a fewer number of speeches per leader (e.g. 10 on average), offering to the training a significant number of units of analysis as well as covering, probabilistically, a broader spectrum of emotions.

11 The idea underpinning dictionary-based sentiment analysis is that the sentiment of a text is determined by the sentiment of the words in that text. However, the presence of a combination of words can convey specific emotions when it recurs in populist texts – something that supervised machine learning can grasp.

12 E.g. a specific kind of hostility that addresses outgroup members like minorities or migrants; not merely fear, but fear and insecurity related to economic regression or dissatisfaction. Not just ‘anger’, but anger against specific categories of enemies typical of populism, including, above all, political opponents and elites (vertical dimension); not only in happiness, but in the joy and pride of belonging to a specific political and social community (the ‘Us’ versus ‘Them’ typical of the populist Manichaean vision of society)

13 RF also gives the advantage of accurate predictions in the case of non-linear relationships. This feature supported its use for predictions within many topics, e.g. voting behaviour, partisanship and political sentiments, parties’ populism (Ansari et al., Reference Ansari, Aziz, Siddiqui, Mehra and Singh2020).

14 We have also tested an alternative algorithm, namely, the Naïve Bayes, obtaining the same results.

15 We assigned Y = 1 if an emotion was present; 0 if absent. Each coding process was held twice and involved both the authors to reduce possible biases, with Cohen's Kappa inter-rater reliability test ranging from 0.96 to 0.99 (Tables D in appendix).

16 For instance, in a paper classifying sentiments in positive-neutral-negative, the accuracy of measurements is around 75% (Bahrawi, Reference Bahrawi2019).

17 The overall emotional score for all the years analysed is 0.102 for Italian populist parties vs. 0.050 for the non-populists', which means that political discourses containing one of our emotions analysed are double (10% vs. 5%) for populist vs. non-populist political communication. In terms of ‘style of communication’ the party Foza Italia obtains a low score in 2004 and 2009, for what concerns the use of emotions (respectively 0.5 and 1 on a scale of measurements 1–4, on the basis of indicators including resentment; direct and non-institutional language; strong emotions such as fear and enthusiasm) (Caiani and Graziano, Reference Caiani and Graziano2016: 260). The Lega can be considered as a populist party not before 2008 – under the leadership of Salvini (Albertazzi et al., Reference Albertazzi, Giovannini and Seddone2018).

18 The emotional score in electoral manifestoes during the years 2016–2020 is 0.115 for populists (i.e. 11.5% of the sentences analysed) vs. 0.114 (11.4%) for non-populists (whereas differences between the two were greater for the speeches over the same period. i.e. 18.5% for populists vs. 12.4% for not populists).

19 Accounting for 12.2% (score 0.122) of ‘emotional’ sentences out of all sentences in the period 2016–20 for populists and 11.9% for non-populists.

20 This emotion has been much stronger among the populists since 2008, when it accounted for more than 15% of their codified sentences.

21 Present in populist parties in more than 19% of their codified sentences vs. about 10% of non-populists in the overall period aggregated.

22 In contrast, emotions such as fear and insecurity and indignation against neoliberalism (namely the opposition to neoliberalist policies and the idea that there are winners against losers from globalization), although generally on the increase over time, still remain higher for populists with some fluctuations.

23 Accounting from 8% of their sentences in 2006 to 20% in 2008, with our model prediction significantly improving.

26 https://youtu.be/_sCfwh7W1SM.

The outgroup hostility emotion, however, is not only a prerogative of right-wing populists. For instance, Luigi Di Maio, a former leader of the Five star Movement, talking about immigration, stressed in some speeches that his party ‘closes the ports to those who do not respect laws (…)’, has the goal of having ‘a bill on judicial cleansing at sea and those boats’ (‘let us take it straight to Parliament’, 2018, source: https://youtu.be/Jiz0GpFK0KI), is against ‘a government who authorised indiscriminate landings of immigrants in Italian ports for a few pennies’ (‘it is shameful!’ ‘they have transformed Italy into the biggest port in Europe’, 2018, source: https://youtu.be/Jiz0GpFK0KI).

27 See also 2013 UDC (Unione Democratici di Centro) election manifesto, stressing that the diseases of Italy are ‘… the selection of the ruling classes entrusted to random, oligarchic and masterly mechanisms; the worsening of the crisis between representation and territory’ (UDC, 2013, https://manifesto-project.wzb.eu/datasets).

37 For this analysis Lega has been regarded as right wing populism; Potere al Popolo as left wing populism (Di Cocco and Monechi, Reference Di Cocco and Monechi2022) and the 5SM as hybrid (‘other’) (Mosca and Tronconi, Reference Mosca and Tronconi2019).

References

Aalberg, T, Esser, F, Reinemann, C, Strömbäck, J and de Vreese, CH (2017) Populist Political Communication in Europe. New York: Routledge.Google Scholar
Abts, K and Kochuyt, T (2013) De vreemde bedreiging van de verzorgingstaat. Tijdschrift voor Sociologie 34, 227–49.CrossRefGoogle Scholar
Abts, K, Dalle Mulle, E and Laermans, R (2019) Beyond issue diversification: N-VA and the communitarisation of political, economic and cultural conflicts in Belgium. West European Politics 42, 848872.CrossRefGoogle Scholar
Akkerman, T (2015) Immigration policy and electoral competition in Western Europe: a fine-grained analysis of party positions over the past two decades. Party Politics 21, 5467.CrossRefGoogle Scholar
Albertazzi, D, Giovannini, A and Seddone, A (2018) No regionalism please, we are Leghisti!’ The transformation of the Italian Lega Nord under the leadership of Matteo Salvini. Regional and Federal Studies 28, 645671.CrossRefGoogle Scholar
Alvares, C and Dahlgren, P (2016) Populism, extremism and media: mapping an uncertain terrain. European Journal of Communication 31, 4657.CrossRefGoogle Scholar
Ansari, MZ, Aziz, MB, Siddiqui, MO, Mehra, H and Singh, KP (2020) Analysis of political sentiment orientations on twitter. Procedia Computer Science 167, 18211828.CrossRefGoogle Scholar
Arias-Maldonado, M (2017) Las bases afectivas del populismo. Revista Internacional de Pensamiento Político 12, 151167.CrossRefGoogle Scholar
Bahrawi, N (2019) Sentiment analysis using random forest algorithm-online social media based. Journal of Information Technology and Its Utilization 2, 2933.CrossRefGoogle Scholar
Bakker, BN, Rooduijn, M and Schumacher, G (2016) The psychological roots of populist voting: evidence from the United States, the Netherlands and Germany. European Journal of Political Research 55, 302320.CrossRefGoogle Scholar
Bakker, BN, Schumacher, G and Roodujin, M (2021) Hot politics? Affective responses to political rhetoric. American Political Science Review 115, 150164.CrossRefGoogle Scholar
Béland, D (2020) Right-wing populism and the politics of insecurity: how president trump frames migrants as collective threats. Political Studies Review 18, 162177.CrossRefGoogle Scholar
Biancalana, C (2020) Four Italian populisms. In Blokker, P and Anselmi, M (eds), Multiple Populisms: Italy as Democracy's Mirror. London: Routledge, pp. 216241.Google Scholar
Biorcio, R and Natale, P (2018) Il Movimento 5 stelle: dalla protesta al governo. Milano: Mimesis.Google Scholar
Bonansinga, D (2020) Who thinks, feels. The relationship between emotions, politics and populism. Partecipazione e Conflitto 13, 83106.Google Scholar
Bossetta, M (2017) Fighting fire with fire: Mainstream adoption of the populist political style in the 2014 Europe debates between Nick Clegg and Nigel Farage. The British Journal of Politics and International Relations 19, 715734.CrossRefGoogle Scholar
Boussalis, C and Coan, TG (2021) Facing the electorate: computational approaches to the study of nonverbal communication and voter impression formation. Political Communication 38, 7597.CrossRefGoogle Scholar
Bracciale, R, Andretta, M and Martella, A (2021) Does populism go viral? How Italian leaders engage citizens through social media. Information, Communication and Society 24, 14771494.CrossRefGoogle Scholar
Breiman, L (2001) Random forests. Machine Learning 45, 532.CrossRefGoogle Scholar
Brubaker, R (2017) Between nationalism and civilizationism: the European populist moment in comparative perspective. Ethnic and Racial Studies 40, 11911226.CrossRefGoogle Scholar
Caiani, M and Graziano, P (2016) Varieties of populism: insights from the Italian case. Italian Political Science Review/Rivista Italiana di Scienza Politica 46, 243267.CrossRefGoogle Scholar
Caiani, M and Graziano, P (eds) (2021) Varieties of Populism in Europe in Times of Crises. London: Routledge.CrossRefGoogle Scholar
Canovan, M (1999) Trust the people! Populism and the two faces of democracy. Political Studies 47, 216.CrossRefGoogle Scholar
Cossarini, P and Vallespín, F (eds) (2019) Populism and Passions: Democratic Legitimacy After Austerity. London: Routledge.CrossRefGoogle Scholar
Crabtree, C, College, D, Golder, M, Gschwend, T and Indriđason, IH (2018) It is not only what you say, it is also how you say it: the strategic use of campaign sentiment. The Journal of Politics 82, 10441060.CrossRefGoogle Scholar
Di Cocco, J and Monechi, B (2022). How populist are parties? : measuring degrees of populism in party manifestos using supervised machine learning. Political Analysis 0, 311327. doi:10.1017/pan.2021.29.CrossRefGoogle Scholar
Eklundh, E (2019) Emotions, Protest, Democracy: Collective Identities in Contemporary Spain. London: Routledge.CrossRefGoogle Scholar
Ellsworth, PC and Smith, CA (1988) From appraisal to emotion: differences among unpleasant feelings. Motivation and Emotion 12, 271302.CrossRefGoogle Scholar
Engesser, S, Fawzi, N and Larsson, AO (2017) Populist online communication: introduction to the special issue. Information, Communication and Society 20, 12791292.CrossRefGoogle Scholar
Ernst, N, Blassnig, S, Engesser, S, Büchel, F and Esser, F (2019 a) Populists prefer social media over talk shows: an analysis of populist messages and stylistic elements across six countries’. Social Media + Society 5, 2056305118823358. doi:10.1177/2056305118823358CrossRefGoogle Scholar
Ernst, N, Esser, F, Blassnig, S and Engesser, S (2019 b) Favorable opportunity structures for populist communication: comparing different types of politicians and issues in social media, television and the press. The International Journal of Press/Politic 24, 165188.CrossRefGoogle Scholar
Gerstlé, J and Nai, A (2019) Negativity, emotionality and populist rhetoric in election campaigns worldwide, and their effects on media attention and electoral success. European Journal of Communication 34, 410444.CrossRefGoogle ScholarPubMed
Hamdaoui, S (2021) A “stylistic anti-populism”: an analysis of the Sardine movement's opposition to Matteo Salvini in Italy. Social Movement Studies 21, 436452. doi: 10.1080/14742837.2021.1899910CrossRefGoogle Scholar
Hameleers, M, Bos, L and de Vreese, CH (2016) The Netherlands: A heartland full of insights into populist communication. In Aalberg, T, Esser, F, Reinemann, C, Strömbäck, J and Vreese, CH (eds), Populist Political Communication in Europe. London: Routledge, pp. 138150.Google Scholar
Haselmayer, M and Jenny, M (2017) Sentiment analysis of political communication: combining a dictionary approach with crowdcoding. Quality and Quantity 51, 26232646.CrossRefGoogle ScholarPubMed
Hawkins, KA (2018) The ideational approach. Routledge Handbook of Global Populism. London: Routledge, pp. 5772.CrossRefGoogle Scholar
Hawkins, KA, Carlin, RE, Littvay, L and Kaltwasser, CR (eds) (2018) The Ideational Approach to Populism: Concept, Theory, and Analysis. London: Routledge.CrossRefGoogle Scholar
Hochschild, AR (2018) Strangers in Their own Land: Anger and Mourning on the American Right. New York: The New Press.Google Scholar
Ivaldi, G, Lanzone, M and Woods, D (2017) Varieties of populism across a left-right Spectrum: the case of the Front National, the Northern League, Podemos and the Five Star Movement. Swiss Political Science Review 23, 354376.CrossRefGoogle Scholar
Iyengar, S, Lelkes, Y, Levendusky, M, Malhotra, N and Westwood, SJ (2019) The origins and consequences of affective polarization in the United States. Annual Review of Political Science 22, 129146.CrossRefGoogle Scholar
Jasper, JM (2011) Emotions and social movements: twenty years of theory and research. Annual Review of Sociology 37, 285303.CrossRefGoogle Scholar
Kenny, M (2017) Back to the populist future?: understanding nostalgia in contemporary ideological discourse. Journal of Political Ideologies 22, 256273.CrossRefGoogle Scholar
Kosmidis, S, Sara, BH, Eamonn, M and Whitefield, L (2019) Party competition and emotive rhetoric. Comparative Political Studies 52, 811–37.CrossRefGoogle Scholar
Kriesi, H (2018) Revisiting the populist challenge. Politologicky Casopis – Czech Journal of Political Science 25, 527.Google Scholar
Kuhne, R and Schemer, C (2015) The emotional effects of news frames. Communication Research 42, 387407.CrossRefGoogle Scholar
Lim, N (2016) Cultural differences in emotion: differences in emotional arousal level between the East and the West. Integrative Medicine Research 5, 105109.CrossRefGoogle Scholar
Magni, G (2017) It's the emotions, Stupid! Anger about the economic crisis, low political efficacy, and support for populist parties. Electoral Studies 50, 91102.CrossRefGoogle Scholar
Manucci, L (ed.) (2022) The Populism Interviews: A Dialogue with Leading Experts. London: Routledge.CrossRefGoogle Scholar
Martella, A and Bracciale, R (2022) Populism and emotions: Italian political leaders’ communicative strategies to engage Facebook users. Innovation: The European Journal of Social Science Research 35, 6585.Google Scholar
Moffitt, B (2015) How to perform crisis: a model for understanding the key role of crisis in contemporary populism. Government and Opposition 50, 189217.CrossRefGoogle Scholar
Mols, F and Jetten, J (2016) Explaining the appeal of populist right-wing parties in times of economic prosperity. Political Psychology 37, 275292.CrossRefGoogle Scholar
Mosca, L and Tronconi, F (2019) Beyond left and right: the eclectic populism of the five star movement. West European Politics 42, 12581283.CrossRefGoogle Scholar
Mudde, C (2016) The ideational approach. In Rovira Kaltwasser, C, Taggart, P, Espejo, PO and Ostiguy, P (eds), The Oxford Handbook of Populism. Oxford: Oxford University Press, pp. 342362.Google Scholar
Nai, A (2021) Fear and loathing in populist campaigns? Comparing the communication style of populists and non-populists in elections worldwide. Journal of Political Marketing 20, 219250.CrossRefGoogle Scholar
Neuman, WR, Marcus, GE, Crigler, AN and MacKuen, M (eds) (2007) The Affect Effect: Dynamics of Emotion in Political Thinking and Behavior. Chicago: University of Chicago Press.Google Scholar
Nguyen, C (2019) Emotions and populist support. SocArXiv, doi: 10.31235/osf.io/e2wm6CrossRefGoogle Scholar
Pirro, AL and Taggart, P (2022) Populists in power and conspiracy theories. Party Politics 0, doi: 10.1177/13540688221077071Google Scholar
Rauh, C (2018) Validating a sentiment dictionary for German political language – a workbench note. Journal of Information Technology and Politics 15, 319–43.CrossRefGoogle Scholar
Rico, G, Guinjoan, M and Anduiza, E (2017) The emotional underpinnings of populism: how anger and fear affect populist attitudes. Swiss Political Science Review 23, 444461.CrossRefGoogle Scholar
Rooduijn, M and Akkerman, T (2017) Flank attacks: populism and left-right radicalism in Western Europe. Party Politics 23, 193204.CrossRefGoogle Scholar
Roodujin, M, Van Kessel, S, Froio, C, Pirro, A, De Lange, S, Halikiopoulou, D, Lewis, P, Mudde, C and Taggart, P (2019) The PopuList. Available at https://popu-list.org/.Google Scholar
Salmeila, M and von Scheve, C (2018) Emotional dynamics of right- and left-wing political populism. Humanity and Society 42, 434454.CrossRefGoogle Scholar
Schwörer, J (2021) Don't call me a populist! The meaning of populism for Western European parties and politicians. Electoral Studies 72, 102358.CrossRefGoogle Scholar
Sindic, D and Condor, S (2014) Social identity theory and self-categorisation theory. The Palgrave Handbook of Global Political Psychology. London: Palgrave Macmillan, pp. 3954.CrossRefGoogle Scholar
Taber, CS and Young, E (2013) Information processing. In Huddy, L, Levy, JS and Sears, DO (eds), The Oxford Handbook of Political Psychology, 2nd Edn. Oxford: Oxford University Press.Google Scholar
Tarchi, M (2015) Italy: the promised land of populism? Contemporary Italian Politics 7, 273285.CrossRefGoogle Scholar
Utych, SM (2018) Negative affective language in politics. American Politics Research 46, 77102.CrossRefGoogle Scholar
Valentim, V and Widmann, T (2023) Does radical-right success make the political debate more negative? Evidence from emotional rhetoric in German state parliaments. Political Behavior 45, 243264.CrossRefGoogle Scholar
Vasilopoulos, P, George, EM and Foucault, M (2018) Emotional responses to the Charlie Hebdo attacks: addressing the authoritarianism puzzle. Political Psychology 39, 557–75.CrossRefGoogle Scholar
Vasilopoulos, P, George, EM, Nicholas, AV and Foucault, M (2019) Fear, anger, and voting for the far right: evidence from the 13 November 2015 Paris terror attacks. Political Psychology 40, 679704.CrossRefGoogle Scholar
Vasilopoulou, S and Wagner, M (2017) Fear, anger and enthusiasm about the European Union: effects of emotional reactions on public preferences towards European integration. European Union Politics 18, 382405.CrossRefGoogle Scholar
Verzichelli, L and Castaldo, A (2020) Technocratic populism in Italy after Berlusconi: the trendsetter and his disciples. Politics and Governance 8, 485495.Google Scholar
Wagner, M (2014) Fear and anger in Great Britain: blame assignment and emotional reactions to the financial crisis. Political Behavior 36, 683703.CrossRefGoogle Scholar
Widmann, T (2021) How emotional are populists really? Factors explaining emotional appeals in the communication of political parties. Political Psychology 42, 163181.CrossRefGoogle Scholar
Wirz, D (2018) Persuasion through emotion? An experimental test of the emotion-eliciting nature of populist communication. International Journal of Communication 12, 11141138.Google Scholar
Zulianello, M (2020) Varieties of populist parties and party systems in Europe: from state-of-the-art to the application of a novel classification scheme to 66 parties in 33 countries. Government and Opposition 55, 327347.CrossRefGoogle Scholar
Figure 0

Figure 1. The overall emotional level (i.e. presence of emotions) in the populist vs. not -populist party political discourse in Italy (2000–2020). (a) aggregated. (b) by type of communication arena (electoral manifestoes vs. speeches).Note: The scores showed in the figures represent the percentages of ‘emotional sentences’ per year, and have to be considered as a proxy of a political actors’ emotional level. For example, a score of 0.122 (i.e. the emotional score of populists in 2016–20 fig.1a) means that 12.2% of the codified sentences of the Italian populist political discourse in 2016–2020 contained emotions (at least one among the five broad emotions analysed in this study).

Figure 1

Figure 2. Different types of emotions in the populist vs. not -populist party political discourse in Italy (2000–2020).Note: In the figures, the label hate refers to ‘hate against outgroup’; indignation’ to ‘indignation against neoliberalism’. The scores showed in the figures represent the percentages of ‘emotional sentences’ per year, and have to be considered as a proxy of a political actors’ emotional level related to the specific emotion.

Figure 2

Figure 3. Different types of emotions in the political discourse of varieties of populism (lef wing, right wing, hybrid, i.e. ‘other’), Italy (2008–2020).Note: In the figures, the label hate refers to ‘hate against outgroup’; indignation’ to ‘indignation against neoliberalism’. The Italian party ‘Potere al Popolo’ has been classified as Left wing populism (see also Di Cocco and Monechi, 2022); the party Lega as Right wing populism; and, finally, the 5SM party as hybrid (i.e. ‘other’) (see also Mosca and Tronconi, 2019). The scores showed in the figures represent the percentages of emotional sentences per year, per emotion, per type of populism, and have to be considered as a proxy of a political actors’ emotional level.

Supplementary material: Link

Caiani and Di Cocco Dataset

Link
Supplementary material: File

Caiani and Di Cocco supplementary material

Caiani and Di Cocco supplementary material

Download Caiani and Di Cocco supplementary material(File)
File 801.9 KB