Hostname: page-component-cd9895bd7-8ctnn Total loading time: 0 Render date: 2024-12-26T23:07:15.910Z Has data issue: false hasContentIssue false
  • English
  • Français

Can the Acoustic Analysis of Expressive Prosody Discriminate Schizophrenia?

Published online by Cambridge University Press:  02 November 2015

Francisco Martínez-Sánchez ,
José Antonio Muela-Martínez ,
Pedro Cortés-Soto ,
Juan José García Meilán ,
Juan Antonio Vera Ferrándiz ,
Amaro Egea Caparrós  and
Isabel María Pujante Valverde
Francisco Martínez-Sánchez*
Affiliation:
Universidad de Murcia (Spain)
José Antonio Muela-Martínez
Affiliation:
Universidad de Jaén (Spain)
Pedro Cortés-Soto
Affiliation:
Universidad de Jaén (Spain)
Juan José García Meilán
Affiliation:
Universidad de Salamanca (Spain)
Juan Antonio Vera Ferrándiz
Affiliation:
Universidad de Murcia (Spain)
Amaro Egea Caparrós
Affiliation:
Universidad de Murcia (Spain)
Isabel María Pujante Valverde
Affiliation:
Universidad de Murcia (Spain)
*
*Correspondence concerning this article should be addressed to Francisco Martínez-Sánchez. Dpto. de Psicología Básica y Metodología. Facultad de Psicología. Universidad de Murcia. Campus Universitario de Espinardo. 30100. Murcia (Spain). E-mail: franms@um.es
Get access Rights & Permissions [Opens in a new window]

Abstract

Emotional states, attitudes and intentions are often conveyed by modulations in the tone of voice. Impaired recognition of emotions from a tone of voice (receptive prosody) has been described as characteristic symptoms of schizophrenia. However, the ability to express non-verbal information in speech (expressive prosody) has been understudied. This paper describes a useful technique for quantifying the degree of expressive prosody deficits in schizophrenia, using a semi-automatic method, and evaluates this method’s ability to discriminate between patient and control groups. Forty-five medicated patients with a diagnosis of schizophrenia were matched with thirty-five healthy comparison subjects. Production of expressive prosodic speech was analyzed using variation in fundamental frequency (F0) measures on an emotionally neutral reading task. Results revealed that patients with schizophrenia exhibited significantly more pauses (p < .001), were slower (p < .001), and showed less pitch variability in speech (p < .05) and fewer variations in syllable timing (p < .001) than control subjects. These features have been associated with «flat» speech prosody. Signal processing algorithms applied to speech were shown to be capable of discriminating between patients and controls with an accuracy of 93.8%. These speech parameters may have a diagnostic and prognosis value and therefore could be used as a dependent measure in clinical trials.

Keywords

Schizophreniaflat affectexpressive prosodyspeech analysis
Type
Research Article
Information
The Spanish Journal of Psychology , Volume 18 , 2015 , E86
Copyright
Copyright © Universidad Complutense de Madrid and Colegio Oficial de Psicólogos de Madrid 2015 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Adolphs, R. (2001). The neurobiology of social cognition. Current Opinion in Neurobiology, 11, 231–239. http://dx.doi.org/10.1016/S0959-4388(00)00202-6 Google Scholar
Allott, K. A., Schäfer, M. R., Thompson, A., Nelson, B., Bendall, S., Bartholomeusz, C. F., … Amminger, G. P. (2014). Emotion recognition as a predictor of transition to a psychotic disorder in ultra-high risk participants. Schizophrenia Research, 153, 25–31. http://dx.doi.org/10.1016/j.schres.2014.01.037 Google Scholar
Alpert, M., Kotsaftis, A., & Pouget, E. R. (1997). At issue: Speech fluency and schizophrenic negative signs. Schizophrenia Bulletin, 23, 171–177.CrossRefGoogle ScholarPubMed
Alpert, M., Rosenberg, S. D., Pouget, E. R., & Shaw, R. J. (2000). Prosody and lexical accuracy in flat affect schizophrenia. Psychiatry Research, 97, 107–118. http://dx.doi.org/10.1016/S0165-1781(00)231-6 Google Scholar
Alpert, M., Shaw, R. J., Pouget, E. R., & Lim, K. O. (2002). A comparison of clinical ratings with vocal acoustic measures of flat affect and alogia. Journal of Psychiatry Research, 36, 347–353. http://dx.doi.org/10.1016/S0022-3956(02)00016-X CrossRefGoogle ScholarPubMed
Bech, P., Larsen, J. K., & Andersen, J. (1988). The BPRS: Psychometric Developments. Psychopharmacology Bulletin, 24(1), 117–121.Google Scholar
Boersma, P., & Weenink, D. (2013). Praat: Doing phonetics by computer (5.1.42 version). [Computer software]. Amsterdam, The Netherlands: University of Amsterdam. Retrieved from http://www.praat.org/ Google Scholar
Brazo, P., Beaucousin, V., Lecardeur, L., Razafimandimby, A., Dollfus, S. (2014). Social cognition in schizophrenic patients: The effect of semantic content and emotional prosody in the comprehension of emotional discourse. Frontiers in Psychiatry, 5, 120. http://dx.doi.org/10.3389/fpsyt.2014.00120 Google Scholar
Cantero, F. J. (2003). Fonética y didáctica de la pronunciación [Phonetics and Didactics of pronunciation]. In Mendoza, A. (Ed.), Didáctica de la Lengua y la Literatura para Primaria [Didactics of the language and literature for elementary]. (pp. 1–24). Madrid, Spain: Pearson.Google Scholar
Clemmer, E. J. (1980). Psycholinguistic aspects of pauses and temporal patterns in schizophrenic speech. The Journal of Psycholinguistic Research, 9, 161–185. http://dx.doi.org/10.1007/BF01067469 Google Scholar
Cohen, A. S., & Elvevåg, B. (2014). Automated computerized analysis of speech in psychiatric disorders. Current Opinion in Psychiatry, 27, 203–209. http://dx.doi.org/10.1097/YCO.0000000000000056 Google Scholar
Cohen, A. S., & Hong, S. L. (2011). Understanding constricted affect in schizotypy through computerized prosodic analysis. Journal of Personality Disorders, 25, 478–491. http://dx.doi.org/10.1521/pedi.2011.25.4.478 Google Scholar
Cohen, A. S., Alpert, M., Nienow, T. M., Dinzeo, T. J., & Docherty, N. M. (2008). Computerized measurement of negative symptoms in schizophrenia. Journal of Psychiatry Research, 42, 827–836. http://dx.doi.org/10.1016/j.jpsychires.2007.08.008 CrossRefGoogle ScholarPubMed
Cohen, A. S., Iglesias, B., & Minor, K. S. (2009). The neurocognitive underpinnings of diminished expressivity in schizotypy: What the voice reveals. Schizophrenia Research, 109, 38–45. http://dx.doi.org/10.1016/j.schres.2009.01.010 CrossRefGoogle ScholarPubMed
Cohen, A. S., Kim, Y., & Najolia, G. M. (2013). Psychiatric symptom versus neurocognitive correlates of diminished expressivity in schizophrenia and mood disorders. Schizophrenia Research, 146, 249–253. http://dx.doi.org/10.1016/j.schres.2013.02.002 Google Scholar
Cohen, A. S., McGovern, J. E., Dinzeo, T. J., & Covington, M. A. (2014). Speech deficits in serious mental illness: A cognitive resource issue?. Schizophrenia Research, 160, 173–179. http://dx.doi.org/10.1016/j.schres.2014.10.032 Google Scholar
Cohen, A. S., Mitchell, K. R., & Elvevåg, B. (2014). What do we really know about blunted vocal affect and alogia? A meta-analysis of objective assessments. Schizophrenia Research, 159, 533–538. http://dx.doi.org/10.1016/j.schres.2014.09.013 Google Scholar
Couture, S. M., Penn, D. L., & Roberts, D. L. (2006). The functional significance of social cognition in schizophrenia: A review. Schizophrenia Bulletin, 32, S44–S63. http://dx.doi.org/10.1093/schbul/sbl029 Google Scholar
Dickey, C. C., Vu, M. A. T., Voglmaier, M. M., Niznikiewicz, M. A., McCarley, R. W., & Panych, L. P. (2012). Prosodic abnormalities in schizotypal personality disorder. Schizophrenia Research, 142, 20–30. http://dx.doi.org/10.1016/j.schres.2012.09.006 Google Scholar
Emmerson, L. C., Ben-Zeev, D., Granholm, E., Tiffany, M., Golshan, S., & Jeste, D. V. (2009). Prevalence and longitudinal stability of negative symptoms in healthy participants. International Journal of Geriatric Psychiatry, 24, 1438–1444. http://dx.doi.org/10.1002/gps.2284 Google Scholar
First, M. B., Spitzer, R. L., Gibbon, M., & Williams, J. B. W (1996). Structured Clinical Interview for DSM-IV Axis I Disorders—Clinician Version (SCID-CV). New York, NY: New York State Psychiatric Institute, Biometrics Research Department.Google Scholar
Green, M. F., & Horan, W. P. (2010). Social cognition in Schizophrenia. Current Directions in Psychological Science, 19, 243–248. http://dx.doi.org/10.1177/0963721410377600 Google Scholar
Green, M. F., Bearden, C. E., Cannon, T. D., Fiske, A. P., Hellemann, G. S., Horan, W. P., … Nuechterlein, K. H (2012). Social cognition in schizophrenia, Part 1: Performance across phases of illness. Schizophrenia Bulletin, 38, 854–864. http://dx.doi.org/10.1093/schbul/sbq171 Google Scholar
Hoekert, M., Kahn, R. S., Pijnenborg, M., & Aleman, A. (2007). Impaired recognition and expression of emotional prosody in schizophrenia: Review and meta-analysis. Schizophrenia Research, 96, 135–145. http://dx.doi.org/10.1016/j.schres.2007.07.023 Google Scholar
Hooker, C., & Park, S. (2002). Emotion processing and its relationship to social functioning in schizophrenia patients. Psychiatry Research, 112, 41–50. http://dx.doi.org/10.1016/S0165-1781(02)00177–4 CrossRefGoogle ScholarPubMed
Horan, W. P., Green, M. F., DeGroot, M., Fiske, A., Hellemann, G. S., Kee, K., … Nuechterlein, K. H. (2012). Social cognition in schizophrenia, Part 2: 12-month stability and prediction of functional outcome in first-episode patients. Schizophrenia Bulletin, 38, 865–872. http://dx.doi.org/10.1093/schbul/sbr001 Google Scholar
Johns, L. C., Roseell, S., Frith, C., Ahmad, F., Hemsley, D., Kuipers, E., & McGuire, P. K. (2001). Verbal self-monitoring and auditory verbal hallucinations in patients with schizophrenia. Psychological Medicine, 31, 705–715. http://dx.doi.org/10.1017/S0033291701003774 Google Scholar
Johnson-Selfridge, M., & Zalewski, C. (2001). Moderator variables of executive functioning in schizophrenia: Meta-analytic findings. Schizophrenia Bulletin, 27, 305–316. http://dx.doi.org/10.1093/oxfordjournals.schbul.a006876 Google Scholar
Kee, K. S., Green, M. F., Mintz, J., & Brekke, J. S. (2003). Is emotion processing a predictor of functional outcome in schizophrenia? Schizophrenia Bulletin, 29, 487–497. http://dx.doi.org/10.1093/oxfordjournals.schbul.a007021 Google Scholar
Kliper, R., Vaizman, Y., Weinshall, D., & Portuguese, S. (2010). Evidence for depression and dchizophrenia in speech prosody. Athens, Greece: Proceedings of ISCA Tutorial and Research Workshop on Experimental Linguistics.Google Scholar
Kohler, C. G., Walker, J. B., Martin, E. A., Healey, K. M., & Moberg, P. J. (2010). Facial emotion perception in schizophrenia: A meta-analytic review. Schizophrenia Bulletin, 36, 1009–1019. http://dx.doi.org/10.1093/schbul/sbn192 Google Scholar
Kring, A. M., & Ellis, O. (2013). Emotion deficits in people with schizophrenia. Annual Review of Clinical Psychology, 9, 409–433. http://dx.doi.org/10.1146/annurev-clinpsy-050212-185538 Google Scholar
Kring, A. M., & Moran, E. K. (2008). Emotional response deficits in schizophrenia: Insights from affective science. Schizophrenia Bulletin, 34, 819–834. http://dx.doi.org/10.1093/schbul/sbn071 CrossRefGoogle ScholarPubMed
Kucharska-Pietura, K., David, A. S., Masiak, M., & Phillips, M. L. (2005). Perception of facial and vocal affect by people with schizophrenia in early and late stages of illness. The British Journal of Psychiatry, 187, 523–528. http://dx.doi.org/10.1192/bjp.187.6.523 Google Scholar
Kugler, B. T., & Caudrey, D. J. (1983). Phoneme discrimination in schizophrenia. The British Journal of Psychiatry, 142, 53–59. http://dx.doi.org/10.1192/bjp.142.1.53 Google Scholar
Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (2005). International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Technical Report A-6. Gainesville, FL: University of Florida.Google Scholar
Leentjens, A. F. G., Wielaert, S. M., Harskamp, F. V., & Wilmink, F. W. (1998). Disturbances of affective prosody in patients with Schizophrenia; a cross sectional study. The Journal of Neurology, Neurosurgery, & Psychiatry, 64, 375–378. http://dx.doi.org/10.1136/jnnp.64.3.375 Google Scholar
Lukoff, D., Nuechterlein, K. H., & Ventura, J. (1986). Manual for the Expanded Brief Psychiatric Rating Scale (BPRS). Schizophrenia Bulletin, 12, 594–602.Google Scholar
Martínez-Sánchez, F., Meilán, J. J., Pérez, E., Carro, J., & Arana, J. M. (2012). Patrones prosódicos en sujetos con la Enfermedad de Alzheimer [Prosodic profiles of patients suffering from Alzheimer’s Disease]. Psicothema, 24(1), 16–21.Google Scholar
Matsumoto, K, Samson, G. T., O’Daly, O. D., Tracy, D. K, Patel, A. D., & Shergill, S. S. (2006). Impaired prosodic discrimination in patients with schizophrenia. British Journal of Psychiatry, 89, 180–181.Google Scholar
Melinder, M. R. D., & Barch, D. M. (2003). The influence of a working memory load manipulation on language production in schizophrenia. Schizophrenia Bulletin, 29, 473–485. http://dx.doi.org/10.1093/oxfordjournals.schbul.a007020 Google Scholar
Mertens, P. (2004). Le prosogramme: Une transcription semi-automatique de la prosodie [The prosogram: Semi-automatic transcription of prosody]. Cahiers de l'Institut de Linguistique de Louvain, 30, 7–25. http://dx.doi.org/10.2143/CILL.30.1.519212 Google Scholar
Michelas, A., Faget, C., Portes, C., Lienhart, A. S., Boyer, L., Lançon, C., & Champagne-Lavau, M. (2014). Do patients with schizophrenia use prosody to encode contrastive discourse status? Frontiers in Psychology, 5, 755. http://dx.doi.org/10.3389/fpsyg.2014.00755 Google Scholar
Nicholson, I. R., Chapman, J. E., & Neufeld, R. W. J. (1995). Variability in BPRS definitions of positive and negative symptoms. Schizophrenia Research, 17, 177–185. http://dx.doi.org/10.1016/0920-9964(94)00088-P Google Scholar
Pascual, S., Solé, B., Castillón, J. J., Abadía, M. J., & Tejedor, M. J. (2005). Prosodia afectiva y reconocimiento facial y verbal de la emoción en la esquizofrenia [Expressive prosody and facial and verbal emotional recognition in schizophrenia]. Revista de Psiquiatría de la Facultad de Medicina de Barcelona, 32, 179–183.Google Scholar
Patel, A. D. (2008). Music, language and the brain. Oxford, UK: Oxford University.Google Scholar
Penn, D. L., Sanna, L. J., & Roberts, D. L. (2008). Social perception in schizophrenia: An overview. Schizophrenia Bulletin, 34, 408–411.Google Scholar
Peralta, V., & Cuesta, M. J. (1994). Validación de la escala de los síndromes positivo y negativo (PANSS) en una muestra de esquizofrénicos españoles [Standardization of the Positive and Negative Syndrome Scale (PANSS) in a sample of Spanish schizophrenic patients]. Actas Luso-Españolas de Neurología y Psiquiatría, 22, 171–177.Google Scholar
Putnam, K. M., & Kring, A. M. (2007). Accuracy and intensity of posed emotional expressions in unmedicated schizophrenia patients: Vocal and facial channels. Psychiatry Research 151, 67–76. http://dx.doi.org/10.1016/j.psychres.2006.09.010 Google Scholar
Shaw, R. J., Dong, M., Lim, K. O., Faustman, W. O., Pouget, E. R., & Alpert, M. (1999). The relationship between affect expression and affect recognition in schizophrenia. Schizophrenia Research, 37, 245–250. http://dx.doi.org/10.1016/S0920-9964(98)00172–8 Google Scholar
Silver, H., Goodman, C., Knoll, G., Isakov, V., & Modai, L. (2005). Schizophrenia patients with a history of severe violence differ from nonviolent schizophrenia patients in perception of emotions but not cognitive function. Journal of Clinical Psychiatry, 66, 300–308. http://dx.doi.org/10.4088/JCP.v66n0305 Google Scholar
Silver, H., Shlomo, N., Turner, T., & Gur, R. C. (2002). Perception of happy and sad facial expressions in chronic schizophrenia: Evidence for two evaluative systems. Schizophrenia Research, 55, 171–177. http://dx.doi.org/10.1016/S0920-9964(01)00208–0 Google Scholar
Trémeau, F. A. (2006). Review of emotion deficits in schizophrenia. Dialogues in Clinical Neuroscience, 8, 59–70.CrossRefGoogle ScholarPubMed
Trémeau, F., Malaspina, D., Duval, F., Correa, H., Hager-Budny, M., Coin-Bariou, L., … Gorman, J. M. (2005). Facial expressiveness in patients with schizophrenia compared to depressed patients and nonpatient comparison subjects. The American Journal of Psychiatry, 162(1), 92–101. http://dx.doi.org/10.1176/appi.ajp.162.1.92 Google Scholar