Pitch Patterns in Vocal Expression of 'Happiness' and 'Sadness' in the Reading Aloud of Prose on the Basis of Selected Audiobooks

Authors

  • Łukasz Stolarski Jan Kochanowski University

DOI:

https://doi.org/10.1515/rela-2015-0016

Keywords:

Pitch patterns, emotional speech, natural speech

Abstract

The primary focus of this paper is to examine the way the emotional categories of “happiness” and “sadness” are expressed vocally in the reading aloud of prose. In particular, the two semantic categories were analysed in terms of the pitch level and the pitch variability on a corpus based on 28 works written by Charles Dickens. passages with the intended emotional colouring were selected and the fragments found in the corresponding audiobooks. They were then analysed acoustically in terms of the mean F0 and the standard deviation of F0. The results for individual emotional passages were compared with a particular reader’s mean pitch and standard deviation of pitch. The differences obtained in this way supported the initial assumptions that the pitch level and its standard deviation would raise in “happy” extracts but lower in “sad” ones. Nevertheless, not all of these tendencies could be statistically validated and additional examples taken from a selection of random novels by other nineteenth century writers were added. The statistical analysis of the larger samples confirmed the assumed tendencies but also indicated that the two semantic domains may utilise the acoustic parameters under discussion to varying degrees. While “happiness” tends to be signalled primarily by raising F0, “sadness” is communicated mostly by lowering the variability of F0. Changes in the variability of F0 seem to be of less importance in the former case, and shifts in the F0 level less significant in the latter.

References

Alter, K., Rank, E., Kotz, S. A., Pfeifer, E., Besson, M., Friederici, A. D., & Matiasek, J. (1999). On the relations of semantic and acoustic properties of emotions. In Proceedings of the XIVth International Congress of Phonetic Sciences, San Francisco: 2121-2124.
Google Scholar

Anthony, L. (2014). AntConc (version 3.4.3w) [Computer Software]. Tokyo: Waseda University. Retrieved from http://www.antlab.sci.waseda.ac.jp/.
Google Scholar

Averill, J. R. (2009). Constructivism (psychological perspectives). In D. Sander & K. R. Scherer (Eds.), Oxford Companion to Emotion and the Affective Sciences (pp 98-99). New York, NY: Oxford University Press.
Google Scholar

Banse, R., & Scherer, K. R. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70, 614-636.
Google Scholar

Barrett, L. F. (2006). Are emotions natural kinds? Perspectives on Psychological Science, 1, 28-58.
Google Scholar

Bergmann, G., Goldbeck T., & Scherer, K. R. (1988). Emotionale Eindruckswirkung von prosodischen Sprechmerkmalen. Zeitschrift für Experimentelle und Angewandte Psychologie, 35, 167-200.
Google Scholar

Bezooijen, R. V. (1984). The Characteristics and Recognizability of Vocal Expression of Emotion. Dordrecht, Holland: Foris Publications.
Google Scholar

Boersma, P., & Weenink, D. (2014). Praat: Doing Phonetics by Computer (version 5.4.01) [Computer software]. Retrieved from http://www.praat.org/.
Google Scholar

Boves, L. (1984). The Phonetic Basis of Perceptual Ratings of Running Speech. Dordrecht, Holland: Foris Publications.
Google Scholar

Breitenstein C., van Lancker, D., & Daum, I. (2001). The contribution of speech rate and pitch variation to the perception of vocal emotions in a German and an American sample. Cognition and Emotion, 15(1), 57-79.
Google Scholar

Cahn, J. (1990a). The generation of affect in synthesized speech. Journal of the American Voice I/O Society, 8, 1-19.
Google Scholar

Cahn, J. (1990b). Generating expression in synthesized speech. Technical report. Boston: MIT Media Laboratory Technical Report.
Google Scholar

Carlson, R. B., Granström, B., & Nord, L. (1992). Experiments with emotive speech: acted utterances and synthesized replicas. Proceedengs ICSLP 92, Banff, Alberta, Canada 1, 671-674.
Google Scholar

Coleman, R. K., & Williams, R. (1979). Identification of emotional states using perceptual and acoustic analyses. In V. Lawrence & B. Weinberg (Eds.), Transcript of the Eighth Symposium: Care of the Professional Voice (Part I). New York:The Voice Foundation.
Google Scholar

Cosmides, L. (1983). Invariances in the acoustic expression of emotion during speech. Journal of Experimental Psychology: Human Perception and Performance, 9, 864-881.
Google Scholar

Cummings, K. E., & Clements, M. A. (1995). Analysis of the glottal excitation of emotionally styled and stressed speech. Journal of the Acoustical Society of America, 98, 88-98.
Google Scholar

Darwin, C. (1872). The Expression of Emotions in Man and Animals. London: John Murray.
Google Scholar

Davitz, J. R. (1964). The Communication of Emotional Meaning. New York: McGraw-Hill.
Google Scholar

Ekman, P. (1982). Emotion in the Human Face. Cambridge, New York: Cambridge University Press.
Google Scholar

Ekman, P. (1999). Basic emotions. In T. Dalgleish & M. Power (Eds.), Handbook of Cognition and Emotion (pp. 45-60). Sussex, UK: John Wiley & Sons.
Google Scholar

Eldred, S. H., & Price, D. B. (1958). A linguistic evaluation of feeling states in psychotherapy. Psychiatry, 21, 115-121.
Google Scholar

Fairbanks, G., & Hoaglin, L. W. (1941). An experimental study of the pitch characteristics of the voice during the expression of emotion. Speech Monographs, 6, 85-90.
Google Scholar

Fairbanks, G., & Provost, W. (1939). An experimental study of the pitch characteristics of the voice during the expression of emotion. Speech Monographs, 6, 87-104.
Google Scholar

Frijda, N. H. (1986). The Emotions. Cambridge: Cambridge University Press.
Google Scholar

Fonagy, I. (1978). A new method of investigating the perception of prosodic features. Language and Speech, 21, 34-49.
Google Scholar

Gobl, C., & Ní Chasaide, A. (2003). The role of voice quality in communicating emotion, mood and attitude. Speech Communication, 40, 189-212.
Google Scholar

Hargreaves, W. A., Starkweather J. A., & Blacker, K. H. (1965). Voice quality in depression. Journal of Abnormal Psychology, 70, 218-220.
Google Scholar

Havrdova, Z., & Moravek, M. (1979). Changes of the voice expression during suggestively influenced states of experiencing. Activitas Nervosa Superior, 21, 33-35.
Google Scholar

Huttar, G. L. (1968). Relations between prosodic variables and emotions in normal American English utterances. Journal of Speech and Hearing Research, 11, 481-487.
Google Scholar

House, D. (1990). Tonal Perception in Speech. Lund: Lund University Press.
Google Scholar

Izard, C. E. (1977). Human Emotions. New York: Plenum Press.
Google Scholar

Johnstone, T., & Scherer, K R. (1999). The effects of emotions on voice quality. In Proceedings of the XIVth International Congress of Phonetic Sciences (pp. 2029-2032). San Francisco.
Google Scholar

Kaiser, L. (1962). Communication of affects by single vowels. Synthese, 14, 300-319.
Google Scholar

Kotlyar, G. M., & Morozov, V. P. (1976). Acoustical correlates of the emotional content of vocalized speech. Journal of Acoustics of the Academy of Sciences of the USSR, 22, 208-211.
Google Scholar

Kuroda, I., Fujiwara, O., Okamura N., & Utsuki, N. (1976). Method for determining pilot stress through analysis of voice communication. Aviation, Space, and Environmental Medicine, 47, 528-533.
Google Scholar

Ladd, D. R., Silverman, K., Tolkmitt, F., Bergmann, G., & Scherer, K. R. (1985). Evidence for the independent function of intonation contour type, voice quality, and F0 range in signalling speaker affect. Journal of the Acoustical Society of America, 78, 435-444.
Google Scholar

Laukkanen, A. M., Vilkman, E., Alku, P., & Oksanen, H. (1996). Physical variation related to stress and emotionally state: a preliminary study. Journal of Phonetics, 24, 313-335.
Google Scholar

Lieberman, P., & Michaels, S. B. (1962). Some aspects of fundamental frequency and envelope amplitude as related to the emotional content of speech. Journal of the Acoustical Society of America, 34, 922-927.
Google Scholar

Markel, N. N., Bern M. F., & Phillis, J. A. (1973). The relationship between words and tone-of-voice. Language and Speech, 16, 15-21.
Google Scholar

Mason, W. A. (2012). Basic emotions: a reconstruction. Emotion Review, 4, 238-244.
Google Scholar

Minitab 16 Statistical Software. (2010). [Computer software]. State College, PA: Minitab, Inc. Available from http://www.minitab.com/.
Google Scholar

McRoberts, G. W., Studdert-Kennedy, M., & Shankweiler, D. P. (1995). The role of fundamental frequency in signaling linguistic stress and affect: evidence for a dissociation. Perception and Psychophysics, 57, 159-174.
Google Scholar

Mozziconacci, S. (1998). Speech Variability and Emotion: Production and Perception. Eindhoven: Technische Universiteit Eindhoven.
Google Scholar

Murray, I. R., & Arnott, J. L. (1993). Towards the simulation of emotion in synthetic speech: a review of the literature on human vocal emotion. Journal of the Acoustical Society of America, 93, 1097-1108.
Google Scholar

Murray, I. R., & Arnott, J. L. (1995). Implementation and testing of a system for producing emotion-by-rule in synthetic speech. Speech Communication, 16, 369-390.
Google Scholar

Nesse R. M. (1990). Evolutionary explanations of emotions. Human Nature, 1, 261-289.
Google Scholar

Nesse, R. M., & Ellsworth, P. C. (2009). Evolution, emotions, and emotional disorders. American Psychologist, 6, 129-139.
Google Scholar

Ortony, A., & Turner, T. J. (1990). What’s basic about basic emotions? Psychological Review, 97, 315-331.
Google Scholar

Pell, M. (1999). Fundamental frequency encoding of linguistic and emotional prosody by right hemisphere-damaged speakers. Brain and Language, 69, 161-192.
Google Scholar

Plutchik, R. (1980). Emotion: a Psychoevolutionary Synthesis. New York: Harper & Row.
Google Scholar

Plutchik, R. (2001). The nature of emotions. American Scientist, 89, 344-350.
Google Scholar

Protopapas, A., & Lieberman, P. (1997). Fundamental frequency of phonation and perceived emotional stress. Journal of the Acoustical Society of America, 101, 2267-2277.
Google Scholar

Roessler, R., & Lester, J. W. (1976). Voice predicts affect during psychotherapy. Journal of Nervous and Mental Disease, 163, 166-176.
Google Scholar

Scherer, K. R. (1979). Personality markers in speech. In K. R. Scherer & H. Giles (Eds.), Social Markers in Speech (pp. 147-209). Cambridge, UK: Cambridge University Press.
Google Scholar

Scherer, K. R. (1982). Methods of research on vocal communication: paradigms and parameters. In K. R. Scherer & P. Ekman (Eds.), Handbook of Methods in Nonverbal Behavior Research (pp. 136-198). Cambridge, UK: Cambridge University Press.
Google Scholar

Scherer, K. R. (1986). Vocal affect expression: a review and a model for future research. Psychological Bulletin, 99, 143-165.
Google Scholar

Scherer, K. R. (1995). Expression of emotion in voice and music. Journal of Voice, 9, 235-248.
Google Scholar

Scherer, K. R., & Oshinsky, J. S. (1977). Cue utilization in emotion attribution from auditory stimuli. Motivation and Emotion, 4, 331-346.
Google Scholar

Scherer, K. R., Wallbott, H. G., Tolkmitt, F. J., & Bergmann, G. (1985). Die Stressreaktion: Physiologie und Verhalten. Gottingen, West Germany: Hogrefe.
Google Scholar

Siegman, A. W. (1978). The telltale voice: nonverbal messages of verbal communication. In A. W. Siegman & S. Feldstein (Eds.), Nonverbal Behavior and Communication (pp. 183-243). Hillsdale, NJ: Erlbaum.
Google Scholar

Skinner, E. R. (1935). A calibrated recording and analysis of the pitch, force and quality of vocal tones expressing happiness and sadness. Speech Monographs, 2, 81-137.
Google Scholar

Tooby, J., & Cosmides, L. (1990). The past explains the present. Emotional adaptations and the structure of ancestral environments. Ethology and Sociobiology, 11, 375-424.
Google Scholar

Utsuki, N. & Okamura, N. (1976). Relationship between emotional state and fundamental frequency of speech. Japanese Air Self Defense Force, Report of the Aeromedical Laboratory, 16, 179-188.
Google Scholar

Williams, C. E., & Stevens, K. N. (1969). On determining the emotional state of pilots during flight: an exploratory study. Aerospace Medicine, 40, 1369-1372.
Google Scholar

Williams, C. E., & Stevens, K. N. (1972). Emotions and speech: some acoustical factors. Journal of the Acoustical Society of America, 52, 1238-1250.
Google Scholar

Downloads

Published

2015-06-30

How to Cite

Stolarski, Łukasz. (2015). Pitch Patterns in Vocal Expression of ’Happiness’ and ’Sadness’ in the Reading Aloud of Prose on the Basis of Selected Audiobooks. Research in Language, 13(2), 140–161. https://doi.org/10.1515/rela-2015-0016

Issue

Section

Articles