Pitch Patterns in Vocal Expression of 'Happiness' and 'Sadness' in the Reading Aloud of Prose on the Basis of Selected Audiobooks
DOI:
https://doi.org/10.1515/rela-2015-0016Keywords:
Pitch patterns, emotional speech, natural speechAbstract
The primary focus of this paper is to examine the way the emotional categories of “happiness” and “sadness” are expressed vocally in the reading aloud of prose. In particular, the two semantic categories were analysed in terms of the pitch level and the pitch variability on a corpus based on 28 works written by Charles Dickens. passages with the intended emotional colouring were selected and the fragments found in the corresponding audiobooks. They were then analysed acoustically in terms of the mean F0 and the standard deviation of F0. The results for individual emotional passages were compared with a particular reader’s mean pitch and standard deviation of pitch. The differences obtained in this way supported the initial assumptions that the pitch level and its standard deviation would raise in “happy” extracts but lower in “sad” ones. Nevertheless, not all of these tendencies could be statistically validated and additional examples taken from a selection of random novels by other nineteenth century writers were added. The statistical analysis of the larger samples confirmed the assumed tendencies but also indicated that the two semantic domains may utilise the acoustic parameters under discussion to varying degrees. While “happiness” tends to be signalled primarily by raising F0, “sadness” is communicated mostly by lowering the variability of F0. Changes in the variability of F0 seem to be of less importance in the former case, and shifts in the F0 level less significant in the latter.
References
Alter, K., Rank, E., Kotz, S. A., Pfeifer, E., Besson, M., Friederici, A. D., & Matiasek, J. (1999). On the relations of semantic and acoustic properties of emotions. In Proceedings of the XIVth International Congress of Phonetic Sciences, San Francisco: 2121-2124.
Google Scholar
Anthony, L. (2014). AntConc (version 3.4.3w) [Computer Software]. Tokyo: Waseda University. Retrieved from http://www.antlab.sci.waseda.ac.jp/.
Google Scholar
Averill, J. R. (2009). Constructivism (psychological perspectives). In D. Sander & K. R. Scherer (Eds.), Oxford Companion to Emotion and the Affective Sciences (pp 98-99). New York, NY: Oxford University Press.
Google Scholar
Banse, R., & Scherer, K. R. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70, 614-636.
Google Scholar
Barrett, L. F. (2006). Are emotions natural kinds? Perspectives on Psychological Science, 1, 28-58.
Google Scholar
Bergmann, G., Goldbeck T., & Scherer, K. R. (1988). Emotionale Eindruckswirkung von prosodischen Sprechmerkmalen. Zeitschrift für Experimentelle und Angewandte Psychologie, 35, 167-200.
Google Scholar
Bezooijen, R. V. (1984). The Characteristics and Recognizability of Vocal Expression of Emotion. Dordrecht, Holland: Foris Publications.
Google Scholar
Boersma, P., & Weenink, D. (2014). Praat: Doing Phonetics by Computer (version 5.4.01) [Computer software]. Retrieved from http://www.praat.org/.
Google Scholar
Boves, L. (1984). The Phonetic Basis of Perceptual Ratings of Running Speech. Dordrecht, Holland: Foris Publications.
Google Scholar
Breitenstein C., van Lancker, D., & Daum, I. (2001). The contribution of speech rate and pitch variation to the perception of vocal emotions in a German and an American sample. Cognition and Emotion, 15(1), 57-79.
Google Scholar
Cahn, J. (1990a). The generation of affect in synthesized speech. Journal of the American Voice I/O Society, 8, 1-19.
Google Scholar
Cahn, J. (1990b). Generating expression in synthesized speech. Technical report. Boston: MIT Media Laboratory Technical Report.
Google Scholar
Carlson, R. B., Granström, B., & Nord, L. (1992). Experiments with emotive speech: acted utterances and synthesized replicas. Proceedengs ICSLP 92, Banff, Alberta, Canada 1, 671-674.
Google Scholar
Coleman, R. K., & Williams, R. (1979). Identification of emotional states using perceptual and acoustic analyses. In V. Lawrence & B. Weinberg (Eds.), Transcript of the Eighth Symposium: Care of the Professional Voice (Part I). New York:The Voice Foundation.
Google Scholar
Cosmides, L. (1983). Invariances in the acoustic expression of emotion during speech. Journal of Experimental Psychology: Human Perception and Performance, 9, 864-881.
Google Scholar
Cummings, K. E., & Clements, M. A. (1995). Analysis of the glottal excitation of emotionally styled and stressed speech. Journal of the Acoustical Society of America, 98, 88-98.
Google Scholar
Darwin, C. (1872). The Expression of Emotions in Man and Animals. London: John Murray.
Google Scholar
Davitz, J. R. (1964). The Communication of Emotional Meaning. New York: McGraw-Hill.
Google Scholar
Ekman, P. (1982). Emotion in the Human Face. Cambridge, New York: Cambridge University Press.
Google Scholar
Ekman, P. (1999). Basic emotions. In T. Dalgleish & M. Power (Eds.), Handbook of Cognition and Emotion (pp. 45-60). Sussex, UK: John Wiley & Sons.
Google Scholar
Eldred, S. H., & Price, D. B. (1958). A linguistic evaluation of feeling states in psychotherapy. Psychiatry, 21, 115-121.
Google Scholar
Fairbanks, G., & Hoaglin, L. W. (1941). An experimental study of the pitch characteristics of the voice during the expression of emotion. Speech Monographs, 6, 85-90.
Google Scholar
Fairbanks, G., & Provost, W. (1939). An experimental study of the pitch characteristics of the voice during the expression of emotion. Speech Monographs, 6, 87-104.
Google Scholar
Frijda, N. H. (1986). The Emotions. Cambridge: Cambridge University Press.
Google Scholar
Fonagy, I. (1978). A new method of investigating the perception of prosodic features. Language and Speech, 21, 34-49.
Google Scholar
Gobl, C., & Ní Chasaide, A. (2003). The role of voice quality in communicating emotion, mood and attitude. Speech Communication, 40, 189-212.
Google Scholar
Hargreaves, W. A., Starkweather J. A., & Blacker, K. H. (1965). Voice quality in depression. Journal of Abnormal Psychology, 70, 218-220.
Google Scholar
Havrdova, Z., & Moravek, M. (1979). Changes of the voice expression during suggestively influenced states of experiencing. Activitas Nervosa Superior, 21, 33-35.
Google Scholar
Huttar, G. L. (1968). Relations between prosodic variables and emotions in normal American English utterances. Journal of Speech and Hearing Research, 11, 481-487.
Google Scholar
House, D. (1990). Tonal Perception in Speech. Lund: Lund University Press.
Google Scholar
Izard, C. E. (1977). Human Emotions. New York: Plenum Press.
Google Scholar
Johnstone, T., & Scherer, K R. (1999). The effects of emotions on voice quality. In Proceedings of the XIVth International Congress of Phonetic Sciences (pp. 2029-2032). San Francisco.
Google Scholar
Kaiser, L. (1962). Communication of affects by single vowels. Synthese, 14, 300-319.
Google Scholar
Kotlyar, G. M., & Morozov, V. P. (1976). Acoustical correlates of the emotional content of vocalized speech. Journal of Acoustics of the Academy of Sciences of the USSR, 22, 208-211.
Google Scholar
Kuroda, I., Fujiwara, O., Okamura N., & Utsuki, N. (1976). Method for determining pilot stress through analysis of voice communication. Aviation, Space, and Environmental Medicine, 47, 528-533.
Google Scholar
Ladd, D. R., Silverman, K., Tolkmitt, F., Bergmann, G., & Scherer, K. R. (1985). Evidence for the independent function of intonation contour type, voice quality, and F0 range in signalling speaker affect. Journal of the Acoustical Society of America, 78, 435-444.
Google Scholar
Laukkanen, A. M., Vilkman, E., Alku, P., & Oksanen, H. (1996). Physical variation related to stress and emotionally state: a preliminary study. Journal of Phonetics, 24, 313-335.
Google Scholar
Lieberman, P., & Michaels, S. B. (1962). Some aspects of fundamental frequency and envelope amplitude as related to the emotional content of speech. Journal of the Acoustical Society of America, 34, 922-927.
Google Scholar
Markel, N. N., Bern M. F., & Phillis, J. A. (1973). The relationship between words and tone-of-voice. Language and Speech, 16, 15-21.
Google Scholar
Mason, W. A. (2012). Basic emotions: a reconstruction. Emotion Review, 4, 238-244.
Google Scholar
Minitab 16 Statistical Software. (2010). [Computer software]. State College, PA: Minitab, Inc. Available from http://www.minitab.com/.
Google Scholar
McRoberts, G. W., Studdert-Kennedy, M., & Shankweiler, D. P. (1995). The role of fundamental frequency in signaling linguistic stress and affect: evidence for a dissociation. Perception and Psychophysics, 57, 159-174.
Google Scholar
Mozziconacci, S. (1998). Speech Variability and Emotion: Production and Perception. Eindhoven: Technische Universiteit Eindhoven.
Google Scholar
Murray, I. R., & Arnott, J. L. (1993). Towards the simulation of emotion in synthetic speech: a review of the literature on human vocal emotion. Journal of the Acoustical Society of America, 93, 1097-1108.
Google Scholar
Murray, I. R., & Arnott, J. L. (1995). Implementation and testing of a system for producing emotion-by-rule in synthetic speech. Speech Communication, 16, 369-390.
Google Scholar
Nesse R. M. (1990). Evolutionary explanations of emotions. Human Nature, 1, 261-289.
Google Scholar
Nesse, R. M., & Ellsworth, P. C. (2009). Evolution, emotions, and emotional disorders. American Psychologist, 6, 129-139.
Google Scholar
Ortony, A., & Turner, T. J. (1990). What’s basic about basic emotions? Psychological Review, 97, 315-331.
Google Scholar
Pell, M. (1999). Fundamental frequency encoding of linguistic and emotional prosody by right hemisphere-damaged speakers. Brain and Language, 69, 161-192.
Google Scholar
Plutchik, R. (1980). Emotion: a Psychoevolutionary Synthesis. New York: Harper & Row.
Google Scholar
Plutchik, R. (2001). The nature of emotions. American Scientist, 89, 344-350.
Google Scholar
Protopapas, A., & Lieberman, P. (1997). Fundamental frequency of phonation and perceived emotional stress. Journal of the Acoustical Society of America, 101, 2267-2277.
Google Scholar
Roessler, R., & Lester, J. W. (1976). Voice predicts affect during psychotherapy. Journal of Nervous and Mental Disease, 163, 166-176.
Google Scholar
Scherer, K. R. (1979). Personality markers in speech. In K. R. Scherer & H. Giles (Eds.), Social Markers in Speech (pp. 147-209). Cambridge, UK: Cambridge University Press.
Google Scholar
Scherer, K. R. (1982). Methods of research on vocal communication: paradigms and parameters. In K. R. Scherer & P. Ekman (Eds.), Handbook of Methods in Nonverbal Behavior Research (pp. 136-198). Cambridge, UK: Cambridge University Press.
Google Scholar
Scherer, K. R. (1986). Vocal affect expression: a review and a model for future research. Psychological Bulletin, 99, 143-165.
Google Scholar
Scherer, K. R. (1995). Expression of emotion in voice and music. Journal of Voice, 9, 235-248.
Google Scholar
Scherer, K. R., & Oshinsky, J. S. (1977). Cue utilization in emotion attribution from auditory stimuli. Motivation and Emotion, 4, 331-346.
Google Scholar
Scherer, K. R., Wallbott, H. G., Tolkmitt, F. J., & Bergmann, G. (1985). Die Stressreaktion: Physiologie und Verhalten. Gottingen, West Germany: Hogrefe.
Google Scholar
Siegman, A. W. (1978). The telltale voice: nonverbal messages of verbal communication. In A. W. Siegman & S. Feldstein (Eds.), Nonverbal Behavior and Communication (pp. 183-243). Hillsdale, NJ: Erlbaum.
Google Scholar
Skinner, E. R. (1935). A calibrated recording and analysis of the pitch, force and quality of vocal tones expressing happiness and sadness. Speech Monographs, 2, 81-137.
Google Scholar
Tooby, J., & Cosmides, L. (1990). The past explains the present. Emotional adaptations and the structure of ancestral environments. Ethology and Sociobiology, 11, 375-424.
Google Scholar
Utsuki, N. & Okamura, N. (1976). Relationship between emotional state and fundamental frequency of speech. Japanese Air Self Defense Force, Report of the Aeromedical Laboratory, 16, 179-188.
Google Scholar
Williams, C. E., & Stevens, K. N. (1969). On determining the emotional state of pilots during flight: an exploratory study. Aerospace Medicine, 40, 1369-1372.
Google Scholar
Williams, C. E., & Stevens, K. N. (1972). Emotions and speech: some acoustical factors. Journal of the Acoustical Society of America, 52, 1238-1250.
Google Scholar