Exploring Communicative Gestures in Czech Persons with Diagnosed Aphasia

Martin Janečka

doi:10.18778/1731-7533.19.1.02

Authors

Martin Janečka Charles University of Prague, Czech Republic

DOI:

https://doi.org/10.18778/1731-7533.19.1.02

Keywords:

Aphasia, gestures, speech, nonverbal communication, multimodality

Abstract

In my investigation, I worked with 6 persons with diagnosed aphasia. I introduce some possible perspectives on the exploration of the extent of speech damage in persons with aphasia and the various ways in which they substitute for language deficiency with the aid of gestures.

From the viewpoint of data processing methods, on the one hand, I explore the parameters of spoken language, such as the quantity of words, and, on the other hand, the parameters of gestures, such as the quantity of gestures, diversity of gestures, etc. In aphasic persons speaking Czech, I verify the following assumption established by Jakob et al. (2011): the more speech-limited an aphasic person is, the more gestures he/she produces during the interpretation of a story.

It was found that the number of words produced by aphasic persons varies, partially dependent on the specific type of aphasia. This is particularly true on both ends of the scale – people with large speech distortion use the highest quantity of gestures, people with low speech distortion use gestures to a lesser extent. Within the classification of semantic gestures, I focus particularly on iconic and deictic gestures. In addition, I presume that symbolic gestures (i.e. emblems) do not occur in aphasic persons’ speech, because aphasic persons prefer gestures that display the plot in the most concrete way.

My data correlate with other studies dealing with this topic – aphasic persons do use gestures intentionally to substitute for their verbal deficiency. At the same time, they mostly use very concrete (iconic) gestures, which enable them to transmit a large volume of information.

References

Abner, Natasha, Cooperrider, Kensy, and Goldin-Meadow, Susan. 2015. Gesture for Linguists: A Handy Primer. Language and Linguistics Compass, 9(11), 437–451. https://doi.org/10.1111/lnc3.12168
Google Scholar DOI: https://doi.org/10.1111/lnc3.12168

Alwood, Jens. 2009. Multimodal Corpora. In Lüdeling, A. and M. Kytö (eds), Corpus Linguistics. An International Handbook, 207–225. Berlin: Mouton de Gruyter.
Google Scholar

Bartmann, D., Jakob, H., Ziegler, W. and G. Goldenberg. 2011. Zussamenhang von Spontansprachproduktion und Gesten bei Patienten mit Aphasie. Aphasie und verwandte Gebiete, 30(3), 5–19.
Google Scholar

de Beer, C., Carragher, M., van Nispen, K., Hogrefe, K., de Ruiter, J. P. and M. L. Rose. 2017. How Much Information Do People With Aphasia Convey via Gesture? American journal of speech-language pathology, 26 (2), 483–497. https://doi.org/10.1044/2016_AJSLP-15-0027
Google Scholar DOI: https://doi.org/10.1044/2016_AJSLP-15-0027

Birdwhistell, Ray L. 1970. Kinesics and Context. Essays on Body Motion Communication. Philadelphia: University of Pennsylvania Press. https://doi.org/10.9783/9780812201284
Google Scholar DOI: https://doi.org/10.9783/9780812201284

Corbett, Faye, Jefferies, Elizabeth, Ehsan, Sheeba and Ralph, Mathew. A. Lambon. 2009. Different impairments of semantic cognition in semantic dementia and semantic aphasia: evidence from the non-verbal domain. Brain, 132,2593–2608. https://doi.org/10.1093/brain/awp146
Google Scholar DOI: https://doi.org/10.1093/brain/awp146

Crystal, David. 2010. The Cambridge encyclopedia of language. Cambridge: Cambridge University Press.
Google Scholar

Hogrefe, Katharina, Ziegler, Wolfram, Wiesmayer, Susanne, Weidinger, Nicole. and Goldenberg, Georg. 2013. The actual and potential use of gestures for communication in aphasia. Aphasiology, 27(9), 1070–1089. https://doi.org/10.1080/02687038.2013.803515
Google Scholar DOI: https://doi.org/10.1080/02687038.2013.803515

Hogrefe, Katharina. 2009. Aphasie, Apraxie und Gestik: Zur Produktion von Handgesten bei Patienten mit linkhemisphärischer Hirnschädigung. Dissertation, Universität Potsdam.
Google Scholar

Jakob, Hanna, Bartmann, Daniela, Goldenberg, Georg, Ziegler, Wolfram and Hogrefe, Katharina. 2011. Zussamenhang von Spontansprachproduktion und Gesten bei Patienten mit Aphasie. Aphasie und verwandte Gebiete, 30(3), 20–38.
Google Scholar

Janečka, Martin. In print. Gestikulace v komunikaci osob s diagnostikovanou afázií. Praha: Karolinum.
Google Scholar

Janečka, Martin. 2021. The relationship between speech and gestures in persons with aphasia: Evidence from the Czech perspective. Topics in Linguistics, 22(1), 1–14. https://doi.org/10.2478/topling-2021-0001
Google Scholar DOI: https://doi.org/10.2478/topling-2021-0001

Jefferies, Elizabeth., Patterson, Karalyn and Ralph, Mathew A. Lambon. 2008. Deficits of knowledge vs. executive control in semantic cognition: insights from cued naming. Neuropsychologia, 46(2), 649-658. https://doi.org/10.1016/j.neuropsychologia.2007.09.007
Google Scholar DOI: https://doi.org/10.1016/j.neuropsychologia.2007.09.007

Jefferies, Elizabeth. and Ralph, Mathew A. Lambon. 2006. Semantic impairment in stroke aphasia versus semantic dementia: a case-series comparison. Brain, 129, 2132–2147. https://doi.org/10.1093/brain/awl153
Google Scholar DOI: https://doi.org/10.1093/brain/awl153

Jewitt, Carey. (ed) 2009, 2016. The Routledge Handbook of Multimodal Analysis. London – New York: Routledge.
Google Scholar

Jokinen, Kristiina, Navarretta, Costanza and Paggio, Patrizia. 2008. Distinguishing the Communicative Functions of Gestures: An Experiment with Annotated Gesture Data. In R. Stiefelhagen and A. Popescu-Belis (eds), MLMI 2008: Machine Learning for Multimodal Interaction, 38–49. https://doi.org/10.1007/978-3-540-85853-9_4
Google Scholar DOI: https://doi.org/10.1007/978-3-540-85853-9_4

Kertesz, Andrew. 1979. Aphasia and associated disorder: Taxonomy, localization and recovery. New York: Grune & Stratton, Inc.
Google Scholar

Kipp, Michael, Martin, Jean-Claude., Paggio, Patrizia and Heylen, Dirk. 2009. Multimodal Corpora: From Models of Natural Interaction to Systems and Applications. Berlin – Heidelberg: Springer Verlag. https://doi.org/10.1007/978-3-642-04793-0
Google Scholar DOI: https://doi.org/10.1007/978-3-642-04793-0

Kong, Anthony Pak-Hin, Law, Sam-Po, Wat, Watson Ka-Chun and Lai, Christy. 2015. Co-verbal gestures among speakers with aphasia: Influence of aphasia severity, linguistic and semantic skills, and hemiplegia on gesture employment in oral discourse. Journal of Communication Disorders, 56, 88–102. https://doi.org/10.1016/j.jcomdis.2015.06.007
Google Scholar DOI: https://doi.org/10.1016/j.jcomdis.2015.06.007

Kress, Gunther. 2010. Multimodality: a social semiotic approach to contemporary communication. London: Routledge. https://doi.org/10.4324/9780203970034
Google Scholar DOI: https://doi.org/10.4324/9780203970034

McNeill, David. 1992. Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.
Google Scholar

Miller, Chreston and Quek, Francis. 2011. Toward Multimodal Situated Analysis. In J. Oncina (ed), Proceedings of the 13th international conference on multimodal interfaces, 239–246. New York: Association for Computing Machinery. https://doi.org/10.1145/2070481.2070526
Google Scholar DOI: https://doi.org/10.1145/2070481.2070526

Mittelberg, Irene. 2018. Gestures as image schemas and force gestalts: A dynamic systems approach augmented with motion-capture data analyses. Cognitive semiotics, 11(1), 1–21. https://doi.org/10.1515/cogsem-2018-0002
Google Scholar DOI: https://doi.org/10.1515/cogsem-2018-0002

Persson, Inga Britt. 1995. Connectionism, Language Production and Adult Aphasia. Helsinki: The Finnish Society of Sciences and Letters. https://doi.org/10.1017/S0332586500004030
Google Scholar DOI: https://doi.org/10.1017/S0332586500004030

Pike, Kenneth Lee. 1967. Language in Relation to a Unified Theory of the Structure of Human Behaviour. The Hague: Mouton. https://doi.org/10.1515/9783111657158
Google Scholar DOI: https://doi.org/10.1515/9783111657158

Preisig, Basil C. 2018. Multimodal Communication in Aphasia: Perception and Production of Co-speech Gestures During Face-to-Face Conversation. Frontiers in Human Neuroscience, 12, article 200. https://doi.org/10.3389/fnhum.2018.00200
Google Scholar DOI: https://doi.org/10.3389/fnhum.2018.00200

de Ruiter, Jan P., Bangerter, Adrian and Dings, Paula. 2012. The Interplay Between Gesture and Speech in the Production of Referring Expressions: Investigating the Trade-off Hypothesis. Topics in Cognitive Science, 4(2), 232–248. https://doi.org/10.1111/j.1756-8765.2012.01183.x
Google Scholar DOI: https://doi.org/10.1111/j.1756-8765.2012.01183.x

de Ruiter, Jan P. 2006. Can gesticulation help aphasic people speak, or rather, communicate? Advances in Speech-Language Pathology, 8(2), 124–127. https://doi.org/10.1080/14417040600667285
Google Scholar DOI: https://doi.org/10.1080/14417040600667285

So, Wing Chee, Kita, Sotaro and Goldin-Meadow, Susan. 2009. Using the Hands to Identify Who Does What to Whom: Gesture and Speech Go Hand-in-Hand. Cognitive Science, 33(1), 115–125. https://doi.org/10.1111/j.1551-6709.2008.01006.x
Google Scholar DOI: https://doi.org/10.1111/j.1551-6709.2008.01006.x

Teasell, Robert. 2016. Aphasia and Apraxia. London, Ontario: Parkwood Institute.
Google Scholar

Wiesmayer, Susanne, Hogrefe, Katharina, Ziegler, Woflram and Goldenberg, Georg. 2011. Sag es mit den Händen! Welches Potenzial bergen Gesten für die Kommunikationsfähigkeit aphasischer Sprecher? Aphasie und verwandte Gebiete, 30(3), 39–57.
Google Scholar