N°019_Vol.2_23
- THE ROLE OF THEORY OF MIND IN UNDERSTANDING
- CO-SPEECH GESTURES
- Mamadou BASSENE
- Department of English
- Cheikh Anta Diop University, Dakar
- ORCID iD: 0009-0009-2250-4844
- mamadou1.bassene@ucad.edu.sn
Introduction: Research in conversation analysis has shown a close link between speech and gestures. Speakers use various types of gestures to illustrate their utterances, and scholars such as Kendon (1980: 225) argue that gestures are “utterances” in the sense that they do not just provide a visual illustration of what a speaker says but are sometimes used as an ‘alternative’ to speech. Effective communication involves more than just the ability to process and derive meaning from words, phrases and sentences. It also requires the ability to convey information and understand the meaning of information conveyed through gestures and other nonverbal channels. This paper discusses the role of Theory of Mind, the ability to attribute mental states to others (Rosello & al., 2020: 1), in understanding conversational gestures. The objective is to address the following two questions: (1) is a Theory of Mind required to process co-speech gestures? If a Theory of Mind is indeed required to understand co-speech gestures, (2) are these gestures equally challenging for autistic patients? The study is based on an analysis of cases of co-speech gestures in recorded face-to-face conversations, a study of videotaped conversations involving autistic patients, and a survey of the existing literature on conversational gestures, autism, and on Theory of Mind. I argue that (1) gestures do convey meaning, (2) that meaning of co-speech gestures is closely related that of the speech they serve to illustrate, and that (3) the ability to derive the meaning of information imparted through gestures requires the ability to understand the intentions of the speaker (or signaler). This paper includes four sections. The first section deals with some of the most common conversational gestures. The second section revisits the debate concerning the relation between gestures and meaning. The third section discusses the impairment of autistic children in both the use and comprehension of gestures. The last section is devoted to the role a Theory of Mind plays in the comprehension of information presented via gestures.
- The data
The data used in this research come from three different sources. I examined face-to-face natural conversations, video clips on autism, and I surveyed the already existing literature on conversational gestures, autism, and on the concept of Theory of Mind. These data include both audio and video recordings totaling three hours of natural conversation on a variety of topics in Jóola Eegimaa, in Wolof, and in English. The data was collected for an ongoing study on Conversation Analysis and, specifically, on the role of intonation on turn taking in natural conversation. However, the gestures produced simultaneously with speech made me think of the semantic contents of these co-speech gestures, and if their meaning is accessible to all conversational partners. In other words, they prompted this proposed study. Since the Wolof data are yet to be transcribed and analyzed, this research only focused on the English and the Jóola Eegimaa data. I analyzed 26 video recordings of autistic patients interacting with their caregivers and their parents, and accounts from caregivers and parents of autistic patients. Some of those video recordings provide interesting accounts of (high functioning) autistic patients on their daily experiences. Again, the focus is on their communication skills and specifically on their understanding of conversational gestures. The age range and mean of the 30 autistic patients in the video recordings cannot be accurately established, as for some of them, information on their ages has not been provided. However, the youngest are preschoolers, whereas the oldest are in their late teens and early 20s. The link to the recordings is provided in the reference list.
Abstract: Conversational participants choose their words and co-speech gestures with their listeners in mind. In the exchange, they take into account the knowledge, feelings, intentions, and other mental states of their conversational partners and adjust their contributions accordingly. This research is intended to contribute to the already rich body of work on both Theory of Mind and conversational gestures (also known as co-speech gestures). The main objective has been to look at the pertinence of the concept of Theory of Mind in processing conversational gestures. The analysis of recorded conversations among Jóola Eegimaa native speakers, American English participants, and video clips of interactions involving autistic people, accounts from caregivers and parents of autistic children, and accounts from autistic patients on their linguistic behaviors shows that an accurate interpretation of co-speech gestures requires a working Theory of Mind.
Keywords: Theory of Mind, mental state, co-speech gesture, autism, impairment
References
- Abbot-Smith, K. (2020). Language Disorders and Autism: implications for usage-based theories of language development. Current perspectives on child language acquisition: how children use their environment to learn. Trends in Language Acquisition Research 7, ed by Rowland, C. F. & al., 287-321. Amsterdam: John Benjamins.
- Abzaliev, A. & al. (2022). Towards Understanding the Relation between Gestures and Language. Proceedings of the 29th International Conference on Computational Linguistics, 5507-5520.
- Baron-Cohen, S. & al. (1985). Does the autistic child have a “theory of mind”? Cognition 21, 37-46.
- Baron-Cohen, S. (1999). The evolution of a theory of mind. The descent of mind: Psychological perspectives on hominid evolution, ed. by M. C. Corballis and Lea, S. E. G., 261-277. Oxford: Oxford University Press.
- Butterworth, B. and Beattie, G. (1978). Gesture and silence as indicators of planning in speech. Recent Advances in the psychology of language: Formal and experimental approaches, ed. by Campbell, R. N. & Smith, P. T., 347-360. New York: Plenum.
- Byom, L. J. & Mutlu, B. (2013). Theory of mind: mechanisms, methods, and new directions. Frontiers in Human Neuroscience 7, 1-12.
- Camaioni, L. et al. (2004). The role of declarative pointing in developing a theory of mind. Infancy 5:3, 291-308.
- Cassell, J. (1998). A Framework for gesture generation and interpretation. Computer vision in human-machine interaction, ed. by Cipolla, R. & Pentland, A., 191-215. New York: Cambridge University Press.
- Cummings, L. (2013). Pragmatic disorders and theory of mind. The Cambridge Handbook of Communication Disorders, ed. by Cummings, L., 559-577. Cambridge: Cambridge University Press.
- Dittmann, A. T. & Llewellyn, L. G. (1969). Body movement and speech rhythm in social conversation. Journal of personality and social psychology 23, 283-392.
- Georgiou, N. & Spanoudis, G. (2021). Developmental Language Disorder and Autism: Commonalities and Differences on Language. Brian Sciences 11:5, 1-29.
- …
