Decoding the semantics of basic gaze patterns: Towards an unbiased extraction of meaning and its dependency on situational demands

Many non-verbal communication signals during social interaction originate in facial expressions and gaze patterns. Surprisingly, systematic research on how basic gaze patterns are interpreted is rare. Beside a planned literature review on this, we assess how gaze is understood empirically based on a recently published pilot study from our group. We utilize a novel two-step qualitative-quantitative experimental approach to decode the semantics of gaze patterns (and its contextual modulations). We investigate effects of different gaze patterns of an avatar on gaze perception by having participants watch videos of persons listening to different types of narrations (thereby varying situational demands). The listeners’ gaze is manipulated in terms of directions (direct/up/down/side) and gaze shift/blink frequencies. In a qualitative-exploratory step, participants freely describe which states/traits they attribute to the various gaze patterns to overcome any researcher-induced biases inherent in previous studies. We then construct rating scales for the follow-up quantitative-confirmatory step. Participants’ eye movements are measured to assess how these contribute to gaze understanding. We want to reveal systematic meanings ascribed to the listeners’ gaze behavior. The project then transfers this approach to real-life situations with confederates exhibiting gaze patterns (instead of videos) to analyze mutual gaze in real life situations. We also investigate what renders gaze patterns natural by recording natural eye movements in comparable situations as a model for avatar programming. Finally, we will also analyze the understanding of gaze in bargaining situations. This project represents an important step towards a systematic understanding of gaze.

Deutsche Forschungsgemeinschaft (DFG) - Project number 562993814

Prof. Dr. Anne Böckler-Raettig

Institute of Psychology, Research Methods & Social Cognition, Julius-Maximilian-Universität Würzburg

Prof. Dr. Anne Böckler-Raettig studied psychology in Berlin and Glasgow and received her doctorate from Radboud University Nijmegen in 2012. Research stays took her to Princeton University, among other places, as a visiting research collaborator. After working as a postdoctoral researcher at the Max-Planck-Institute for Human Cognitive and Brain Sciences in Leipzig from 2012 to 2015, she became a junior professor at the University of Würzburg and a professor of general psychology at Leibniz University Hannover. Since 2021, she has been Professor of Research Methods and Social Cognition at the University of Würzburg. Since 2018, she has also headed an Emmy Noether Junior Research Group on the processing of eye contact. Her research focuses on gaze processing and gaze behavior, social cognition, prosocial behavior, and cooperation. Other areas of her research include the development of social processes, clinical issues, and the psychological effects of meditation. In addition to her research, she is active in various university committees and is involved as a liaison professor for the German National Academic Foundation. She has also published books such as Social Cognition and Interaction and Theory of Mind.

Prof. Dr. Lynn Huestegge

Institute of Psychology, Psychological Methods, Cognition and Applied Research, Julius-Maximilians-Universität Würzburg

Prof. Dr. Lynn Huestegge studied psychology and philosophy in Göttingen and Aachen and received his doctorate from Bielefeld University in 2006. He habilitated in psychology on the role of eye movements in multitasking in 2011. Since 2013, he has been Professor of Research Methods at the University of Würzburg, where he combines research and teaching on cognitive processes and methodological foundations. His scientific work deals with the flexibility of cognitive control mechanisms, with research focuses including action control, multitasking, eye movements, visual attention, and visual and social cognition. A key methodological focus of his work is the use of eye tracking to analyze visual information intake and gaze control. His work ranges from basic research on gaze control and visual orientation to application-oriented areas, such as reading, automation and traffic psychology.