Refine
Has Fulltext
- yes (15)
Is part of the Bibliography
- yes (15)
Year of publication
Document Type
- Doctoral Thesis (15)
Keywords
- Aufmerksamkeit (3)
- Fahrerverhalten (3)
- Kognition (3)
- Verkehrspsychologie (3)
- Automation (2)
- Automatisiertes Fahren (2)
- Autonomes Fahrzeug (2)
- Blickbewegung (2)
- Experimentelle Psychologie (2)
- Ideomotorik (2)
- Kognitive Psychologie (2)
- Mehrfachtätigkeit (2)
- Mensch-Maschine-Interaktion (2)
- Mensch-Maschine-Kommunikation (2)
- Multisensory integration (2)
- Multitasking (2)
- Reaktionszeit (2)
- Sense of agency (2)
- ADAS (1)
- Active self (1)
- Blick (1)
- Blickinteraktion (1)
- Causality (1)
- Cognitive control (1)
- Doppelaufgabe (1)
- Dual task (1)
- Dysarthrie (1)
- Effect anticipation (1)
- Effektantizipation (1)
- Effektorsysteme (1)
- Einfühlung (1)
- Fahrerablenkung (1)
- Fahrerassistenzsystem (1)
- Fahrsimulator (1)
- Fear (1)
- Feelings of agency (1)
- Furcht (1)
- Gaze interaction (1)
- Geschwindigkeitswahrnehmung (1)
- Handlungserleben (1)
- Handlungsregulation (1)
- Handlungssteuerung (1)
- Haptische Feedback-Technologie (1)
- Ideomotor (1)
- Ideomotor gaze control (1)
- Ideomotorische Blickkontrolle (1)
- Immersion <Virtuelle Realität> (1)
- Instructional Support (1)
- Interaktion (1)
- Judgements of agency (1)
- Kognitionspsychologie (1)
- Lautes Denken (1)
- Lenkeingriffe (1)
- Manual responses (1)
- Mechanisms of Social Attention (1)
- Mensch-Maschine-Schnittstelle (1)
- Metacognitive Prompting (1)
- Metakognition (1)
- Notausweichassistenz (1)
- Parkinson (1)
- Parkinson-Krankheit (1)
- Process Mining (1)
- Prozessanalyse (1)
- Präsenzerleben (1)
- Psychologie (1)
- Saccades (1)
- Selbstgesteuertes Lernen (1)
- Self-Regulated Learning (1)
- Sense of ownership (1)
- Social action effects (1)
- Sociomotor gaze control (1)
- Soziale Handlungseffekte (1)
- Soziale Wahrnehmung (1)
- Soziomotorische Blickkontrolle (1)
- Tactile gating (1)
- Tactile suppression (1)
- Task interference (1)
- Tastwahrnehmung (1)
- Technology-Enhanced Learning (1)
- Telepräsenz (1)
- Temporal binding (1)
- Theory of Mind (1)
- Validität (1)
- Verhalten (1)
- Verhaltenskontrolle (1)
- Verhaltensmodell (1)
- Virtuelle Realität (1)
- Vocal responses (1)
- Wirksamkeit (1)
- automated driving (1)
- cognitive control (1)
- cross-modal action (1)
- driver behavior (1)
- driver behavior model (1)
- driver distraction (1)
- driving simulator (1)
- ecological validity (1)
- emergency steering and evasion assistant (1)
- eye contact (1)
- eye tracking (1)
- human-automation interaction (1)
- motorcycle simulator (1)
- presence (1)
- response modalities (1)
- social attention (1)
- social understanding (1)
- speed perception (1)
- task prioritization (1)
- virtual reality (1)
Institute
Sonstige beteiligte Institutionen
Cross-Modal Action Control
(2016)
Nowadays, multitasking is ubiquitously discussed within many different scientific disciplines. The present work addressed multitasking from the perspective of cognitive behavioural sciences by investigating the role of conflict resolution processes that arise during the requirements of multiple-action control. More specifically, the present work focuses on cognitive mechanisms in the case of cross-modal action control, which involves the performance of two actions in different effector systems. One aim was to broaden the scope of action modalities typically considered in the literature by studying oculomotor responses (i.e. saccades) – an action modality that has been largely neglected in previous research – in combination with responses in other effector systems (i.e. manual and vocal responses). A further aim was to specify the mechanisms of crosstalk as an explanatory concept referring to the action content, which is particularly relevant since cross-modal actions usually differ regarding their response characteristics. The present work comprises four studies (each involving two or three experiments).
In Study A, cross-modal response compounds based on a single stimulus were studied with respect to the interplay of the presence of response alternatives and between-response compatibility (i.e. crosstalk potential). In three experiments, this study showed that crosstalk can be dissociated into a component that determines the amount of current conflict (i.e. online crosstalk) and a memory-based component that originates either from residual activation of previous action demands (retrospective crosstalk) or from preparation for future demands (prospective crosstalk).
Study B provided first evidence that oculomotor responses are subject to interference based on both structural and content-based origins. In three experiments, an overlapping tasks paradigm was employed in which the onsets between two stimuli that triggered oculomotor and manual responses were varied. Evidence for both serial and parallel processing of the two tasks was found. The results further indicated that based on the between-task compatibility participants shifted between these processing modes, i.e. to more parallel processing during compatible task demands and to more serial processing during incompatible task demands.
Study C examined processing priorities among effector systems and demonstrated in two experiments that the previously reported prioritisation scheme, in which the oculomotor system is prioritised over the vocal and manual effector system, can be replicated, but is also adjusted in its strength by the presence of response conflict. Specifically, processing priorities were shifted towards the response that already is involved in conflict resolution (in terms of stimulus-response compatibility), suggesting that processing priorities can be flexibly adapted to particular task demands.
Study D addressed response order control in dual tasks, an issue that has been widely neglected in previous research. In a comprehensive study of three experiments including several factors that are known to be relevant for dual-task interference mechanisms, it was shown that the final response order in a given trial is the result of a continuous adjustment process based on the interplay of several top-down factors, such as the anticipation of response characteristics, and bottom-up factors, such as stimulus order and between-task compatibility.
In summary, the present work advances the theoretical understanding of complex action control by providing a cross-modal action perspective, by proposing mechanisms for effector-system prioritisation and response order control, and by proposing a novel taxonomy of crosstalk as an overarching framework for interference mechanisms in multiple-response control.
Driving simulators are powerful research tools. Countless simulator studies have contributed to traffic safety over the last decades. Constant improvements in simulator technology call for a measureable scale to assess driving simulators with regard to their utility in human factors research. A promising psychological construct to do so is presence. It is commonly defined as the feeling of being located in a remote or virtual environment that seems to be real. Another aspect of presence describes the ability to act there successfully.
The main aim of this thesis is to develop a presence model dedicated to the application in driving simulators. Established models have been combined and extended in order to gain a comprehensive model of presence that allows understanding its emergence and deriving recommendations on how to design or improve driving simulators. The five studies presented in this thesis investigate specific postulated model components and their interactions. All studies deal with motorcycling or a motorcycle riding simulator as exemplary field of application.
The first study used a speed estimation task to investigate the contribution of different sensory cues to presence. While visualization plays a particularly important role, further improvements could be achieved by adding more consistent sensory stimuli to the virtual environment. Auditory, proprioceptive and vestibular cues have been subject to investigation. In the second study, the speed production method was applied. It confirmed the positive contribution of action to presence as predicted by psychocybernetic models. The third study dealt with the effect of training on presence. Hence, no positive effect was observed. The fourth study aimed at replicating previous findings on sensory fidelity and diversity in a more complex riding situation than only longitudinal vehicle control. The riders had to cross an unexpectedly appearing deep pit with the virtual motorcycle. The contribution of more consistent sensory stimulation on presence was successfully shown in this scenario, too. The final study was a real riding experiment that delivered reference values for the speed estimation capabilities of motorcycle riders. Besides higher variations in the simulator data, the general speed estimation performance was on a comparable level. Different measures, such as subjective ratings, behavioral responses, performance, and physiological reactions, have been applied as presence indicators.
These studies’ findings deliver evidence for the meaningful application of the proposed presence model in driving simulator settings. The results suggest that presence can be interpreted as a quality measure for perception in virtual environments. In line with psychocybernetic models, taking action, which is seen as controlling perception, enhances this quality even further. Describing the psychological construct of presence in a theoretical framework that takes the diversity of perception and action in driving simulator settings into account closes a gap in traffic psychological research.
The rise of automated driving will fundamentally change our mobility in the near future. This thesis specifically considers the stage of so called highly automated driving (Level 3, SAE International, 2014). At this level, a system carries out vehicle guidance in specific application areas, e.g. on highway roads. The driver can temporarily suspend from monitoring the driving task and might use the time by engaging in so called non-driving related tasks (NDR-tasks). However, the driver is still in charge to resume vehicle control when prompted by the system. This new role of the driver has to be critically examined from a human factors perspective.
The main aim of this thesis was to systematically investigate the impact of different NDR-tasks on driver behavior and take-over performance. Wickens’ (2008) architecture of multiple resource theory was chosen as theoretical framework, with the building blocks of multiplicity (task interference due to resource overlap), mental workload (task demands), and aspects of executive control or self-regulation. Specific adaptations and extensions of the theory were discussed to account for the context of NDR-task interactions in highly automated driving.
Overall four driving simulator studies were carried out to investigate the role of these theoretical components. Study 1 showed that drivers focused NDR-task engagement on sections of highly automated compared to manual driving. In addition, drivers avoided task engagement prior to predictable take-over situations. These results indicate that self-regulatory behavior, as reported for manual driving, also takes place in the context of highly automated driving. Study 2 specifically addressed the impact of NDR-tasks’ stimulus and response modalities on take-over performance. Results showed that particularly visual-manual tasks with high motoric load (including the need to get rid of a handheld object) had detrimental effects. However, drivers seemed to be aware of task specific distraction in take-over situations and strictly canceled visual-manual tasks compared to a low impairing auditory-vocal task. Study 3 revealed that also the mental demand of NDR-tasks should be considered for drivers’ take-over performance. Finally, different human-machine-interfaces were developed and evaluated in Simulator Study 4. Concepts including an explicit pre-alert (“notification”) clearly supported drivers’ self-regulation and achieved high usability and acceptance ratings.
Overall, this thesis indicates that the architecture of multiple resource theory provides a useful framework for research in this field. Practical implications arise regarding the potential legal regulation of NDR-tasks as well as the design of elaborated human-machine-interfaces.
Fahrzeughersteller haben die Verfügbarkeit sogenannter hochautomatisierter Fahrfunktionen (SAE Level 3; SAE, 2018) in ihren Modellen angekündigt. Hierdurch wird der Fahrer in der Lage sein, sich permanent von der Fahraufgabe abzuwenden und fahrfremden Tätigkeiten nachzugehen. Allerdings muss er immer noch als Rückfallebene zur Verfügung stehen, um im Fall von Systemgrenzen oder -fehlern (siehe Gold, Naujoks, Radlmayr, Bellem & Jarosch, 2017), die Fahrzeugkontrolle zu übernehmen. Das Übernahmeerfordernis wird dem Fahrer durch die Ausgabe einer Übernameaufforderung vermittelt. Die Übernahme der manuellen Fahrzeugführung aus dem hochautomatisierten Fahren stellt aus psychologischer Sicht einen Aufgabenwechsel dar. Bei der Untersuchung von Aufgabenwechseln im Bereich der kognitiven und angewandten Psychologie zeigte sich vielfach, dass Aufgabenwechsel mit verlängerten Reaktionszeiten und erhöhten Fehlerraten assoziiert sind. Für den Anwendungsfall des automatisierten Fahrens liegen ebenfalls eine Reihe empirischer Studien vor, die darauf hinweisen, dass der Wechsel zum manuellen Fahren mit einer Verschlechterung der Fahrleistung gegenüber dem manuellen Fahren verbunden ist. Da Erkenntnisse vorliegen, dass eine Vorbereitung auf den Aufgabenwechsel die zu erwartenden Kosten verringern kann, ist das Ziel dieser Arbeit die Konzeption und empirische Evaluation einer Mensch-Maschine-Schnittstelle, die Nutzer hochautomatisierter Fahrzeuge durch frühzeitige Vorinformationen über Systemgrenzen auf die Kontrollübernahme vorbereitet.
Drei Experimente im Fahrsimulator mit Bewegungssystem betrachteten jeweils unterschiedliche Aspekte frühzeitiger Vorinformationen über bevorstehende Übernahmen. Das erste Experiment untersuchte, ob Fahrer überhaupt von frühzeitigen Situationsankündigungen, beispielsweise im Sinne einer verbesserten Übernahmeleistung, profitieren. Das zweite Experiment befasste sich mit der Frage, wie solche Ankündigungen zeitlich und inhaltlich zu gestalten sind (d. h. wann sie präsentiert werden und welche Informationen sie enthalten sollten), und welchen Einfluss deren Gestaltung auf die Aufgabenbearbeitung (insbesondere deren Unterbrechung und spätere Wiederaufnahme) während der automatisierten Fahrt hat. Um herauszufinden, wie ein Anzeigekonzept zur längerfristigen Planung von fahrfremden Tätigkeiten während des automatisierten Fahrens beitragen könnte, fand im dritten Experiment ein Vergleich von Situationsankündigungen, die vor dem Erreichen einer Übernahmesituation ausgegeben wurden, mit kontinuierlich präsentierten Informationen über die verbleibende Distanz zur nächsten Systemgrenze statt. In allen Studien wurde neben den Auswirkungen frühzeitiger Vorinformationen auf die Übernahmeleistung und Bearbeitung von fahrfremden Tätigkeiten auch untersucht, welche Auswirkungen ein erweitertes Übernahmekonzept auf die Fahrerreaktion in Grenz- und Fehlerfällen, in denen Vorinformationen entweder nicht oder fehlerhaft angezeigt wurden, hat.
Für die Gestaltung zukünftiger Übernahmekonzepte für hochautomatisierte Fahrzeuge kann basierend auf den Ergebnissen empfohlen werden, frühzeitige Anzeigen von Systemgrenzen zur Ermöglichung eines sicheren und komfortablen Wechsels zwischen dem manuellen und dem automatisierten Fahren in die Mensch-Maschine-Schnittstelle zu integrieren. Basierend auf den Ergebnissen dieser Arbeit liegt der empfohlene Zeitpunkt für diskrete Ankündigungen bei einer Reisegeschwindigkeit von 120 km/h bei etwa 1000 Meter (d. h. ca. 30 Sekunden) vor der Ausgabe der Übernahmeaufforderung. Zudem wird empfohlen zur Abschätzung der verbleibenden Zeit im automatisierten Modus eine Anzeige der Entfernung zur nächsten Systemgrenze in das Konzept zu integrieren, die dem Fahrer eine längerfristige Aufgabenplanung ermöglicht. Neben der reinen Anzeige des Übernahmeerfordernisses sollten dem Fahrer auch Informationen über das erforderliche Fahrmanöver nach der Kontrollübernahme übermittelt werden.
The “active self” approach suggests that any object we manipulate voluntarily and foreseeably becomes part of our “self” in the sense that we feel control over this object (sense of agency) and experience it as belonging to our own body (sense of ownership). While there is considerable evidence that we can indeed experience both a sense of agency and a sense of ownership over a broad variety of objects when we control these through our actions, the approach has also been criticized for exaggerating the flexibility of the human self. In this thesis, I investigate the influence that the relationship between the body movements controlling an object and the movements of the object itself has on the process of integrating an object into the self. I demonstrate that fully controlling an object is not sufficient for it to be integrated into the self since both explicit and implicit measures of the sense of agency and the sense of ownership indicate less or no integration when body movements are transformed into inverted object movements. Furthermore, I show that such inversions lead to the downregulation of sensory signals either from the body or from the controlled object in order to deal with the conflicting multisensory information when performing such actions. I argue that this downregulation is the underlying factor behind the diminished or eliminated integration of inverted body and object movements and I discuss further pathways for possible future studies building up on these findings.
From simply ringing a bell to preparing a five-course menu, human behavior commonly causes changes in the environment. Such episodes where an agent acts, thereby causing changes in their environment constitute the sense of agency. In this thesis four series of experi-ments elucidate how the sense of agency is represented in complex action-event sequences, thereby bridging a gap between basic cognitive research and real-life practice. It builds upon extensive research on the sense of agency in unequivocal sequences consisting of single ac-tions and distinct, predominantly auditory, outcomes. Employing implicit as well as explicit measures, the scope is opened up to multi-step sequences.
The experiments show that it is worthwhile devoting more research to complex action-event sequences. With a newly introduced auditory measure (Chapter II), common phenomena such as temporal binding and a decrease in agency ratings following distorted feedback were replicated in multi-step sequences. However, diverging results between traditional implicit and explicit measures call for further inspection. Multisensory integration appears to gain more weight when multiple actions have to be performed to attain a goal leading to more accurate representations of the own actions (Chapter III). Additionally, freedom of choice (Chapter III) as well as early spatial ambiguity altered the perceived timing of outcomes, while late spatial ambi-guity (Chapter IV) and the outcome’s self-relevance did not (Chapter V). The data suggests that the cognitive system is capable of representing multi-step action-event sequences implicitly and explicitly. Actions and sensory events show a temporal attraction stemming from a bias in the perception of outcomes. Explicit knowledge about causing an event-sequence facilitates neither feelings of control nor taking authorship. The results corroborate current theorizing on the un-derpinnings of temporal binding and the divergence between traditional implicit and explicit measures of the sense of agency. Promising avenues for further research include structured analyses of how much inferred causality contributes to implicit and explicit measures of agency as well as finding alternative measures to capture conceptual as well as non-conceptual facets of the agency experience with one method.
One of the features that defines humans as extraordinarily social beings is their striking susceptibility to the gaze of others. The research reported in this dissertation was undertaken to advance our understanding of the role of gaze cues in low-level attentional and higher-order cognitive processes. In particular, effects of gaze were examined with regard to three aspects of human cognition: (1) social attention, (2) social interaction and (3) social understanding. Chapter 1 consists of three manuscripts that investigate the boundary conditions of attention capture by direct gaze and how gaze direction is integrated with facial context information. Manuscript 1 and 2 suggest two necessary requirements for attention capture by direct gaze: a meaningful holistic facial context and sharp foveal vision, respectively. Manuscript 3 shows approach/avoidance-congruency effects between gaze direction and emotion expression on attention. Chapter 2 of this dissertation explores the role of gaze in more naturalistic social scenarios. Manuscript 4 demonstrates that gaze behavior during a conversation shapes our perception of another person. Manuscript 5 builds on these findings by showing that these perceptions define our willingness to act in a prosocial way towards our interaction partner. Finally, chapter 3 adopts a broader perspective on social cognition research with a special focus on methodological aspects. Manuscript 6 is a review highlighting the significance of methodological aspects in social cognition research and stressing the importance of sophisticated decisions on task and stimulus materials. Manuscript 7 introduces a new instrument for the assessment of social understanding in adolescents. Initial application in a young sample group indicates that an understanding of another person’s mental states is a capacity that is still developing throughout adolescence. Both manuscripts of this final chapter include eye tracking data that suggest a relationship between gaze behavior and social understanding, a finding that further emphasizes the complex and multifaceted nature of social cognition. I conclude from the findings of this dissertation that research can benefit from adopting a broad view in terms of methodological as well as temporal aspects in order to capture human social cognition in its entirety.
The current dissertation addresses the analysis of technology-enhanced learning processes by using Process Mining techniques. For this purpose, students’ coded think-aloud data served as the measurement of the learning process, in order to assess the potential of this analysis method for evaluating the impact of instructional support.
The increasing use of digital media in higher education and further educational sectors enables new potentials. However, it also poses new challenges to students, especially regarding the self-regulation of their learning process. To help students with optimally making progress towards their learning goals, instructional support is provided during learning. Besides the use of questionnaires and tests for the assessment of learning, researchers make use increasingly of process data to evaluate the effects of provided support. The analysis of observed behavioral traces while learning (e.g., log files, eye movements, verbal reports) allows detailed insights into the student’s activities as well as the impact of interventions on the learning process. However, new analytical challenges emerge, especially when going beyond the analysis of pure frequencies of observed events. For example, the question how to deal with temporal dynamics and sequences of learning activities arises. Against this background, the current dissertation concentrates on the application of Process Mining techniques for the detailed analysis of learning processes. In particular, the focus is on the additional value of this approach in comparison to a frequency-based analysis, and therefore on the potential of Process Mining for the evaluation of instructional support.
An extensive laboratory study with 70 university students, which was conducted to investigate the impact of a support measure, served as the basis for pursuing the research agenda of this dissertation. Metacognitive prompts supported students in the experimental group (n = 35) during a 40-minute hypermedia learning session; whereas the control group (n = 35) received no support. Approximately three weeks later, all students participated in another learning session; however, this time all students learned without any help. The participants were instructed to verbalize their learning activities concurrently while learning. In the three analyses of this dissertation, the coded think aloud data were examined in detail by using frequency-based methods as well as Process Mining techniques.
The first analysis addressed the comparison of the learning activities between the experimental and control groups during the first learning session. This study concentrated on the research questions whether metacognitive prompting increases the number of metacognitive learning activities, whether a higher number of these learning activities corresponds with learning outcome (mediation), and which differences regarding the sequential structure of learning activities can be revealed. The second analysis investigated the impact of the individual prompts as well as the conditions of their effectiveness on the micro level. In addition to Process Mining, we used a data mining approach to compare the findings of both analysis methods. More specifically, we classified the prompts by their effectiveness, and we examined the learning activities preceding and following the presentation of instructional support. Finally, the third analysis considered the long-term effects of metacognitive prompting on the learning process during another learning session without support. It was the key objective of this study to examine which fostered learning activities and process patterns remained stable during the second learning session.
Overall, all three analyses indicated the additional value of Process Mining in comparison to a frequency-based analysis. Especially when conceptualizing the learning process as a dynamic sequence of multiple activities, Process Mining allows identifying regulatory loops and crucial routing points of the process. These findings might contribute to optimizing intervention strategies. However, before drawing conclusions for the design of instructional support based on the revealed process patterns, additional analyses need to investigate the generalizability of results. Moreover, the application of Process Mining remains challenging because guidelines for analytical decisions and parameter settings in technology-enhanced learning context are currently missing. Therefore, future studies need to examine further the potential of Process Mining as well as related analysis methods to provide researchers with concrete recommendations for use. Nevertheless, the application of Process Mining techniques can already contribute to advance the understanding of the impact of instructional support through the use of fine-grained process data.
Humans use their eyes not only as visual input devices to perceive the environment, but also as an action tool in order to generate intended effects in their environment. For instance, glances are used to direct someone else's attention to a place of interest, indicating that gaze control is an important part of social communication. Previous research on gaze control in a social context mainly focused on the gaze recipient by asking how humans respond to perceived gaze (gaze cueing). So far, this perspective has hardly considered the actor’s point of view by neglecting to investigate what mental processes are involved when actors decide to perform an eye movement to trigger a gaze response in another person. Furthermore, eye movements are also used to affect the non-social environment, for instance when unlocking the smartphone with the help of the eyes. This and other observations demonstrate the necessity to consider gaze control in contexts other than social communication whilst at the same time focusing on commonalities and differences inherent to the nature of a social (vs. non-social) action context. Thus, the present work explores the cognitive mechanisms that control such goal-oriented eye movements in both social and non-social contexts.
The experiments presented throughout this work are built on pre-established paradigms from both the oculomotor research domain and from basic cognitive psychology. These paradigms are based on the principle of ideomotor action control, which provides an explanatory framework for understanding how goal-oriented, intentional actions come into being. The ideomotor idea suggests that humans acquire associations between their actions and the resulting effects, which can be accessed in a bi-directional manner: Actions can trigger anticipations of their effects, but the anticipated resulting effects can also trigger the associated actions. According to ideomotor theory, action generation involves the mental anticipation of the intended effect (i.e., the action goal) to activate the associated motor pattern. The present experiments involve situations where participants control the gaze of a virtual face via their eye movements. The triggered gaze responses of the virtual face are consistent to the participant’s eye movements, representing visual action effects. Experimental situations are varied with respect to determinants of action-effect learning (e.g., contingency, contiguity, action mode during acquisition) in order to unravel the underlying dynamics of oculomotor control in these situations. In addition to faces, conditions involving changes in non-social objects were included to address the question of whether mechanisms underlying gaze control differ for social versus non-social context situations.
The results of the present work can be summarized into three major findings. 1. My data suggest that humans indeed acquire bi-directional associations between their eye movements and the subsequently perceived gaze response of another person, which in turn affect oculomotor action control via the anticipation of the intended effects. The observed results show for the first time that eye movements in a gaze-interaction scenario are represented in terms of their gaze response in others. This observation is in line with the ideomotor theory of action control. 2. The present series of experiments confirms and extends pioneering results of Huestegge and Kreutzfeldt (2012) with respect to the significant influence of action effects in gaze control. I have shown that the results of Huestegge and Kreutzfeldt (2012) can be replicated across different contexts with different stimulus material given that the perceived action effects were sufficiently salient. 3. Furthermore, I could show that mechanisms of gaze control in a social gaze-interaction context do not appear to be qualitatively different from those in a non-social context.
All in all, the results support recent theoretical claims emphasizing the role of anticipation-based action control in social interaction. Moreover, my results suggest that anticipation-based gaze control in a social context is based on the same general psychological mechanisms as ideomotor gaze control, and thus should be considered as an integral part rather than as a special form of ideomotor gaze control.
This dissertation highlights various aspects of basic social attention by choosing versatile approaches to disentangle the precise mechanisms underlying the preference to focus on other human beings. The progressive examination of different social processes contrasted with aspects of previously adopted principles of general attention. Recent research investigating eye movements during free exploration revealed a clear and robust social bias, especially for the faces of depicted human beings in a naturalistic scene. However, free viewing implies a combination of mechanisms, namely automatic attention (bottom-up), goal-driven allocation (top-down), or contextual cues and inquires consideration of overt (open exploration using the eyes) as well as covert orienting (peripheral attention without eye movement). Within the scope of this dissertation, all of these aspects have been disentangled in three studies to provide a thorough investigation of different influences on social attention mechanisms.
In the first study (section 2.1), we implemented top-down manipulations targeting non-social features in a social scene to test competing resources. Interestingly, attention towards social aspects prevailed, even though this was detrimental to completing the requirements. Furthermore, the tendency of this bias was evident for overall fixation patterns, as well as fixations occurring directly after stimulus onset, suggesting sustained as well as early preferential processing of social features. Although the introduction of tasks generally changes gaze patterns, our results imply only subtle variance when stimuli are social. Concluding, this experiment indicates that attention towards social aspects remains preferential even in light of top-down demands.
The second study (section 2.2) comprised of two separate experiments, one in which we investigated reflexive covert attention and another in which we tested reflexive as well as sustained overt attention for images in which a human being was unilaterally located on either the left or right half of the scene. The first experiment consisted of a modified dot-probe paradigm, in which peripheral probes were presented either congruently on the side of the social aspect, or incongruently on the non-social side. This was based on the assumption that social features would act similar to cues in traditional spatial cueing paradigms, thereby facilitating reaction times for probes presented on the social half as opposed to the non-social half. Indeed, results reflected such congruency effect. The second experiment investigated these reflexive mechanisms by monitoring eye movements and specifying the location of saccades and fixations for short as well as long presentation times. Again, we found the majority of initial saccades to be congruently directed to the social side of the stimulus. Furthermore, we replicated findings for sustained attention processes with highest fixation densities for the head region of the displayed human being.
The third study (section 2.3), tackled the other mechanism proposed in the attention dichotomy, the bottom-up influence. Specifically, we reduced the available contextual information of a scene by using a gaze-contingent display, in which only the currently fixated regions would be visible to the viewer, while the remaining image would remain masked. Thereby, participants had to voluntarily change their gaze in order to explore the stimulus. First, results revealed a replication of a social bias in free-viewing displays. Second, the preference to select social features was also evident in gaze-contingent displays. Third, we find higher recurrent gaze patterns for social images compared to non-social ones for both viewing modalities. Taken together, these findings imply a top-down driven preference for social features largely independent of contextual information.
Importantly, for all experiments, we took saliency predictions of different computational algorithms into consideration to ensure that the observed social bias was not a result of high physical saliency within these areas. For our second experiment, we even reduced the stimulus set to those images, which yielded lower mean and peak saliency for the side of the stimulus containing the social information, while considering algorithms based on low-level features, as well as pre-trained high-level features incorporated in deep learning algorithms.
Our experiments offer new insights into single attentional mechanisms with regard to static social naturalistic scenes and enable a further understanding of basic social processing, contrasting from that of non-social attention. The replicability and consistency of our findings across experiments speaks for a robust effect, attributing social attention an exceptional role within the general attention construct, not only behaviorally, but potentially also on a neuronal level and further allowing implications for clinical populations with impaired social functioning.
Studien zeigen, dass Fahrer in Notfallsituationen meistens eher bremsen als ausweichen, obwohl ausweichen möglicherweise die bessere Strategie zur Kollisionsvermeidung gewesen wäre. Um Fahrer besser bei der Kollisionsvermeidung zu unterstützen, wurden daher in den letzten Jahren Assistenzsysteme entwickelt, die den Fahrer nicht mehr nur bei Notbremsmanövern, sondern auch bei Notausweichmanövern durch einen automatischen Eingriff in die Querführung unterstützen sollen. Allerdings zeigte sich in mehreren Studien, dass das Verhalten der Fahrer die Wirksamkeit dieser Assistenten reduziert, insbesondere wenn der Eingriff des Assistenten über das Lenkrad rückgemeldet wurde.
In dieser Arbeit wurde davon ausgegangen, dass diese Reaktion der Fahrer eine Folge automatischer Korrekturprozesse innerhalb eines psychokybernetischen Regelkreises ist, an dem sensomotorische Regelprozesse zur Steuerung der Lenkradbewegung beteiligt sind. Dazu wurde ein Fahrerverhaltensmodell entwickelt, das den Einfluss der sensomotorischen Regelprozesse im Kontext der Fahraufgabe beschreibt. Auf Basis des Fahrerverhaltensmodells wird angenommen, dass unerwartete haptische Signale am Lenkrad auf Ebene der motorischen Regelung zunächst als Störung des ursprünglichen Handlungsziels interpretiert werden. Um die resultierenden Abweichungen zu korrigieren, wird auf sensomotorischer Ebene ein Korrekturprozess eingeleitet, der erst dann beendet wird, wenn der Fahrer die Möglichkeit hatte, die Situation visuell zu analysieren und sein Handlungsziel an die Situation anzupassen. Dies sollte sich im zeitlichen Verlauf der Fahrerreaktion am Lenkrad widerspiegeln und könnte eine Erklärung für die vom Fahrer verursachte Reduktion der Wirksamkeit sein.
Das Ziel der vorliegenden Arbeit war es, Anhaltspunkte für diese Annahme aufzuzeigen. Im Rahmen von sieben Experimenten wurden der Einfluss von Eingriffen mit haptischer Rückmeldung am Lenkrad und das resultierende Zusammenspiel von sensomotorischen und visuellen Kontrollprozessen untersucht. Alle Studien befassten sich mit Eingriffen in die Querführung, die den Fahrer potenziell bei Notausweichmanövern unterstützen könnten, und betrachteten sowohl Aspekte der Wirksamkeit als auch der Kontrollierbarkeit. Dabei wurde versucht, durch die Gestaltung des Eingriffs, einer gezielten Beeinflussung der Handlungsziele des Fahrers und einer Manipulation der Rückmeldung Unterschiede in der Reaktion des Fahrers auf unerwartete Eingriffe hervorzurufen. Die Lenkreaktionszeit und das Reaktionsmuster der Fahrer dienten hierbei als Indikatoren für die Leistungsfähigkeit der Fahrer, ihre Handlungsziele an die vorliegende Situation anzupassen.
Die Ergebnisse bestätigen die Relevanz der im Modell angenommenen sensomotorischen Kontrollprozesse und damit auch den Einfluss der haptischen Rückmeldung auf das Fahrerverhalten bei automatischen Eingriffen in die Querführung. Die beschriebene Betrachtung des zeitlichen Verlaufs des Lenkverhaltens ermöglicht zudem eine fundierte Evaluation der Fahrer-Fahrzeug-Interaktion, um verschiedene Assistenzsysteme miteinander zu vergleichen. Darüber hinaus liefert die vorliegende Arbeit wertvolle Hinweise für die Gestaltung von Assistenzsystemen, die den Fahrer in Notfallsituationen mit automatischen Eingriffen in die Querführung unterstützen sollen. Insgesamt bietet die Integration sensomotorischer Kontrollprozesse in bestehende Fahrerverhaltensmodelle einen Erklärungsansatz für bestehende Probleme bei der Fahrer-Fahrzeug-Interaktion bei automatischen Eingriffen in die Querführung, wodurch eine Lücke in der aktuellen verkehrspsychologischen Forschung geschlossen wurde.
Gazes are of central relevance for people. They are crucial for navigating the world and communicating with others. Nevertheless, research in recent years shows that many findings from experimental research on gaze behavior cannot be transferred from the laboratory to everyday behavior. For example, the frequency with which conspecifics are looked at is considerably higher in experimental contexts than what can be observed in daily behavior. In short: findings from laboratories cannot be generalized into general statements. This thesis is dedicated to this matter. The dissertation describes and documents the current state of research on social attention through a literature review, including a meta-analysis on the /gaze cueing/ paradigm and an empirical study on the robustness of gaze following behavior. In addition, virtual reality was used in one of the first studies in this research field. Virtual reality has the potential to significantly improve the transferability of experimental laboratory studies to everyday behavior. This is because the technology enables a high degree of experimental control in naturalistic research designs. As such, it has the potential to transform empirical research in the same way that the introduction of computers to psychological research did some 50 years ago. The general literature review on social attention is extended to the classic /gaze cueing/ paradigm through a systematic review of publications and a meta-analytic evaluation (Study 1). The cumulative evidence supported the findings of primary studies: Covert spatial attention is directed by faces. However, the experimental factors included do not explain the surprisingly large variance in the published results. Thus, there seem to be further, not well-understood variables influencing these social processes. Moreover, classic /gaze cueing/ studies have limited ecological validity. This is discussed as a central reason for the lack of generalisability. Ecological validity describes the correspondence between experimental factors and realistic situations. A stimulus or an experimental design can have high and low ecological validity on different dimensions and have different influences on behavior. Empirical research on gaze following behavior showed that the /gaze cueing/ effect also occurs with contextually embedded stimuli (Study 2). The contextual integration of the directional cue contrasted classical /gaze cueing/ studies, which usually show heads in isolation. The research results can thus be transferred /within/ laboratory studies to higher ecologically valid research paradigms. However, research shows that the lack of ecological validity in experimental designs significantly limits the transferability of experimental findings to complex situations /outside/ the laboratory. This seems to be particularly the case when social interactions and norms are investigated. However, ecological validity is also often limited in these studies for other factors, such as contextual embedding /of participants/, free exploration behavior (and, thus, attentional control), or multimodality. In a first study, such high ecological validity was achieved for these factors with virtual reality, which could not be achieved in the laboratory so far (Study 3). Notably, the observed fixation patterns showed differences even under /most similar/ conditions in the laboratory and natural environments. Interestingly, these were similar to findings also derived from comparisons of eye movement in the laboratory and field investigations. These findings, which previously came from hardly comparable groups, were thus confirmed by the present Study 3 (which did not have this limitation). Overall, /virtual reality/ is a new technical approach to contemporary social attention research that pushes the boundaries of previous experimental research. The traditional trade-off between ecological validity and experimental control thus becomes obsolete, and laboratory studies can closely inherit an excellent approximation of reality. Finally, the present work describes and discusses the possibilities of this technology and its practical implementation. Within this context, the extent to which this development can still guarantee a constructive classification of different laboratory tests in the future is examined.
Multitasking, defined as performing more than one task at a time, typically yields performance decrements, for instance, in processing speed and accuracy. These performance costs are often distributed asymmetrically among the involved tasks. Under suitable conditions, this can be interpreted as a marker for prioritization of one task – the one that suffers less – over the other. One source of such task prioritization is based on the use of different effector systems (e.g., oculomotor system, vocal tract, limbs) and their characteristics. The present work explores such effector system-based task prioritization by examining to which extent associated effector systems determine which task is processed with higher priority in multitasking situations. Thus, three different paradigms are used, namely the simultaneous (stimulus) onset paradigm, the psychological refractory period (PRP) paradigm, and the task switching paradigm. These paradigms invoke situations in which two (in the present studies basic spatial decision) tasks are a) initiated at exactly the same time, b) initiated with a short varying temporal distance (but still temporally overlapping), or c) in which tasks alternate randomly (without temporal overlap). The results allow for three major conclusions: 1. The assumption of effector system-based task prioritization according to an ordinal pattern (oculomotor > pedal > vocal > manual, indicating decreasing prioritization) is supported by the observed data in the simultaneous onset paradigm. This data pattern cannot be explained by a rigid “first come, first served” task scheduling principle. 2. The data from the PRP paradigm confirmed the assumption of vocal-over-manual prioritization and showed that classic PRP effects (as a marker for task order-based prioritization) can be modulated by effector system characteristics. 3. The mere cognitive representation of task sets (that must be held active to switch between them) differing in effector systems without an actual temporal overlap in task processing, however, is not sufficient to elicit the same effector system prioritization phenomena observed for overlapping tasks. In summary, the insights obtained by the present work support the assumptions of parallel central task processing and resource sharing among tasks, as opposed to exclusively serial processing of central processing stages. Moreover, they indicate that effector systems are a crucial factor in multitasking and suggest an integration of corresponding weighting parameters in existing dual-task control frameworks.
Defensive behaviors in response to threats are key factors in maintaining mental and physical health, but their phenomenology remains poorly understood. Prior work reported an inhibition of oculomotor activity in response to avoidable threat in humans that reminded of freezing behaviors in rodents. This notion of a homology between defensive responding in rodents and humans was seconded by concomitant heart rate decrease and skin conductance increase. However, several aspects of this presumed defense state remained ambiguous. For example, it was unclear whether the observed oculomotor inhibition would 1) robustly occur during preparation for threat-avoidance irrespective of task demands, 2) reflect a threat-specific defensive state, 3) be related to an inhibition of somatomotor activity as both motion metrics have been discussed as indicators for freezing behaviors in humans, and 4) manifest in unconstrained settings.
We thus embarked on a series of experiments to unravel the robustness, threat-specificity, and validity of previously observed (oculo)motor and autonomic dynamics upon avoidable threat in humans. We provided robust evidence for reduced gaze dispersion, significantly predicting the speed of subsequent motor reactions across a wide range of stimulus contexts. Along this gaze pattern, we found reductions in body movement and showed that the temporal profiles between gaze and body activity were positively related within individuals, suggesting that both metrics reflect the same construct. A simultaneous activation of the parasympathetic (i.e., heart rate deceleration) and sympathetic (i.e., increased skin conductance and pupil dilation) nervous system was present in both defensive and appetitive contexts, suggesting that these autonomic dynamics are not only sensitive to threat but reflecting a more general action-preparatory mechanism. We further gathered evidence for two previously proposed defensive states involving a decrease of (oculo)motor activity in a naturalistic, unconstrained virtual reality environment. Specifically, we observed a state consisting of a cessation of ongoing behaviors and orienting upon relatively distal, ambiguous threat (Attentive Immobility) while an entire immobilization and presumed allocation of attention to the threat stimulus became apparent upon approaching potential threat (Immobility under Attack).
Taken together, we provided evidence for specific oculomotor and autonomic dynamics upon increasing levels of threat that may inspire future translational work in rodents and humans on shared mechanisms of threat processing, ultimately supporting the development of novel therapeutic approaches.
Sprech- und Stimmstörungen sind häufige Symptome der Idiopathischen Parkinson Erkrankung (IPS), wobei bis zu 89% der Patienten im Verlauf der Krankheit unter einer Dysarthrie leiden. Die Tiefenhirnstimulation des Nucleus subthalamicus (STN-DBS) ist eine etablierte Behandlung für die motorischen Symptome des IPS (Allert et al., 2004). Während STN-DBS positive Effekte auf einige Teilfunktionsbereiche der Dysarthrie zu haben scheint, berichten die meisten Studien entweder über keine Verbesserung oder eine Verschlechterung der Sprech- und Stimmfunktionen nach Implantation der STN-DBS (Tsuboi et al., 2015; Wang et al., 2003; Wertheimer et al., 2014). Klinische Erfahrungswerte sowie Fallberichte und Studien lassen vermuten, dass diese sprachtherapeutisch relevanten Nebenwirkungen unabhängig von der therapeutischen Wirksamkeit der STN-DBS sind und daher als unerwünschte, aber nicht therapieimmanente Interferenzfaktoren anzusehen sind (Bouthour et al., 2018), die es genauer zu untersuchen gilt, da die Lebensqualität von IPS-Erkrankten als stark einschränkend wahrgenommen wird (Hariz et al., 2010). Eine aufwendige und methodisch fundierte Klassifizierung wurde von Tsuboi und Kollegen vorgenommen, die im Zusammenhang mit STN-DBS fünf Cluster von Sprech- und Stimmstörungen identifizierten (Tanaka et al., 2020; Tsuboi et al., 2015, 2017). Dazu zählten die Phänotypen „spastische Dysarthrie“, „Stottern“, „rigid-hypokinetischer Typ“, „behauchte Stimme“ und „gepresste Stimme“.
Erste Hinweise lassen darauf schließen, dass die Nebenwirkungen von STN-DBS auf die Stimulation spezifischer Gehirnkreise zurückzuführen sein könnte (Fox et al., 2014). In dieser Arbeit wird eine retrospektive Studie mit STN-DBS stimulierten IPS Erkrankten vorgestellt, die sprachtherapeutisch relevante Sprech- und Stimmstörungen unter zwei Bedingungen bewertet (ein- und ausgeschaltete Stimulation) sowie eine prospektive Studie mit den beiden gleichen Bedingungen. Beide Studien haben das Ziel einer Replizierbarkeit der Ergebnisse von Tsuboi et al. (2015, 2017). Die zweite prospektive Studie bezieht außerdem konnektombasierte Daten ein.
Die Ergebnisse beider Studien lassen quantitativ keine Signifikanzen hinsichtlich der o.g. dysarthrischen Phänotypen zu, quantitativ lassen sich jedoch deutliche Tendenzen ähnlich der Ausgangsstudie erkennen. Zudem wurden das Cluster „Stottern“ in der retrospektiven Studie als weiteres möglicherweise STN-DBS immantentes Cluster identifiziert. In der prospektiven Studie wurde ein Cluster hinzugefügt, da in den Beurteilungen zusätzlich die Symptomatik „hasty speech“ oder auch „hastiges Sprechen“ beobachtet wurde.