Refine
Has Fulltext
- yes (358)
Is part of the Bibliography
- yes (358)
Year of publication
Document Type
- Journal article (358) (remove)
Language
- English (358) (remove)
Keywords
- Psychologie (41)
- EEG (14)
- anxiety (13)
- attention (13)
- psychology (13)
- virtual reality (13)
- P300 (12)
- event-related potentials (10)
- emotion (8)
- emotions (8)
Institute
- Institut für Psychologie (358) (remove)
Sonstige beteiligte Institutionen
Previous studies of social phobia have reported an increased vigilance to social threat cues but also an avoidance of socially relevant stimuli such as eye gaze. The primary aim of this study was to examine attentional mechanisms relevant for perceiving social cues by means of abnormalities in scanning of facial features in patients with social phobia. In two novel experimental paradigms, patients with social phobia and healthy controls matched on age, gender and education were compared regarding their gazing behavior towards facial cues. The first experiment was an emotion classification paradigm which allowed for differentiating reflexive attentional shifts from sustained attention towards diagnostically relevant facial features. In the second experiment, attentional orienting by gaze direction was assessed in a gaze-cueing paradigm in which non-predictive gaze cues shifted attention towards or away from subsequently presented targets. We found that patients as compared to controls reflexively oriented their attention more frequently towards the eyes of emotional faces in the emotion classification paradigm. This initial hypervigilance for the eye region was observed at very early attentional stages when faces were presented for 150 ms, and persisted when facial stimuli were shown for 3 s. Moreover, a delayed attentional orienting into the direction of eye gaze was observed in individuals with social phobia suggesting a differential time course of eye gaze processing in patients and controls. Our findings suggest that basic mechanisms of early attentional exploration of social cues are biased in social phobia and might contribute to the development and maintenance of the disorder.
A MODEL of good information processing is sketched, describing how metacognitive knowledge influences strategy selection and use. Three factors pose particular problems for learning disabled students as they attempt to acquire metacognitive knowledge and to use study strategies productively: neurological impairments; deficiencies in general world knowledge; and negative beliefs, attitudes, and styles that limit self-efficacy. Creating an educational atmosphere that explicitly builds conceptual (domain-specific) knowledge and teaches positive beliefs about learning potential is essential in promoting metacognitively-oriented instruction.
Conflicts between avoiding feared stimuli versus approaching them for competing rewards are essential for functional behavior and anxious psychopathology. Yet, little is known about the underlying decision process. We examined approach-avoidance decisions and their temporal dynamics when avoiding Pavlovian fear stimuli conflicted with gaining rewards. First, a formerly neutral stimulus (CS+) was repeatedly paired with an aversive stimulus (US) to establish Pavlovian fear. Another stimulus (CS−) was never paired with the US. A control group received neutral tones instead of aversive USs. Next, in each of 324 trials, participants chose between a CS−/low reward and a CS+/high reward option. For the latter, probability of CS+ presentation (Pavlovian fear information) and reward magnitude (reward information) varied. Computer mouse movements were tracked to capture the decision dynamics. Although no more USs occurred, pronounced and persistent costly avoidance of the Pavlovian fear CS+ was found. Time-continuous multiple regression of movement trajectories revealed a stronger and faster impact of Pavlovian fear compared to reward information during decision-making. The impact of fear information, but not reward information, modestly decreased across trials. These findings suggest a persistently stronger weighting of fear compared to reward information during approach-avoidance decisions, which may facilitate the development of pathological avoidance.
Purpose of Review
This article provides an overview of current findings on Theory of Mind (ToM) in human children and adults and highlights the relationship between task specifications and their outcome in socio-cognitive research.
Recent Findings
ToM, the capacity to reason about and infer others’ mental states, develops progressively throughout childhood—the exact time course is still a matter of debate. Neuroimaging studies indicate the involvement of a widespread neuronal network during mentalizing, suggesting that ToM is a multifaceted process. Accordingly, the tasks and trainings that currently exist to investigate and enhance ToM are heterogeneous, and the outcomes largely depend on the paradigm that was used.
Summary
We argue for the implementation of multiple-task batteries in the assessment of socio-cognitive abilities. Decisions for a particular paradigm need to be carefully considered and justified. We want to emphasize the importance of targeted research on the relationship between task specifications and outcomes.
Human attention is strongly attracted by direct gaze and sudden onset motion. The sudden direct-gaze effect refers to the processing advantage for targets appearing on peripheral faces that suddenly establish eye contact. Here, we investigate the necessity of social information for attention capture by (sudden onset) ostensive cues. Six experiments involving 204 participants applied (1) naturalistic faces, (2) arrows, (3) schematic eyes, (4) naturalistic eyes, or schematic facial configurations (5) without or (6) with head turn to an attention-capture paradigm. Trials started with two stimuli oriented towards the observer and two stimuli pointing into the periphery. Simultaneous to target presentation, one direct stimulus changed to averted and one averted stimulus changed to direct, yielding a 2 × 2 factorial design with direction and motion cues being absent or present. We replicated the (sudden) direct-gaze effect for photographic faces, but found no corresponding effects in Experiments 2-6. Hence, a holistic and socially meaningful facial context seems vital for attention capture by direct gaze. STATEMENT OF SIGNIFICANCE: The present study highlights the significance of context information for social attention. Our findings demonstrate that the direct-gaze effect, that is, the prioritization of direct gaze over averted gaze, critically relies on the presentation of a meaningful holistic and naturalistic facial context. This pattern of results is evidence in favor of early effects of surrounding social information on attention capture by direct gaze.
Empathy and Theory of Mind (ToM) are two core components of social understanding. The EmpaToM is a validated social video task that allows for independent manipulation and assessment of the two capacities. First applications revealed that empathy and ToM are dissociable constructs on a neuronal as well as on a behavioral level. As the EmpaToM has been designed for the assessment of social understanding in adults, it has a high degree of complexity and comprises topics that are inadequate for minors. For this reason, we designed a new version of the EmpaToM that is especially suited to measure empathy and ToM in youths. In experiment 1, we successfully validated the EmpaToM-Y on the original EmpaToM in an adult sample (N = 61), revealing a similar pattern of results across tasks and strong correlations of all constructs. As intended, the performance measure for ToM and the control condition of the EmpaToM-Y showed reduced difficulty. In experiment 2, we tested the feasibility of the EmpaToM-Y in a group of teenagers (N = 36). Results indicate a reliable empathy induction and higher demands of ToM questions for adolescents. We provide a promising task for future research targeting inter-individual variability of socio-cognitive and socio-affective capacities as well as their precursors and outcomes in healthy minors and clinical populations.
Pupil dilation is known to be affected by a variety of factors, including physical (e.g., light) and cognitive sources of influence (e.g., mental load due to working memory demands, stimulus/response competition etc.). In the present experiment, we tested the extent to which vocal demands (speaking) can affect pupil dilation. Based on corresponding preliminary evidence found in a reanalysis of an existing data set from our lab, we setup a new experiment that systematically investigated vocal response‐related effects compared to mere jaw/lip movement and button press responses. Conditions changed on a trial‐by‐trial basis while participants were instructed to keep fixating a central cross on a screen throughout. In line with our prediction (and previous observation), speaking caused the pupils to dilate strongest, followed by nonvocal movements and finally a baseline condition without any vocal or muscular demands. An additional analysis of blink rates showed no difference in blink frequency between vocal and baseline conditions, but different blink dynamics. Finally, simultaneously recorded electromyographic activity showed that muscle activity may contribute to some (but not all) aspects of the observed effects on pupil size. The results are discussed in the context of other recent research indicating effects of perceived (instead of executed) vocal action on pupil dynamics.
The Role of Blinks, Microsaccades and their Retinal Consequences in Bistable Motion Perception
(2021)
Eye-related movements such as blinks and microsaccades are modulated during bistable perceptual tasks. However, if they play an active role during internal perceptual switches is not known. We conducted two experiments involving an ambiguous plaid stimulus, wherein participants were asked to continuously report their percept, which could consist of either unidirectional coherent or bidirectional component movement. Our main results show that blinks and microsaccades did not facilitate perceptual switches. On the contrary, a reduction in eye movements preceded the perceptual switch. Blanks, on the other hand, thought to mimic the retinal consequences of a blink, consistently led to a switch. Through the timing of the blank-introduced perceptual change, we were able to estimate the delay between the internal switch and the response. This delay further allowed us to evaluate that the reduction in blink probability co-occurred with the internal perceptual switch. Additionally, our results indicate that distinct internal processes underlie the switch to coherent vs. component percept. Blanks exclusively facilitated a switch to the coherent percept, and only the switch to coherent percept was followed by an increase in blink rate. In a second study, we largely replicated the findings and included a microsaccade analysis. Microsaccades only showed a weak relation with perceptual switches, but their direction was correlated with the perceived motion direction. Nevertheless, our data suggests an interaction between microsaccades and blinks by showing that microsaccades were differently modulated around blinks compared with blanks. This study shows that a reduction in eye movements precedes internal perceptual switches indicating that the rate of blinks can set the stage for a reinterpretation of sensory input. While a perceptual switch based on changed sensory input usually leads to an increase in blink rate, such an increase was only present after the perceptual switch to coherent motion but absent after the switch to component percept. This provides evidence of different underlying mechanism or internal consequence of the two perceptual switches and suggests that blinks can uncover differences in internal percept-related processes that are not evident from the percept itself.
Stranger, Lover, Friend?
(2021)
Social exclusion, even from minimal game-based interactions, induces negative consequences. We investigated whether the nature of the relationship with the excluder modulates the effects of ostracism. Participants played a virtual ball-tossing game with a stranger and a friend (friend condition) or a stranger and their romantic partner (partner condition) while being fully included, fully excluded, excluded only by the stranger, or excluded only by their close other. Replicating previous findings, full exclusion impaired participants’ basic-need satisfaction and relationship evaluation most severely. While the degree of exclusion mattered, the relationship to the excluder did not: Classic null hypothesis testing and Bayesian statistics showed no modulation of ostracism effects depending on whether participants were excluded by a stranger, a friend, or their partner.
Universal prevention for non-suicidal self-injury in adolescents is scarce - A systematic review
(2023)
Non-suicidal self-injury (NSSI) during adolescence is a high-risk marker for the development and persistence of mental health problems and has been recognized as a significant public health problem. Whereas targeted prevention has indeed shown to be effective in reducing NSSI and improve mental health problems, access to such programs is limited. By face validity, universal prevention of NSSI seems an ideal starting point for a stepped-care model to circumvent a lack of resources in the medical care system. However, it is yet unclear how effective such approaches are. Here, we provide a summary of existing work on universal prevention of NSSI in adolescents younger than 21 years based on a systematic literature search. We found that only seven studies are available. None of the programs evaluated was found to be effective in reducing the incidence or frequency of NSSI. After providing a comprehensive summary of the existing work, we evaluate the fact that existing work primarily focusses on selected/targeted prevention and on psychoeducational methods. We derive implications for future directions in the field of universal prevention of NSSI.
Experiments in animal models have shown that running increases neuronal activity in early visual areas in light as well as in darkness. This suggests that visual processing is influenced by locomotion independent of visual input. Combining mobile electroencephalography, motion- and eye-tracking, we investigated the influence of overground free walking on cortical alpha activity (~10 Hz) and eye movements in healthy humans. Alpha activity has been considered a valuable marker of inhibition of sensory processing and shown to negatively correlate with neuronal firing rates. We found that walking led to a decrease in alpha activity over occipital cortex compared to standing. This decrease was present during walking in darkness as well as during light. Importantly, eye movements could not explain the change in alpha activity. Nevertheless, we found that walking and eye related movements were linked. While the blink rate increased with increasing walking speed independent of light or darkness, saccade rate was only significantly linked to walking speed in the light. Pupil size, on the other hand, was larger during darkness than during light, but only showed a modulation by walking in darkness. Analyzing the effect of walking with respect to the stride cycle, we further found that blinks and saccades preferentially occurred during the double support phase of walking. Alpha power, as shown previously, was lower during the swing phase than during the double support phase. We however could exclude the possibility that the alpha modulation was introduced by a walking movement induced change in electrode impedance. Overall, our work indicates that the human visual system is influenced by the current locomotion state of the body. This influence affects eye movement pattern as well as neuronal activity in sensory areas and might form part of an implicit strategy to optimally extract sensory information during locomotion.
Action binding is the effect that the perceived time of an action is shifted towards the action related feedback. A much larger action binding effect in schizophrenia compared to normal controls has been shown, which might be due to positive symptoms like delusions. Here we investigated the relationship between delusional thinking and action binding in healthy individuals, predicting a positive correlation between them. The action binding effect was evaluated by comparing the perceived time of a keypress between an operant (keypress triggering a sound) and a baseline condition (keypress alone), with a novel testing method that massively improved the precision of the subjective timing measurement. A positive correlation was found between the tendency of delusional thinking (measured by the 21-item Peters et al. delusions inventory) and action binding across participants after controlling for the effect of testing order between operant and baseline conditions. The results indicate that delusional thinking in particular influences action time perception and support the notion of a continuous distribution of schizotypal traits with normal controls at one end and clinical patients at the other end.
Action binding refers to the observation that the perceived time of an action (e.g., a keypress) is shifted towards the distal sensory feedback (usually a sound) triggered by that action. Surprisingly, the role of somatosensory feedback for this phe-nomenon has been largely ignored. We fill this gap by showing that the somatosensory feedback, indexed by keypress peak force, is functional in judging keypress time. Specifically, the strength of somatosensory feedback is positively correlated with reported keypress time when the keypress is not associated with an auditory feedback and negatively correlated when the keypress triggers an auditory feedback. The result is consistent with the view that the reported keypress time is shaped by sensory information from different modalities. Moreover, individual differences in action binding can be explained by a sensory information weighting between somatosensory and auditory feedback. At the group level, increasing the strength of somatosensory feedback can decrease action binding to a level not being detected statistically. Therefore, a multisensory information integration account (between somatosensory and auditory inputs) explains action binding at both a group level and an individual level.
This study explored the differential effects of strategy training on German and American elementaryschool children and assessed the role of parents in the development of their children's strategic behavior and metacognition. 184 German and 161 American children were pretested on memory and metamemory tasks. Children were then assigned to either an organizational strategy training condition or a control condition. All children were tested on the maintenance and far-transfer of the strategy and task-related metamemory 1 week following training. Parents completed questionnaires about strategy instruction in the home. Strategy maintenance and metacognition were reassessed 6 months following training. German children were more strategic than American children. Instructed children performed better than control children. German parents reported more instruction of strategies in the home. These data suggest that formal education is responsible for aspects of cognitive development that have sometimes been viewed as a function of age.
The goal of the present study was to determine whether 4- and 5-year-old kindergarten children could be trained to maintain an organizational strategy over 2- and 8 week periods through an elaborate training program. A second goal was to assess the effects of the training program on strategy awareness. Twenty-eight kindergarten children were pretested on two sort-recall tasks and their awareness of the use of the clustering strategy was assessed through a protocol type procedure. Half the children received seven half-hour sessions of individual training in the clustering strategy and half the children participated in a control group. Both groups were post-tested on two sort-recall tasks 2 weeks following training and again 8 weeks following training. Strategy awareness, as measured by verbal protocol, was assessed at both post-test points. The elaborate strategy training program was successful in inducing short- and long-term strategy maintenance of the clustering strategy. Trained children’s clustering during sorting and clustering during recall was consistently related to the amount of items correctly recalled. No differences in strategy awareness were found. These findings demonstrate that the elaborate training procedure used in this study can be a very effective memory technique for young kindergarten children.
The main prediction of the Uncanny Valley Hypothesis (UVH) is that observation of humanlike characters that are difficult to distinguish from the human counterpart will evoke a state of negative affect. Well-established electrophysiological [late positive potential (LPP) and facial electromyography (EMG)] and self-report [Self-Assessment Manikin (SAM)] indices of valence and arousal, i.e., the primary orthogonal dimensions of affective experience, were used to test this prediction by examining affective experience in response to categorically ambiguous compared with unambiguous avatar and human faces (N = 30). LPP and EMG provided direct psychophysiological indices of affective state during passive observation and the SAM provided self-reported indices of affective state during explicit cognitive evaluation of static facial stimuli. The faces were drawn from well-controlled morph continua representing the UVH' dimension of human likeness (DHL). The results provide no support for the notion that category ambiguity along the DHL is specifically associated with enhanced experience of negative affect. On the contrary, the LPP and SAM-based measures of arousal and valence indicated a general increase in negative affective state (i.e., enhanced arousal and negative valence) with greater morph distance from the human end of the DHL. A second sample (N = 30) produced the same finding, using an ad hoc self-rating scale of feelings of familiarity, i.e., an oft-used measure of affective experience along the UVH' familiarity dimension. In conclusion, this multi-method approach using well-validated psychophysiological and self-rating indices of arousal and valence rejects for passive observation and for explicit affective evaluation of static faces the main prediction of the UVH.
The affective dimensions of emotional valence and emotional arousal affect processing of verbal and pictorial stimuli. Traditional emotional theories assume a linear relationship between these dimensions, with valence determining the direction of a behavior (approach vs. withdrawal) and arousal its intensity or strength. In contrast, according to the valence-arousal conflict theory, both dimensions are interactively related: positive valence and low arousal (PL) are associated with an implicit tendency to approach a stimulus, whereas negative valence and high arousal (NH) are associated with withdrawal. Hence, positive, high-arousal (PH) and negative, low-arousal (NL) stimuli elicit conflicting action tendencies. By extending previous research that used several tasks and methods, the present study investigated whether and how emotional valence and arousal affect subjective approach vs. withdrawal tendencies toward emotional words during two novel tasks. In Study 1, participants had to decide whether they would approach or withdraw from concepts expressed by written words. In Studies 2 and 3 participants had to respond to each word by pressing one of two keys labeled with an arrow pointing upward or downward. Across experiments, positive and negative words, high or low in arousal, were presented. In Study 1 (explicit task), in line with the valence-arousal conflict theory, PH and NL words were responded to more slowly than PL and NH words. In addition, participants decided to approach positive words more often than negative words. In Studies 2 and 3, participants responded faster to positive than negative words, irrespective of their level of arousal. Furthermore, positive words were significantly more often associated with “up” responses than negative words, thus supporting the existence of implicit associations between stimulus valence and response coding (positive is up and negative is down). Hence, in contexts in which participants' spontaneous responses are based on implicit associations between stimulus valence and response, there is no influence of arousal. In line with the valence-arousal conflict theory, arousal seems to affect participants' approach-withdrawal tendencies only when such tendencies are made explicit by the task, and a minimal degree of processing depth is required.
RATIONALE:
The endocannabinoid (eCB) system is implicated in several psychiatric disorders. Investigating emotional-motivational dysfunctions as underlying mechanisms, a study in humans revealed that in the C385A polymorphism of the fatty acid amide hydrolase (FAAH), the degrading enzyme of the eCB anandamide (AEA), A carriers, who are characterized by increased signaling of AEA as compared to C/C carriers, exhibited reduced brain reactivity towards unpleasant faces and enhanced reactivity towards reward. However, the association of eCB system with emotional-motivational reactivity is complex and bidirectional due to upcoming compensatory processes.
OBJECTIVES:
Therefore, we further investigated the relationship of the FAAH polymorphism and emotional-motivational reactivity in humans.
METHODS:
We assessed the affect-modulated startle, and ratings of valence and arousal in response to higher arousing pleasant, neutral, and unpleasant pictures in 67 FAAH C385A C/C carriers and 45 A carriers.
RESULTS:
Contrarily to the previous functional MRI study, A carriers compared to C/C carriers exhibited an increased startle potentiation and therefore emotional responsiveness towards unpleasant picture stimuli and reduced startle inhibition indicating reduced emotional reactivity in response to pleasant pictures, while both groups did not differ in ratings of arousal and valence.
CONCLUSIONS:
Our findings emphasize the bidirectionality and thorough examination of the eCB system's impact on emotional reactivity as a central endophenotype underlying various psychiatric disorders.
Background:
This study investigated the relation between social desirability and self-reported physical activity in web-based research.
Findings:
A longitudinal study (N = 5,495, 54% women) was conducted on a representative sample of the Dutch population using the Marlowe-Crowne Scale as social desirability measure and the short form of the International Physical Activity Questionnaire. Social desirability was not associated with self-reported physical activity (in MET-minutes/week), nor with its sub-behaviors (i.e., walking, moderate-intensity activity, vigorous-intensity activity, and sedentary behavior). Socio-demographics (i.e., age, sex, income, and education) did not moderate the effect of social desirability on self-reported physical activity and its sub-behaviors.
Conclusions:
This study does not throw doubt on the usefulness of the Internet as a medium to collect self-reports on physical activity.
Virtual reality (VR) has made its way into mainstream psychological research in the last two decades. This technology, with its unique ability to simulate complex, real situations and contexts, offers researchers unprecedented opportunities to investigate human behavior in well controlled designs in the laboratory. One important application of VR is the investigation of pathological processes in mental disorders, especially anxiety disorders. Research on the processes underlying threat perception, fear, and exposure therapy has shed light on more general aspects of the relation between perception and emotion. Being by its nature virtual, i.e., simulation of reality, VR strongly relies on the adequate selection of specific perceptual cues to activate emotions. Emotional experiences in turn are related to presence, another important concept in VR, which describes the user's sense of being in a VR environment. This paper summarizes current research into perception of fear cues, emotion, and presence, aiming at the identification of the most relevant aspects of emotional experience in VR and their mutual relations. A special focus lies on a series of recent experiments designed to test the relative contribution of perception and conceptual information on fear in VR. This strand of research capitalizes on the dissociation between perception (bottom up input) and conceptual information (top-down input) that is possible in VR. Further, we review the factors that have so far been recognized to influence presence, with emotions (e.g., fear) being the most relevant in the context of clinical psychology. Recent research has highlighted the mutual influence of presence and fear in VR, but has also traced the limits of our current understanding of this relationship. In this paper, the crucial role of perception on eliciting emotional reactions is highlighted, and the role of arousal as a basic dimension of emotional experience is discussed. An interoceptive attribution model of presence is suggested as a first step toward an integrative framework for emotion research in VR. Gaps in the current literature and future directions are outlined.
Behavior Change Techniques in Wrist-Worn Wearables to Promote Physical Activity: Content Analysis
(2020)
Background:
Decreasing levels of physical activity (PA) increase the incidences of noncommunicable diseases, obesity, and mortality. To counteract these developments, interventions aiming to increase PA are urgently needed. Mobile health (mHealth) solutions such as wearable sensors (wearables) may assist with an improvement in PA.
Objective:
The aim of this study is to examine which behavior change techniques (BCTs) are incorporated in currently available commercial high-end wearables that target users’ PA behavior.
Methods:
The BCTs incorporated in 5 different high-end wearables (Apple Watch Series 3, Garmin Vívoactive 3, Fitbit Versa, Xiaomi Amazfit Stratos 2, and Polar M600) were assessed by 2 researchers using the BCT Taxonomy version 1 (BCTTv1). Effectiveness of the incorporated BCTs in promoting PA behavior was assessed by a content analysis of the existing literature.
Results:
The most common BCTs were goal setting (behavior), action planning, review behavior goal(s), discrepancy between current behavior and goal, feedback on behavior, self-monitoring of behavior, and biofeedback. Fitbit Versa, Garmin Vívoactive 3, Apple Watch Series 3, Polar M600, and Xiaomi Amazfit Stratos 2 incorporated 17, 16, 12, 11, and 11 BCTs, respectively, which are proven to effectively promote PA.
Conclusions:
Wearables employ different numbers and combinations of BCTs, which might impact their effectiveness in improving PA. To promote PA by employing wearables, we encourage researchers to develop a taxonomy specifically designed to assess BCTs incorporated in wearables. We also encourage manufacturers to customize BCTs based on the targeted populations.
Evidence from multisensory body illusions suggests that body representations may be malleable, for instance, by embodying external objects. However, adjusting body representations to current task demands also implies that external objects become disembodied from the body representation if they are no longer required. In the current web-based study, we induced the embodiment of a two-dimensional (2D) virtual hand that could be controlled by active movements of a computer mouse or on a touchpad. Following initial embodiment, we probed for disembodiment by comparing two conditions: Participants either continued moving the virtual hand or they stopped moving and kept the hand still. Based on theoretical accounts that conceptualize body representations as a set of multisensory bindings, we expected gradual disembodiment of the virtual hand if the body representations are no longer updated through correlated visuomotor signals. In contrast to our prediction, the virtual hand was instantly disembodied as soon as participants stopped moving it. This result was replicated in two follow-up experiments. The observed instantaneous disembodiment might suggest that humans are sensitive to the rapid changes that characterize action and body in virtual environments, and hence adjust corresponding body representations particularly swiftly.
Previous research showed that priming effects in the affective misattribution procedure (AMP) are unaffected by direct warnings to avoid an influence of the primes. The present research examined whether a priming influence is diminished by task procedures that encourage accurate judgments of the targets. Participants were motivated to categorize the affective meaning of nonsense targets accurately by being made to believe that a true word was presented in each trial and by providing feedback on (allegedly) incorrect responses. This condition produced robust priming effects. Priming was however reduced and less reliable relative to more typical AMP conditions in which participants guessed the meaning of openly presented nonsense targets. Affective judgments of nonsense targets were not affected by advance knowledge of the response mapping during the priming phase, which argues against a response-priming explanation of AMP effects. These findings show that affective primes influence evaluative judgments even in conditions in which the motivation to provide accurate responses is high and a priming of motor responses is not possible. Priming effects were however weaker with high accuracy motivation, suggesting that a focus on accurate judgments is an effective strategy to control for an unwanted priming influence in the AMP.
A hallmark of habitual actions is that, once they are established, they become insensitive to changes in the values of action outcomes. In this article, we review empirical research that examined effects of posttraining changes in outcome values in outcome-selective Pavlovian-to-instrumental transfer (PIT) tasks. This review suggests that cue-instigated action tendencies in these tasks are not affected by weak and/or incomplete revaluation procedures (e.g., selective satiety) and substantially disrupted by a strong and complete devaluation of reinforcers. In a second part, we discuss two alternative models of a motivational control of habitual action: a default-interventionist framework and expected value of control theory. It is argued that the default-interventionist framework cannot solve the problem of an infinite regress (i.e., what controls the controller?). In contrast, expected value of control can explain control of habitual actions with local computations and feedback loops without (implicit) references to control homunculi. It is argued that insensitivity to changes in action outcomes is not an intrinsic design feature of habits but, rather, a function of the cognitive system that controls habitual action tendencies.
Previous research suggested that people prefer to administer unpleasant electric shocks to themselves rather than being left alone with their thoughts because engagement in thinking is an unpleasant activity. The present research examined this negative reinforcement hypothesis by giving participants a choice of distracting themselves with the generation of electric shock causing no to intense pain. Four experiments (N = 254) replicated the result that a large proportion of participants opted to administer painful shocks to themselves during the thinking period. However, they administered strong electric shocks to themselves even when an innocuous response option generating no or a mild shock was available. Furthermore, participants inflicted pain to themselves when they were assisted in the generation of pleasant thoughts during the waiting period, with no difference between pleasant versus unpleasant thought conditions. Overall, these results question that the primary motivation for the self-administration of painful shocks is avoidance of thinking. Instead, it seems that the self-infliction of pain was attractive for many participants, because they were curious about the shocks, their intensities, and the effects they would have on them.
What reaction stops revenge taking? Four experiments (total N = 191) examined this question where the victim of an interpersonal transgression could observe the offender's reaction (anger, sadness, pain, or calm) to a retributive noise punishment. We compared the punishment intensity selected by the participant before and after seeing the offender's reaction. Seeing the opponent in pain reduced subsequent punishment most strongly, while displays of sadness and verbal indications of suffering had no appeasing effect. Expression of anger about a retributive punishment did not increase revenge seeking relative to a calm reaction, even when the anger response was disambiguated as being angry with the punisher. It is concluded that the expression of pain is the most effective emotional display for the reduction of retaliatory aggression. The findings are discussed in light of recent research on reactive aggression and retributive justice.
We examined whether a voluntary response becomes associated with the (affective) meaning of intended response effects. Four experiments revealed that coupling a keypress with positive or negative consequences produces affective compatibility effects when the keypress has to be executed in response to positively or negatively evaluated stimulus categories. In Experiment 1, positive words were evaluated faster with a keypress that turned the words ON (versus OFF), whereas negative words were evaluated faster with a keypress that turned the words OFF (versus ON). Experiment 2 showed that this compatibility effect is reversed if an aversive tone is turned ON and OFF with keypresses. Experiment 3 revealed that keypresses acquire an affective meaning even when the association between the responses and their effects is variable and intentionally reconfigured before each trial. Experiment 4 used affective response effects to assess implicit ingroup favoritism, showing that the measure is sensitive to the valence of categories and not to the valence of exemplars. Results support the hypothesis that behavioral reactions become associated with the affective meaning of the intended response goal, which has important implications for the understanding and construction of implicit attitude measures.
This paper addresses the question of how the brain maintains a probabilistic body state estimate over time from a modeling perspective. The neural Modular Modality Frame (nMMF) model simulates such a body state estimation process by continuously integrating redundant, multimodal body state information sources. The body state estimate itself is distributed over separate, but bidirectionally interacting modules. nMMF compares the incoming sensory and present body state information across the interacting modules and fuses the information sources accordingly. At the same time, nMMF enforces body state estimation consistency across the modules. nMMF is able to detect conflicting sensory information and to consequently decrease the influence of implausible sensor sources on the fly. In contrast to the previously published Modular Modality Frame (MMF) model, nMMF offers a biologically plausible neural implementation based on distributed, probabilistic population codes. Besides its neural plausibility, the neural encoding has the advantage of enabling (a) additional probabilistic information flow across the separate body state estimation modules and (b) the representation of arbitrary probability distributions of a body state. The results show that the neural estimates can detect and decrease the impact of false sensory information, can propagate conflicting information across modules, and can improve overall estimation accuracy due to additional module interactions. Even bodily illusions, such as the rubber hand illusion, can be simulated with nMMF. We conclude with an outlook on the potential of modeling human data and of invoking goal-directed behavioral control.
Brain–computer interfaces (BCI) often rely on visual stimulation and feedback. Potential end-users with impaired vision, however, cannot use these BCIs efficiently and require a non-visual alternative. Both auditory and tactile paradigms have been developed but are often not sufficiently fast or accurate. Thus, it is particularly relevant to investigate if and how users can train and improve performance. We report data from 29 healthy participants who trained with a 4-choice tactile P300-BCI during five sessions. To identify potential training factors, we pre-post assessed the robustness of the BCI performance against increased workload in a dual task condition and determined the participants’ somatosensory sensitivity thresholds with a forced-choice intensity discrimination task. Accuracy (M = 79.2% to 92.0%) and tactually evoked P300 amplitudes increased significantly, confirming successful training. Pre-post somatosensory sensitivity increased, and workload decreased significantly, but results of the dual task condition remained inconclusive. The present study confirmed the previously reported feasibility and trainability of our tactile BCI paradigm within a multi-session design. Importantly, we provide first evidence of improvement in the somatosensory system as a potential mediator for the observed training effects.
Tactile stimulation is less frequently used than visual for brain-computer interface (BCI) control, partly because of limitations in speed and accuracy. Non-visual BCI paradigms, however, may be required for patients who struggle with vision dependent BCIs because of a loss of gaze control. With the present study, we attempted to replicate earlier results by Herweg et al. (2016), with several minor adjustments and a focus on training effects and usability. We invited 16 healthy participants and trained them with a 4-class tactile P300-based BCI in five sessions. Their main task was to navigate a virtual wheelchair through a 3D apartment using the BCI. We found significant training effects on information transfer rate (ITR), which increased from a mean of 3.10–9.50 bits/min. Further, both online and offline accuracies significantly increased with training from 65% to 86% and 70% to 95%, respectively. We found only a descriptive increase of P300 amplitudes at Fz and Cz with training. Furthermore, we report subjective data from questionnaires, which indicated a relatively high workload and moderate to high satisfaction. Although our participants have not achieved the same high performance as in the Herweg et al. (2016) study, we provide evidence for training effects on performance with a tactile BCI and confirm the feasibility of the paradigm.
This article gives an overview of possibilities for the assessment offacial behavior. With regard to validity, results from a longitudinal study of 36 depressed patients and nine controls as weil as often schizophrenic patients and their relatives will be referred to. These results are used to illustrate the following principles which have to be taken into account when studying facial behavior: a) communication strongly facilitates facial expression, b) activation of facial behavior follows the "principle of least effort", and c) the principle of individual specificity applies to the association of nonverbal behavior and mood states. Making allowance for these principles has, among others, consequences a) for situations or conditions under which to asses behavior (specifically conditions of communication), b) for data analysis (e.g., dealing with frequent and rare events), and c) for empirical or experimental strategies (e.g., aggregation of single-case longitudinal comparisons). From the results on facial behavior during depression it can be concluded that the nonverbal reaction tendencies of endogenous and neurotic depressed patients differ. Moreover, the differential behavioral pattems observed cast doubt on the assumption of a homogeneity of affects in depression. Taking into account the conditions which govern it, facial behavior has proved to be a valid and, especially, a differential indicator for pathoIogic affective states and their changes. Given the fact that a psychiatric illness generally incorporates emotional problems it is more than surprising that little attention has been paid to the systematic study of emotional behavior. Some of the reasons for this will be clarified in the following.
The ability to spell words correctly is a key competence for educational and professional achievement. Economical procedures are essential to identifying children with spelling problems as early as possible. Given the strong evidence showing that reading and spelling are based on the same orthographic knowledge, error-detection tasks (EDTs) could be considered such an economical procedure. Although EDTs are widely used in English-speaking countries, the few studies in German-speaking countries investigated only pupils in secondary school. The present study investigated N = 1,513 children in elementary school. We predicted spelling competencies (measured by dictation or gap-fill dictation) based on an EDT via linear regression. Error-detection abilities significantly predicted spelling competencies (R² between .509 and .679), indicating a strong connection. Predictive values in identifying children with poor spelling abilities with an EDT proved to be sufficient. Error detection for the assessment of spelling skills is therefore a valid instrument for transparent languages as well.
Task instructions modulate the attentional mode affecting the auditory MMN and the semantic N400
(2014)
Event-related potentials (ERPs) have been proven to be a useful tool to complement clinical assessment and to detect residual cognitive functions in patients with disorders of consciousness. These ERPs are of ten recorded using passive or unspecific instructions. Patient data obtained this way are then compared to data from healthy participants, which are usually recorded using active instructions. The present study investigates the effect of attentive modulations and particularly the effect of activevs. passive instruction on the ERP components mismatch negativity (MMN) and N400. A sample of 18 healthy participants listened to three auditory paradigms: anoddball, aword priming, and a sentence paradigm. Each paradigm was presented three times with different instructions: ignoring auditory stimuli, passive listening, and focused attention on the auditory stimuli. After each task, the participants indicated their subjective effort. The N400 decreased from the focused task to the passive task, and was extinct in the ignore task. The MMN exhibited higher amplitudes in the focused and passive task compared to the ignore task. The data indicate an effect of attention on the supratemporal component of the MMN. Subjective effort was equally high in the passive and focused tasks but reduced in the ignore task. We conclude that passive listening during EEG recording is stressful and attenuates ERPs, which renders the interpretation of the results obtained in such conditions difficult.
Background:
Accidents or neurodegenerative diseases like amyotrophic lateral sclerosis (ALS) can lead to progressing, extensive, and complete paralysis leaving patients aware but unable to communicate (locked-in state). Brain-computer interfaces (BCI) based on electroencephalography represent an important approach to establish communication with these patients. The most common BCI for communication rely on the P300, a positive deflection arising in response to rare events. To foster broader application of BCIs for restoring lost function, also for end-users with impaired vision, we explored whether there were specific time windows during the day in which a P300 driven BCI should be preferably applied.
Methods:
The present study investigated the influence of time of the day and modality (visual vs. auditory) on P300 amplitude and latency. A sample of 14 patients (end-users) with ALS and 14 healthy age matched volunteers participated in the study and P300 event-related potentials (ERP) were recorded at four different times (10, 12 am, 2, & 4 pm) during the day.
Results:
Results indicated no differences in P300 amplitudes or latencies between groups (ALS patients v. healthy participants) or time of measurement. In the auditory condition, latencies were shorter and amplitudes smaller as compared to the visual condition.
Conclusion:
Our findings suggest applicability of EEG/BCI sessions in patients with ALS throughout normal waking hours. Future studies using actual BCI systems are needed to generalize these findings with regard to BCI effectiveness/efficiency and other times of day.
Extinction is an important mechanism to inhibit initially acquired fear responses. There is growing evidence that the ventromedial prefrontal cortex (vmPFC) inhibits the amygdala and therefore plays an important role in the extinction of delay fear conditioning. To our knowledge, there is no evidence on the role of the prefrontal cortex in the extinction of trace conditioning up to now. Thus, we compared brain structures involved in the extinction of human delay and trace fear conditioning in a between-subjects-design in an fMRI study. Participants were passively guided through a virtual environment during learning and extinction of conditioned fear. Two different lights served as conditioned stimuli (CS); as unconditioned stimulus (US) a mildly painful electric stimulus was delivered. In the delay conditioning group (DCG) the US was administered with offset of one light (CS+), whereas in the trace conditioning group (TCG) the US was presented 4s after CS+ offset. Both groups showed insular and striatal activation during early extinction, but differed in their prefrontal activation. The vmPFC was mainly activated in the DCG, whereas the TCG showed activation of the dorsolateral prefrontal cortex (dlPFC) during extinction. These results point to different extinction processes in delay and trace conditioning. VmPFC activation during extinction of delay conditioning might reflect the inhibition of the fear response. In contrast, dlPFC activation during extinction of trace conditioning may reflect modulation of working memory processes which are involved in bridging the trace interval and hold information in short term memory.
Given its non-invasive nature, there is increasing interest in the use of transcutaneous vagus nerve stimulation (tVNS) across basic, translational and clinical research. Contemporaneously, tVNS can be achieved by stimulating either the auricular branch or the cervical bundle of the vagus nerve, referred to as transcutaneous auricular vagus nerve stimulation(VNS) and transcutaneous cervical VNS, respectively. In order to advance the field in a systematic manner, studies using these technologies need to adequately report sufficient methodological detail to enable comparison of results between studies, replication of studies, as well as enhancing study participant safety. We systematically reviewed the existing tVNS literature to evaluate current reporting practices. Based on this review, and consensus among participating authors, we propose a set of minimal reporting items to guide future tVNS studies. The suggested items address specific technical aspects of the device and stimulation parameters. We also cover general recommendations including inclusion and exclusion criteria for participants, outcome parameters and the detailed reporting of side effects. Furthermore, we review strategies used to identify the optimal stimulation parameters for a given research setting and summarize ongoing developments in animal research with potential implications for the application of tVNS in humans. Finally, we discuss the potential of tVNS in future research as well as the associated challenges across several disciplines in research and clinical practice.
Alerting signals often serve to reduce temporal uncertainty by predicting the time of stimulus onset. The resulting response time benefits have often been explained by facilitated translation of stimulus codes into response codes on the basis of established stimulus-response (S-R) links. In paradigms of masked S-R priming alerting signals also modulate response activation processes triggered by subliminally presented prime stimuli. In the present study we tested whether facilitation of visuo-motor translation processes due to alerting signals critically depends on established S-R links. Alerting signals resulted in significantly enhanced masked priming effects for masked prime stimuli that included and that did not include established S-R links fi.e., target vs. novel primes). Yet, the alerting-priming interaction was more pronounced for target than for novel primes. These results suggest that effects of alerting signals on masked priming are especially evident when S-R links between prime and target exist. At the same time, an alerting-priming interaction also for novel primes suggests that alerting signals also facilitate stimulus-response translation processes when masked prime stimuli provide action-trigger conditions in terms of programmed S-R links.
Visual saliency maps reflecting locations that stand out from the background in terms of their low-level physical features have proven to be very useful for empirical research on attentional exploration and reliably predict gaze behavior. In the present study we tested these predictions for socially relevant stimuli occurring in naturalistic scenes using eye tracking. We hypothesized that social features (i.e. human faces or bodies) would be processed preferentially over non-social features (i.e. objects, animals) regardless of their low-level saliency. To challenge this notion, we included three tasks that deliberately addressed non-social attributes. In agreement with our hypothesis, social information, especially heads, was preferentially attended compared to highly salient image regions across all tasks. Social information was never required to solve a task but was regarded nevertheless. More so, after completing the task requirements, viewing behavior reverted back to that of free-viewing with heavy prioritization of social features. Additionally, initial eye movements reflecting potentially automatic shifts of attention, were predominantly directed towards heads irrespective of top-down task demands. On these grounds, we suggest that social stimuli may provide exclusive access to the priority map, enabling social attention to override reflexive and controlled attentional processes. Furthermore, our results challenge the generalizability of saliency-based attention models.
What is left after an error? Towards a comprehensive account of goal-based binding and retrieval
(2023)
The cognitive system readily detects and corrects erroneous actions by establishing episodic bindings between representations of the acted upon stimuli and the intended correct response. If these stimuli are encountered again, they trigger the retrieval of the correct response. Thus, binding and retrieval efficiently pave the way for future success. The current study set out to define the role of the erroneous response itself and explicit feedback for the error during these processes of goal-based binding and retrieval. Two experiments showed robust and similar binding and retrieval effects with and without feedback and pointed towards sustained activation of the unbound, erroneous response. The third experiment confirmed that the erroneous response is more readily available than a neutral alternative. Together, the results demonstrate that episodic binding biases future actions toward success, guided primarily through internal feedback processes, while the erroneous response still leaves detectable traces in human action control.
A commentary on: Feeling the Conflict: The Crucial Role of Conflict Experience in Adaptationby Desender, K., Van Opstal, F., and Van den Bussche, E. (2014). Psychol. Sci. 25, 675–683. doi:10.1177/0956797613511468
Conflict adaptation in masked priming has recently been proposed to rely not on successful conflictresolution but rather on conflict experience (Desender et al., 2014). We re-assessed this proposal ina direct replication and also tested a potential confound due toconflict strength. The data supported this alternative view, but also failed to replicate basic conflict adaptation effects of the original studydespite considerable power.
When telling a lie, humans might engage in stronger monitoring of their behavior than when telling the truth. Initial evidence has indeed pointed towards a stronger recruitment of capacity-limited monitoring processes in dishonest than honest responding, conceivably resulting from the necessity to overcome automatic tendencies to respond honestly. Previous results suggested monitoring to be confined to response execution, however, whereas the current study goes beyond these findings by specifically probing for post-execution monitoring. Participants responded (dis)honestly to simple yes/no questions in a first task and switched to an unrelated second task after a response–stimulus interval of 0 ms or 1000 ms. Dishonest responses did not only prolong response times in Task 1, but also in Task 2 with a short response–stimulus interval. These findings support the assumption that increased monitoring for dishonest responses extends beyond mere response execution, a mechanism that is possibly tuned to assess the successful completion of a dishonest act.
In this article, I argue for four theses. First, libertarian and compatibilist accounts of moral responsibility agree that the capability of practical reason is the central feature of moral responsibility. Second, this viewpoint leads to a reasons-focused account of human behavior. Examples of human action discussed in debates about moral responsibility suggest that typical human actions are driven primarily by the agent’s subjective reasons and are sufficiently transparent for the agent. Third, this conception of self-transparent action is a questionable idealization. As shown by psychological research on self-assessment, motivated reasoning, and terror management theory, humans oftentimes have only a limited understanding of their conduct. Self-deception is rather the rule than the exception. Fourth, taking the limited self-transparency of practical reason seriously leads to a socially contextualized conception of moral responsibility.
This paper argues that applied ethics can itself be morally problematic. As illustrated by the case of Peter Singer’s criticism of social practice, morally loaded communication by applied ethicists can lead to protests, backlashes, and aggression. By reviewing the psychological literature on self-image, collective identity, and motivated reasoning three categories of morally problematic consequences of ethical criticism by applied ethicists are identified: serious psychological discomfort, moral backfiring, and hostile conflict. The most worrisome is moral backfiring: psychological research suggests that ethical criticism of people’s central moral convictions can reinforce exactly those attitudes. Therefore, applied ethicists unintentionally can contribute to a consolidation of precisely those social circumstances that they condemn to be unethical. Furthermore, I argue that the normative concerns raised in this paper are not dependent on the commitment to one specific paradigm in moral philosophy. Utilitarianism, Aristotelian virtue ethics, and Rawlsian contractarianism all provide sound reasons to take morally problematic consequences of ethical criticism seriously. Only the case of deontological ethics is less clear-cut. Finally, I point out that the issues raised in this paper provide an excellent opportunity for further interdisciplinary collaboration between applied ethics and social sciences. I also propose strategies for communicating ethics effectively.
Objectives
The spectrum of giant cell arteritis (GCA) and polymyalgia rheumatica (PMR) represents highly inflammatory rheumatic diseases. Patients mostly report severe physical impairment. Possible consequences for mental health have been scarcely studied. The aim of this study was to investigate psychological well-being in the context of GCA and PMR.
Methods
Cross-sectional study with N = 100 patients with GCA and/or PMR (GCA-PMR). Patient-reported outcomes (PROs) were measured using the Short Form 36 Version 2 (SF-36v2) and visual analog scale (VAS) assessment. Moreover, the Patient Health Questionnaire 9 (PHQ-9) was used in 35 of 100 patients to detect depression. To compare PROs with physician assessment, VAS was also rated from physician perspective. To assess a possible association with inflammation itself, serological parameters of inflammation (C-reactive protein [CRP], erythrocyte sedimentation rate [ESR]) were included.
Results
In all scales of the SF-36v2 except General Health (GH) and in the physical and mental sum score (PCS, MCS), a significant impairment compared to the German reference collective was evident (MCS: d = 0.533, p < 0.001). In the PHQ-9 categorization, 14 of the 35 (40%) showed evidence of major depression disorder. VAS Patient correlated significantly with PHQ-9 and SF-36 in all categories, while VAS Physician showed only correlations to physical categories and not in the mental dimensions. Regarding inflammatory parameters, linear regression showed CRP to be a complementary significant positive predictor of mental health subscale score, independent of pain.
Conclusion
PRO show a relevant impairment of mental health up to symptoms of major depression disorder. The degree of depressive symptoms is also distinctly associated with the serological inflammatory marker CRP.
In this article, we explain and demonstrate how to model norm scores with the cNORM package in R. This package is designed specifically to determine norm scores when the latent ability to be measured covaries with age or other explanatory variables such as grade level. The mathematical method used in this package draws on polynomial regression to model a three-dimensional hyperplane that smoothly and continuously captures the relation between raw scores, norm scores and the explanatory variable. By doing so, it overcomes the typical problems of classical norming methods, such as overly large age intervals, missing norm scores, large amounts of sampling error in the subsamples or huge requirements with regard to the sample size. After a brief introduction to the mathematics of the model, we describe the individual methods of the package. We close the article with a practical example using data from a real reading comprehension test.
In a study intended to replicate and extend the findings from a recent experiment by Schneider and Bjorklund (1992), the expert/novice paradigm was used with second- and fourth-grade children in a sort/recall task. Children were classified as experts or novices for their knowledge of baseball, then given two sort/recall tasks, with a list consisting of either baseball or nonbaseball terms. Experts recalled more than novices on the baseball list only. While both groups used organizational strategies at sorting on the nonbaseball list, experts were marginally more strategic than novices on the baseball list, and no differences were found between the groups on either list for clustering. Baseball experts used more adultlike categories, suggesting that their enhanced levels of recall were attributed in part to strategy use, although there was also evidence that most of the substantial recall difference between the groups was attributed to item-specific effects associated with a more elaborated knowledge base. A second experiment using fifth-grade children on a multitrial sort/recall task using the baseball list also found increased recall by experts, and also found evidence of strategic behavior at the sort phase for trials 3 and 4.
Since exposure therapy for anxiety disorders incorporates extinction of contextual anxiety, relapses may be due to reinstatement processes. Animal research demonstrated more stable extinction memory and less anxiety relapse due to vagus nerve stimulation (VNS). We report a valid human three-day context conditioning, extinction and return of anxiety protocol, which we used to examine effects of transcutaneous VNS (tVNS). Seventy-five healthy participants received electric stimuli (unconditioned stimuli, US) during acquisition (Day1) when guided through one virtual office (anxiety context, CTX+) but never in another (safety context, CTX−). During extinction (Day2), participants received tVNS, sham, or no stimulation and revisited both contexts without US delivery. On Day3, participants received three USs for reinstatement followed by a test phase. Successful acquisition, i.e. startle potentiation, lower valence, higher arousal, anxiety and contingency ratings in CTX+ versus CTX−, the disappearance of these effects during extinction, and successful reinstatement indicate validity of this paradigm. Interestingly, we found generalized reinstatement in startle responses and differential reinstatement in valence ratings. Altogether, our protocol serves as valid conditioning paradigm. Reinstatement effects indicate different anxiety networks underlying physiological versus verbal responses. However, tVNS did neither affect extinction nor reinstatement, which asks for validation and improvement of the stimulation protocol.
In everyday life, multiple sensory channels jointly trigger emotional experiences and one channel may alter processing in another channel. For example, seeing an emotional facial expression and hearing the voice's emotional tone will jointly create the emotional experience. This example, where auditory and visual input is related to social communication, has gained considerable attention by researchers. However, interactions of visual and auditory emotional information are not limited to social communication but can extend to much broader contexts including human, animal, and environmental cues. In this article, we review current research on audiovisual emotion processing beyond face-voice stimuli to develop a broader perspective on multimodal interactions in emotion processing. We argue that current concepts of multimodality should be extended in considering an ecologically valid variety of stimuli in audiovisual emotion processing. Therefore, we provide an overview of studies in which emotional sounds and interactions with complex pictures of scenes were investigated. In addition to behavioral studies, we focus on neuroimaging, electro- and peripher-physiological findings. Furthermore, we integrate these findings and identify similarities or differences. We conclude with suggestions for future research.