Refine
Has Fulltext
- yes (24) (remove)
Is part of the Bibliography
- yes (24)
Year of publication
Document Type
- Journal article (14)
- Doctoral Thesis (10)
Keywords
- EEG (24) (remove)
Institute
- Institut für Psychologie (24) (remove)
In dieser Dissertation untersuchten wir die neuronalen Korrelate des Training-Effektes einer auditorischen P300 Gehirn-Computer Schnittstelle mittels fMRI Analyse in einem prä-post Design mit zehn gesunden Testpersonen. Wir wiesen in drei Trainings-sitzungen einen Trainingseffekt in der EEG-Analyse der P300 Welle nach und fanden entsprechende Kontraste in einer prä-post Analyse von fMRI Daten, wobei in allen fünf Sitzungen das gleiche Paradigma verwendet wurde. In der fMRI Analyse fanden wir fol-gende Ergebnisse: in einem Target-/ Nichttarget Kontrast zeigte sich verstärkte Aktivie-rung in Generatorregionen der P300 Welle (temporale und inferiore frontale Regionen) und interessanterweise auch in motorassoziierten Arealen, was höhere kognitiver Pro-zesse wie Aufmerksamkeitslenkung und Arbeitsspeicher widerspiegeln könnte. Der Kon-trast des Trainingseffektes zeigte nach dem Training einen stärkeren Rebound Effekt im Sinne einer verstärkten Aktivierung in Generatorregionen der P300 Welle, was eine ver-besserte Erkennung und Prozessierung von Target-Stimuli reflektieren könnte. Eine Ab-nahme von Aktivierung in frontalen Arealen in diesem Kontrast könnte durch effizientere Abläufe kognitiver Prozesse und des Arbeitsgedächtnis erklärt werden.
In our current obesogenic environment, exposure to visual food-cues can easily lead to craving and overeating because short-term, pleasurable effects of food intake dominate over the anticipated long-term adverse effects such as weight gain and associated health problems. Here we contrasted these two conditions during food-cue presentation while acquiring event-related potentials (ERPs) and subjective craving ratings. Female participants (n = 25) were presented with either high-calorie (HC) or low-calorie (LC) food images under instructions to imagine either immediate (NOW) or long-term effects (LATER) of consumption. On subjective ratings for HC foods, the LATER perspective reduced cravings as compared to the NOW perspective. For LC foods, by contrast, craving increased under the LATER perspective. Early ERPs (occipital N1, 150-200 ms) were sensitive to food type but not to perspective. Late ERPs (late positive potential, LPP, 350-550 ms) were larger in the HC-LATER condition than in all other conditions, possibly indicating that a cognitive focus on negative long-term consequences induced negative arousal. This enhancement for HC-LATER attenuated to the level of the LC conditions during the later slow wave (550-3000 ms), but amplitude in the HC-NOW condition was larger than in all other conditions, possibly due to a delayed appetitive response. Across all conditions, LPP amplitudes were positively correlated with self-reported emotional eating. In sum, results reveal that regulation effects are secondary to an early attentional analysis of food type and dynamically evolve over time. Adopting a long-term perspective on eating might promote a healthier food choice across a range of food types.
The present dissertation aims to shed light on different mechanisms of socio-emotional feedback in social decision-making situations. The objective is to evaluate emotional facial expressions as feedback stimuli, i.e., responses of interaction partners to certain social decisions. In addition to human faces, artificial emojis are also examined due to their relevance for modern digital communication. Previous research on the influence of emotional feedback suggests that a person's behavior can be effectively reinforced by rewarding stimuli. In the context of this dissertation, the differences in the feedback processing of human photographs and emojis, but also the evaluation of socially expected versus socially unexpected feedback were examined in detail in four studies. In addition to behavioral data, we used the electroencephalogram (EEG) in all studies to investigate neural correlates of social decision-making and emotional feedback.
As the central paradigm, all studies were based on a modified ultimatum game. The game is structured as follows: there is a so-called proposer who holds a specific amount of money (e.g., 10 cents) and offers the responder a certain amount (e.g., 3 cents). The responder then decides whether to accept or reject the offer. In the version of the ultimatum game presented here, different types of proposers are introduced. After the participants have accepted or rejected in the role of the responder, the different proposers react to the participant’s decision with specific emotional facial expressions. Different feedback patterns are used for the individual experiments conducted in the course of this dissertation.
In the first study, we investigated the influence of emotional feedback on decision-making in the modified version of the ultimatum game. We were able to show that a proposer who responds to the acceptance of an offer with a smiling face achieves more accepted offers overall than a control proposer who responds to both accepted and rejected offers with a neutral facial expression. Consequently, the smile served as a positive reinforcement. Similarly, a sad expression in response to a rejected offer also resulted in higher acceptance rates as compared to the control identity, which could be considered an expression of compassion for that proposer. On a neuronal level, we could show that there are differences between simply looking at negative emotional stimuli (i.e., sad and angry faces) and their appearance as feedback stimuli after rejected offers in the modified ultimatum game. The so-called feedback-related negativity was reduced (i.e., more positive) when negative emotions appeared as feedback from the proposers. We argued that these findings might show that the participants wanted to punish the proposers by rejecting an offer for its unfairness and therefore the negative feedback met their expectations. The altered processing of negative emotional facial expressions in the ultimatum game could therefore indicate that the punishment is interpreted as successful. This includes the expectation that the interaction partner will change his behavior in the future and eventually make fairer offers.
In the second study we wanted to show that smiling and sad emojis as feedback stimuli in the modified ultimatum game can also lead to increased acceptance rates. Contrary to our assumptions, this effect could not be observed. At the neural level as well, the findings did not correspond to our assumptions and differed strongly from those of the first study. One finding, however, was that the neural P3 component showed how the use of emojis as feedback stimuli particularly characterizes certain types of proposers. This is supported by the fact that the P3 is increased for the proposer who rewards an acceptance with a smile as well as for the proposer who reacts to rejection with a sad emoji compared to the neutral control proposer.
The third study examined the discrepancy between the findings of the first and second study. Accordingly, both humans and emojis representing the different proposers were presented in the ultimatum game. In addition, emojis were selected that showed a higher similarity to known emojis from common messenger services compared to the second study. We were able to replicate that the proposers in the ultimatum game, who reward an acceptance of the offer with a smile, led to an increased acceptance rate compared to the neutral control proposers. This difference is independent of whether the proposers are represented by emojis or human faces. With regard to the neural correlates, we were able to demonstrate that emojis and human faces differ strongly in their neural processing. Emojis showed stronger activation than human faces in the face-processing N170 component, the feedback-related negativity and the P3 component. We concluded that the results of the N170 and feedback-related negativity could indicate a signal for missing social information of emojis compared to faces. The increased P3 amplitude for emojis might imply that emojis appear unexpectedly as reward stimuli in a social decision task compared to human faces.
The last study of this project dealt with socially unexpected feedback. In comparison to the first three studies, new proposer identities were implemented. In particular, the focus was on a proposer who reacted to the rejection of an offer unexpectedly with a smile and to the acceptance with a neutral facial expression. According to the results, participants approach this unexpected smile through increased rejection, although it is accompanied by financial loss. In addition, as reported in studies one and three, we were able to show that proposers who respond to the acceptance of an offer with a smiling face and thus meet the expectations of the participants have higher offer acceptance rates than the control proposer. At the neuronal level, especially the feedback from the socially unexpected proposer led to an increased P3 amplitude, which indicates that smiling after rejection is attributed a special subjective importance.
The experiments provide new insights into the social influence through emotional feedback and the processing of relevant social cues. Due to the conceptual similarity of the studies, it was possible to differentiate between stable findings and potentially stimulus-dependent deviations, thus creating a well-founded contribution to the current research. Therefore, the novel paradigm presented here, and the knowledge gained from it could also play an important role in the future for clinical questions dealing with limited social competencies.
We investigated the influence of mental imagery expertise in 15 pen and paper role-players as an expert group compared to the gender-matched control group of computer role-players in the difficult Vandenberg and Kuse mental rotation task. In this task, the participants have to decide which two of four rotated figures match the target figure. The dependent measures were performance speed and accuracy. In our exploratory investigation, we further examined midline frontal theta band activation, parietal alpha band activation, and parietal alpha band asymmetry in EEG as indicator for the chosen rotation strategy. Additionally, we explored the gender influence on performance and EEG activation, although a very small female sample section was given. The expected gender difference concerning performance accuracy was negated by expertise in pen and paper role-playing women, while the gender-specific difference in performance speed was preserved. Moreover, gender differences concerning electro-cortical measures revealed differences in rotation strategy, with women using top-down strategies compared to men, who were using top-down strategies and active inhibition of associative cortical areas. These strategy uses were further moderated by expertise, with higher expertise leading to more pronounced activation patters, especially during successful performance. However, due to the very limited sample size, the findings of this explorative study have to be interpreted cautiously.
The effect of inherently threatening contexts on visuocortical engagement to conditioned threat
(2023)
Fear and anxiety are crucial for adaptive responding in life‐threatening situations. Whereas fear is a phasic response to an acute threat accompanied by selective attention, anxiety is characterized by a sustained feeling of apprehension and hypervigilance during situations of potential threat. In the current literature, fear and anxiety are usually considered mutually exclusive, with partially separated neural underpinnings. However, there is accumulating evidence that challenges this distinction between fear and anxiety, and simultaneous activation of fear and anxiety networks has been reported. Therefore, the current study experimentally tested potential interactions between fear and anxiety. Fifty‐two healthy participants completed a differential fear conditioning paradigm followed by a test phase in which the conditioned stimuli were presented in front of threatening or neutral contextual images. To capture defense system activation, we recorded subjective (threat, US‐expectancy), physiological (skin conductance, heart rate) and visuocortical (steady‐state visual evoked potentials) responses to the conditioned stimuli as a function of contextual threat. Results demonstrated successful fear conditioning in all measures. In addition, threat and US‐expectancy ratings, cardiac deceleration, and visuocortical activity were enhanced for fear cues presented in threatening compared with neutral contexts. These results are in line with an additive or interactive rather than an exclusive model of fear and anxiety, indicating facilitated defensive behavior to imminent danger in situations of potential threat.
This study aimed at evaluating the performance of the Studentized Continuous Wavelet Transform (t-CWT) as a method for the extraction and assessment of event-related brain potentials (ERP) in data from a single subject. Sensitivity, specificity, positive (PPV) and negative predictive values (NPV) of the t-CWT were assessed and compared to a variety of competing procedures using simulated EEG data at six low signal-to-noise ratios. Results show that the t-CWT combines high sensitivity and specificity with favorable PPV and NPV. Applying the t-CWT to authentic EEG data obtained from 14 healthy participants confirmed its high sensitivity. The t-CWT may thus be well suited for the assessment of weak ERPs in single-subject settings.
Gambling is a popular activity in Germany, with 40% of a representative sample reporting having gambled at least once in the past year (Bundeszentrale für gesundheitliche Aufklärung, 2014). While the majority of gamblers show harmless gambling behavior, a subset develops serious problems due to their gambling, affecting their psychological well-being, social life and work. According to recent estimates, up to 0.8% of the German population are affected by such pathological gambling. People in general and pathological gamblers in particular show several cognitive distortions, that is, misconceptions about the chances of winning and skill involvement, in gambling. The current work aimed at elucidating the biopsychological basis of two such kinds of cognitive distortions, the illusion of control and the gambler’s and hot hand fallacies, and their modulation by gambling problems. Therefore, four studies were conducted assessing the processing of near outcomes (used as a proxy for the illusion of control) and outcome sequences (used as a proxy for the gambler’s and hot hand fallacies) in samples of varying degrees of gambling problems, using a multimethod approach.
The first study analyzed the processing and evaluation of near outcomes as well as choice behavior in a wheel of fortune paradigm using electroencephalography (EEG). To assess the influence of gambling problems, a group of problem gamblers was compared to a group of controls. The results showed that there were no differences in the processing of near outcomes between the two groups. Near compared to full outcomes elicited smaller P300 amplitudes. Furthermore, at a trend level, the choice behavior of participants showed signs of a pattern opposite to the gambler’s fallacy, with longer runs of an outcome color leading to increased probabilities of choosing this color again on the subsequent trial. Finally, problem gamblers showed smaller feedback-related negativity (FRN) amplitudes relative to controls.
The second study also targeted the processing of near outcomes in a wheel of fortune paradigm, this time using functional magnetic resonance imaging and a group of participants with varying degrees of gambling problems. The results showed increased activity in the bilateral superior parietal cortex following near compared to full outcomes.
The third study examined the peripheral physiology reactions to near outcomes in the wheel of fortune. Heart period and skin conductance were measured while participants with varying degrees of gambling problems played on the wheel of fortune. Near compared to full outcomes led to increased heart period duration shortly after the outcome. Furthermore, heart period reactions and skin conductance responses (SCRs) were modulated by gambling problems. Participants with high relative to low levels of gambling problems showed increased SCRs to near outcomes and similar heart period reactions to near outcomes and full wins.
The fourth study analyzed choice behavior and sequence effects in the processing of outcomes in a coin toss paradigm using EEG in a group of problem gamblers and controls. Again, problem gamblers showed generally smaller FRN amplitudes compared to controls. There were no differences between groups in the processing of outcome sequences. The break of an outcome streak led to increased power in the theta frequency band. Furthermore, the P300 amplitude was increased after a sequence of previous wins. Finally, problem gamblers compared to controls showed a trend of switching the outcome symbol relative to the previous outcome symbol more often.
In sum, the results point towards differences in the processing of near compared to full outcomes in brain areas and measures implicated in attentional and salience processes. The processing of outcome sequences involves processes of salience attribution and violation of expectations. Furthermore, problem gamblers seem to process near outcomes as more win-like compared to controls. The results and their implications for problem gambling as well as further possible lines of research are discussed.
Previous EEG research only investigated one stage ultimatum games (UGs). We investigated the influence of a second bargaining stage in an UG concerning behavioral responses, electro-cortical correlates and their moderations by the traits altruism, anger, anxiety, and greed in 92 participants. We found that an additional stage led to more rejection in the 2-stage UG (2SUG) and that increasing offers in the second stage compared to the first stage led to more acceptance. The FRN during a trial was linked to expectance evaluation concerning the fairness of the offers, while midfrontal theta was a marker for the needed cognitive control to overcome the respective default behavioral pattern. The FRN responses to unfair offers were more negative for either low or high altruism in the UG, while high trait anxiety led to more negative FRN responses in the first stage of 2SUG, indicating higher sensitivity to unfairness. Accordingly, the mean FRN response, representing the trait-like general electrocortical reactivity to unfairness, predicted rejection in the first stage of 2SUG. Additionally, we found that high trait anger led to more rejections for unfair offer in 2SUG in general, while trait altruism led to more rejection of unimproving unfair offers in the second stage of 2SUG. In contrast, trait anxiety led to more acceptance in the second stage of 2SUG, while trait greed even led to more acceptance if the offer was worse than in the stage before. These findings suggest, that 2SUG creates a trait activation situation compared to the UG.
Ausgangspunkt für diese Arbeit war die Diskrepanz zwischen der vielfach belegten Schwierigkeit schizophrener Patienten bei der Dekodierung emotionaler Gesichtsausdrücke und dem mangelhaften Wissen über die hierfür verantwortlichen Prozesse. In der Literatur der letzten Jahre gab es einige viel versprechende Ergebnisse, die nahe legten, dass mit dem Elektroenzephalogramm (EEG) sowohl die Verarbeitung von Gesichtern, als auch der Mimik messbar ist. Somit wäre das EEG eine geeignete Methode den Prozess der Emotionsdekodierung bei schizophrenen Patienten zu untersuchen. Diese Arbeit untersucht folgende zwei Hauptfragestellungen. Erstens, wie lassen sich die für die Verarbeitung von Gesichtern und das Erkennen von emotionalen Gesichtsausdrücken verantwortlichen kognitiven Prozesse mit Hilfe ereigniskorrelierter Potentiale des EEGs reliabel messen? Zweitens, sind diese Prozesse bei schizophrenen Patienten im Vergleich zu gesunden Probanden beeinträchtigt? Zur Klärung der ersten Fragestellung wurden drei Stichproben gesunder Personen untersucht. Es zeigte sich in allen drei Untersuchungen, dass sich die Verarbeitung von Gesichtern im Vergleich zu Kontrollreizen in einer negativen Komponente um 170 ms über temporalen Elektrodenpositionen widerspiegelt (Gesichterpeak, N170). Die N170 konnte mit dem Quellenlokalisationsprogramm LORETA unter anderem im Gyrus Fusiformis, der entsprechenden Hirnregion für die Gesichtsverarbeitung, lokalisiert werden. Für die Dekodierung emotionaler Gesichtsausdrücke konnten keine wiederholbaren Effekte nachgewiesen werden. Im Weiteren wurde die Gesichtsverarbeitung bei schizophrenen Patienten untersucht. 22 als schizophren diagnostizierte Patienten wurden mit einer nach dem Alter, dem Geschlecht und dem Bildungsstatus angepassten Kontrollgruppe verglichen. In dieser Auswertung deutete sich bei schizophrenen Patienten ein Defizit in den frühen Verarbeitungsschritten von Gesichtern an. Dieses Ergebnis wurde in dieser Art noch nicht gezeigt und reiht sich ein in Studien, die sowohl strukturelle Veränderungen in den für die Gesichtsverarbeitung wesentlichen Hirnregionen bei schizophrenen Patienten zeigen konnten als auch ein allgemeines Defizit früher visueller Verarbeitung nahe legen.
Spontaneous brain activity builds the foundation for human cognitive processing during external demands. Neuroimaging studies based on functional magnetic resonance imaging (fMRI) identified specific characteristics of spontaneous (intrinsic) brain dynamics to be associated with individual differences in general cognitive ability, i.e., intelligence. However, fMRI research is inherently limited by low temporal resolution, thus, preventing conclusions about neural fluctuations within the range of milliseconds. Here, we used resting-state electroencephalographical (EEG) recordings from 144 healthy adults to test whether individual differences in intelligence (Raven’s Advanced Progressive Matrices scores) can be predicted from the complexity of temporally highly resolved intrinsic brain signals. We compared different operationalizations of brain signal complexity (multiscale entropy, Shannon entropy, Fuzzy entropy, and specific characteristics of microstates) regarding their relation to intelligence. The results indicate that associations between brain signal complexity measures and intelligence are of small effect sizes (r ∼ 0.20) and vary across different spatial and temporal scales. Specifically, higher intelligence scores were associated with lower complexity in local aspects of neural processing, and less activity in task-negative brain regions belonging to the default-mode network. Finally, we combined multiple measures of brain signal complexity to show that individual intelligence scores can be significantly predicted with a multimodal model within the sample (10-fold cross-validation) as well as in an independent sample (external replication, N = 57). In sum, our results highlight the temporal and spatial dependency of associations between intelligence and intrinsic brain dynamics, proposing multimodal approaches as promising means for future neuroscientific research on complex human traits.
Frontal asymmetry, a construct invented by Richard Davidson, linking positive and negative valence as well as approach and withdrawal motivation to lateralized frontal brain activation has been investigated for over thirty years. The frontal activation patterns described as relevant were measured via alpha-band frequency activity (8-13 Hz) as a measurement of deactivation in electroencephalography (EEG) for homologous electrode pairs, especially for the electrode position F4/ F3 to account for the frontal relative lateralized brain activation.
Three different theories about frontal activation patterns linked to motivational states were investigated in two studies. The valence theory of Davidson (1984; 1998a; 1998b) and its extension to the motivational direction theory by Harmon-Jones and Allen (1998) refers to the approach motivation with relative left frontal brain activity (indicated by relative right frontal alpha activity) and to withdrawal motivation with relative right frontal brain activation (indicated by relative left frontal alpha activity). The second theory proposed by Hewig and colleagues (2004; 2005; 2006) integrates the findings of Davidson and Harmon – Jones and Allen with the reinforcement sensitivity theory of Jeffrey A. Gray (1982, 1991). Hewig sees the lateralized frontal approach system and withdrawal system proposed by Davidson as subsystems of the behavioral activation system proposed by Gray and bilateral frontal activation as a biological marker for the behavioral activation system. The third theory investigated in the present studies is the theory from Wacker and colleagues (2003; 2008; 2010) where the frontal asymmetrical brain activation patterns are linked to the revised reinforcement sensitivity theory of Gray and McNaughton (2000). Here, right frontal brain activity (indicated by lower relative right frontal alpha activity) accounts for conflict, behavioral inhibition and activity of the revised behavioral inhibition system, while left frontal brain activation (indicated by lower relative left frontal alpha activity) stands for active behavior and the activity of the revised behavioral activation system as well as the activation of the revised flight fight freezing system. In order to investigate these three theories, a virtual reality T-maze paradigm was introduced to evoke motivational states in the participants, offering the opportunity to measure frontal brain activation patterns via EEG and behavior simultaneously in the first study. In the second study the virtual reality paradigm was additionally compared to mental imagery and a movie paradigm, two well-known state inducing paradigms in the research field of frontal asymmetry.
In the two studies, there was confirming evidence for the theory of Hewig and colleages (2004; 2005; 2006), showing higher bilateral frontal activation for active behavior and lateralized frontal activation patterns for approach (left frontal brain activation) and avoidance (right frontal brain activation) behavior. Additionally a limitation for the capability model of anterior brain asymmetry proposed by Coan and colleagues (2006), where the frontal asymmetry should be dependent on the relevant traits driving the frontal asymmetry pattern if a relevant situation occurs, could be found. As the very intense virtual reality paradigm did not lead to a difference of frontal brain activation patterns compared to the mental imagery paradigm or the movie paradigm for the traits of the participants, the trait dependency of the frontal asymmetry in a relevant situation might not be given, if the intensity of the situation exceeds a certain level. Nevertheless there was an influence of the traits in the virtual reality T-maze paradigm, because the shown behavior in the maze was trait-dependent.
The implications of the findings are multifarious, leading from possible objective personality testing via diversification of the virtual reality paradigm to even clinical implications for depression treatments based on changes in the lateralized frontal brain activation patterns for changes in the motivational aspects, but also for changes in bilateral frontal brain activation when it comes to the drive and preparedness for action in patients. Finally, with the limitation of the capability model, additional variance in the different findings about frontal asymmetry can be explained by taking the intensity of a state manipulation into account.
In dieser EEG Untersuchung wurde der Einfluss von zuvor präsentierten Abfolgen wütender und neutraler Gesichtsausdrücke auf die neurokognitive Verarbeitung eines aktuell wahrgenommenen Gesichts unter Berücksichtigung des modulierenden Effekts der individuellen Ängstlichkeit, sowie eines sozial stressenden Kontextes und einer erhöhten kognitiven Auslastung erforscht.
Die Ergebnisse lieferten bereits auf der Ebene der basalen visuellen Gesichtsanalyse Belege für eine parallele Verarbeitung und Integration von strukturellen und emotionalen Gesichtsinformationen. Zudem konnte schon in dieser frühen Phase ein genereller kontextueller Einfluss von Gesichtssequenzen auf die kognitive Gesichtsverarbeitung nachgewiesen werden, welcher sogar in späteren Phasen der kognitiven Verarbeitung noch zunahm.
Damit konnte nachgewiesen werden, dass die zeitliche Integration, d.h. die spezifische Abfolge wahrgenommener Gesichter eine wichtige Rolle für die kognitive Evaluation des aktuell perzipierten Gesichtes spielt. Diese Ergebnisse wurden zudem in einer Revision des Gesichtsverarbeitungsmodells von Haxby und Kollegen verordnet und in einer sLORETA Analyse dargestellt.
Die Befunde zur individuellen Ängstlichkeit und kognitiven Auslastung bestätigten außerdem die Attentional Control Theorie und das Dual Mechanisms of Control Modell.
Anxiety is characterized by anxious anticipation and heightened vigilance to uncertain threat. However, if threat is not reliably indicated by a specific cue, the context in which threat was previously experienced becomes its best predictor, leading to anxiety. A suitable means to induce anxiety experimentally is context conditioning: In one context (CTX+), an unpredictable aversive stimulus (US) is repeatedly presented, in contrast to a second context (CTX−), in which no US is ever presented. In this EEG study, we investigated attentional mechanisms during acquisition and extinction learning in 38 participants, who underwent a context conditioning protocol. Flickering video stimuli (32 s clips depicting virtual offices representing CTX+/−) were used to evoke steady‐state visual evoked potentials (ssVEPs) as an index of visuocortical engagement with the contexts. Analyses of the electrocortical responses suggest a successful induction of the ssVEP signal by video presentation in flicker mode. Furthermore, we found clear indices of context conditioning and extinction learning on a subjective level, while cortical processing of the CTX+ was unexpectedly reduced during video presentation. The differences between CTX+ and CTX− diminished during extinction learning. Together, these results indicate that the dynamic sensory input of the video presentation leads to disruptions in the ssVEP signal, which is greater for motivationally significant, threatening contexts.
Feedback efficiency and training effects during alpha band modulation over the sensorimotor cortex
(2015)
Neural oscillations can be measured by electroencephalography (EEG) and these oscillations can be characterized by their frequency, amplitude and phase. The mechanistic properties of neural oscillations and their synchronization are able to explain various aspects of many cognitive functions such as motor control, memory, attention, information transfer across brain regions, segmentation of the sensory input and perception (Arnal and Giraud, 2012). The alpha band frequency is the dominant oscillation in the human brain. This oscillatory activity is found in the scalp EEG at frequencies around 8-13 Hz in all healthy adults (Makeig et al., 2002) and considerable interest has been generated in exploring EEG alpha oscillations with regard to their role in cognitive (Klimesch et al., 1993; Hanselmayr et al., 2005), sensorimotor (Birbaumer, 2006; Sauseng et al., 2009) and physiological (Lehmann, 1971; Niedermeyer, 1997; Kiyatkin, 2010) aspects of human life. The ability to voluntarily regulate the alpha amplitude can be learned with neurofeedback training and offers the possibility to control a brain-computer interface (BCI), a muscle independent interaction channel. BCI research is predominantly focused on the signal processing, the classification and the algorithms necessary to translate brain signals into control commands than on the person interacting with the technical system. The end-user must be properly trained to be able to successfully use the BCI and factors such as task instructions, training, and especially feedback can therefore play an important role in learning to control a BCI (Neumann and Kübler, 2003; Pfurtscheller et al., 2006, 2007; Allison and Neuper, 2010; Friedrich et al., 2012; Kaufmann et al., 2013; Lotte et al., 2013).
The main purpose of this thesis was to investigate how end-users can efficiently be trained to perform alpha band modulation recorded over their sensorimotor cortex. The herein presented work comprises three studies with healthy participants and participants with schizophrenia focusing on the effects of feedback and training time on cortical activation patterns and performance. In the first study, the application of a realistic visual feedback to support end-users in developing a concrete feeling of kinesthetic motor imagery was tested in 2D and 3D visualization modality during a single training session. Participants were able to elicit the typical event-related desynchronisation responses over sensorimotor cortex in both conditions but the most significant decrease in the alpha band power was obtained following the three-dimensional realistic visualization. The second study strengthen the hypothesis that an enriched visual feedback with information about the quality of the input signal supports an easier approach for motor imagery based BCI control and can help to enhance performance. Significantly better performance levels were measurable during five online training sessions in the groups with enriched feedback as compared to a conventional simple visual feedback group, without significant differences in performance between the unimodal (visual) and multimodal (auditory–visual) feedback modality. Furthermore, the last study, in which people with schizophrenia participated in multiple sessions with simple feedback, demonstrated that these patients can learn to voluntarily regulate their alpha band. Compared to the healthy group they required longer training times and could not achieve performance levels as high as the control group. Nonetheless, alpha neurofeedback training lead to a constant increase of the alpha resting power across all 20 training session.
To date only little is known about the effects of feedback and training time on BCI performance and cortical activation patterns. The presented work contributes to the evidence that healthy individuals can benefit from enriched feedback: A realistic presentation can support participants in getting a concrete feeling of motor imagery and enriched feedback, which instructs participants about the quality of their input signal can give support while learning to control the BCI. This thesis demonstrates that people with schizophrenia can learn to gain control of their alpha oscillations recorded over the sensorimotor cortex when participating in sufficient training sessions. In conclusion, this thesis improved current motor imagery BCI feedback protocols and enhanced our understanding of the interplay between feedback and BCI performance.
Background: Since the replication crisis, standardization has become even more important in psychological science and neuroscience. As a result, many methods are being reconsidered, and researchers’ degrees of freedom in these methods are being discussed as a potential source of inconsistencies across studies.
New Method: With the aim of addressing these subjectivity issues, we have been working on a tutorial-like EEG (pre-)processing pipeline to achieve an automated method based on the semi-automated analysis proposed by Delorme and Makeig.
Results: Two scripts are presented and explained step-by-step to perform basic, informed ERP and frequency-domain analyses, including data export to statistical programs and visual representations of the data. The open-source software EEGlab in MATLAB is used as the data handling platform, but scripts based on code provided by Mike Cohen (2014) are also included.
Comparison with existing methods: This accompanying tutorial-like article explains and shows how the processing of our automated pipeline affects the data and addresses, especially beginners in EEG-analysis, as other (pre)-processing chains are mostly targeting rather informed users in specialized areas or only parts of a complete procedure. In this context, we compared our pipeline with a selection of existing approaches.
Conclusion: The need for standardization and replication is evident, yet it is equally important to control the plausibility of the suggested solution by data exploration. Here, we provide the community with a tool to enhance the understanding and capability of EEG-analysis. We aim to contribute to comprehensive and reliable analyses for neuro-scientific research.
Electroencephalography (EEG) often fails to assess both the level (i.e., arousal) and the content (i.e., awareness) of pathologically altered consciousness in patients without motor responsiveness. This might be related to a decline of awareness, to episodes of low arousal and disturbed sleep patterns, and/or to distorting and attenuating effects of the skull and intermediate tissue on the recorded brain signals. Novel approaches are required to overcome these limitations. We introduced epidural electrocorticography (ECoG) for monitoring of cortical physiology in a late-stage amytrophic lateral sclerosis patient in completely locked-in state (CLIS) Despite long-term application for a period of six months, no implant related complications occurred. Recordings from the left frontal cortex were sufficient to identify three arousal states. Spectral analysis of the intrinsic oscillatory activity enabled us to extract state-dependent dominant frequencies at <4, similar to 7 and similar to 20 Hz, representing sleep-like periods, and phases of low and elevated arousal, respectively. In the absence of other biomarkers, ECoG proved to be a reliable tool for monitoring circadian rhythmicity, i.e., avoiding interference with the patient when he was sleeping and exploiting time windows of responsiveness. Moreover, the effects of interventions addressing the patient's arousal, e.g., amantadine medication, could be evaluated objectively on the basis of physiological markers, even in the absence of behavioral parameters. Epidural ECoG constitutes a feasible trade-off between surgical risk and quality of recorded brain signals to gain information on the patient's present level of arousal. This approach enables us to optimize the timing of interactions and medical interventions, all of which should take place when the patient is in a phase of high arousal. Furthermore, avoiding low responsiveness periods will facilitate measures to implement alternative communication pathways involving brain-computer interfaces (BCI).
Adapting defensive behavior to the characteristics of a threatening situation is a fundamental function of the brain. Particularly, threat imminence plays a major role for the organization of defensive responses. Acute threat prompts phasic physiological responses, which are usually associated with an intense feeling of fear. In contrast, diffuse and potentially threatening situations elicit a sustained state of anxious apprehension. Detection of the threatening stimulus defines the key event in this framework, initiating the transition from potential to acute threat. Consequently, attention to threat is crucial for supporting defensive behavior. The functions of attention are finely tuned to the characteristics of a threatening situation. Potential threat is associated with hypervigilance, in order to facilitate threat detection. Once a threatening stimulus has been identified, attention is selectively focused on the source of danger. Even though the concepts of selective attention and hypervigilance to threat are well established, evidence for their neural correlates remain scarce. Therefore, a major goal of this thesis is to elucidate the neural correlates of selective attention to acute threat and hypervigilance during potential threat. A second aim of this thesis is to provide a mechanistic account for the interaction of fear and anxiety. While contemporary models view fear and anxiety as mutually exclusive, recent findings for the neural networks of fear and anxiety suggest potential interactions. In four studies, aversive cue conditioning was used to induce acute threat, while context conditioning served as a laboratory model of potential threat. To quantify neural correlates of selective attention and hypervigilance, steady-state visual evoked potentials (ssVEPs) were measured as an index of visuocortical responding. Study 1 compared visuocortical responses to acute and potential threat for high versus low trait-anxious individuals. All individuals demonstrated enhanced electrocortical responses to the central cue in the acute threat condition, suggesting evidence for the neural correlate of selective attention. However, only low anxious individuals revealed facilitated processing of the contexts in the potential threat condition, reflecting a neural correlate of hypervigilance. High anxious individuals did not discriminate among contexts. These findings contribute to the notion of aberrational processing of potential threat for high anxious individuals. Study 2 and 3 realized orthogonal combinations of cue and context conditioning to investigate potential interactions of fear and anxiety. In contrast to Study 1 and 2, Study 3 used verbal instructions to induce potentially threatening contexts. Besides ssVEPs, threat ratings and skin conductance responses (SCRs) were recorded as efferent indices of defensive responding. None of these studies found further evidence for the neural correlates of hypervigilance and selective attention. However, results for ratings and SCRs revealed additive effects of fear and anxiety, suggesting that fear and anxiety are not mutually exclusive, but interact linearly to organize and facilitate defensive behavior. Study 4 tested ssVEPs to more ecologically valid forms of context conditioning, using flickering video stimuli of virtual offices to establish context representations. Contrary to expectations, results revealed decreased visuocortical responses during sustained presentations of anxiety compared to neutral contexts. A disruption of ssVEP signals eventually suggests interferences by continuously changing video streams which are enhanced as a function of motivational relevance. In summary, this thesis provided evidence for the neural correlates of attention only for isolated forms of fear and anxiety, but not for their interaction. In contrast, an additive interaction model of fear and anxiety for measures of defensive responding offers a new perspective on the topography of defensive behavior.
Recent research suggests that the P3b may be closely related to the activation of the locus coeruleus-norepinephrine (LC-NE) system. To further study the potential association, we applied a novel technique, the non-invasive transcutaneous vagus nerve stimulation (tVNS), which is speculated to increase noradrenaline levels. Using a within-subject cross-over design, 20 healthy participants received continuous tVNS and sham stimulation on two consecutive days (stimulation counterbalanced across participants) while performing a visual oddball task. During stimulation, oval non-targets (standard), normal-head (easy) and rotated-head (difficult) targets, as well as novel stimuli (scenes) were presented. As an indirect marker of noradrenergic activation we also collected salivary alpha-amylase (sAA) before and after stimulation. Results showed larger P3b amplitudes for target, relative to standard stimuli, irrespective of stimulation condition. Exploratory post hoc analyses, however, revealed that, in comparison to standard stimuli, easy (but not difficult) targets produced larger P3b (but not P3a) amplitudes during active tVNS, compared to sham stimulation. For sAA levels, although main analyses did not show differential effects of stimulation, direct testing revealed that tVNS (but not sham stimulation) increased sAA levels after stimulation. Additionally, larger differences between tVNS and sham stimulation in P3b magnitudes for easy targets were associated with larger increase in sAA levels after tVNS, but not after sham stimulation. Despite preliminary evidence for a modulatory influence of tVNS on the P3b, which may be partly mediated by activation of the noradrenergic system, additional research in this field is clearly warranted. Future studies need to clarify whether tVNS also facilitates other processes, such as learning and memory, and whether tVNS can be used as therapeutic tool.
Der Einfluss von Aufmerksamkeit und Interferenzkontrolle auf die Verarbeitung visueller Stimuli
(2008)
Gegenstand der vorliegenden Arbeit war die Frage, inwieweit die neuronale Verarbeitung visueller Stimuli durch Prozesse der Aufmerksamkeit und des Arbeitsgedächtnisses moduliert werden kann. Darüber hinaus wurde untersucht, welche „top down“ Prozesse diese Modulation steuern. Dabei wurden zwei konkurrierende Ansichten als mögliche Erklärungsmodelle zugrunde gelegt und überprüft. Zum einen wäre es möglich, dass selektive Aufmerksamkeit zwei qualitativ unterschiedliche Mechanismen beinhaltet. Demnach würde neben dem Fokussieren auf relevante Informationen auch ein aktiver Prozess der Inhibition der Verarbeitung irrelevanter Stimuli existieren. Zum anderen ist es aber auch denkbar, dass aufgrund begrenzter Verarbeitungsressourcen das Fokussieren auf relevante Reize automatisch mit dem Nichtbeachten irrelevanter Stimuli einhergeht und nur ein Mechanismus existiert. In einem ersten Experiment wurde vorab die Alertness als ein grundlegender Prozess der Aufmerksamkeit mit der Nah-Infrarot Spektroskopie (NIRS) untersucht. Mittels eines zweigestuften Studiendesigns wurden in einem ersten Schritt für die Alertness relevante Regionen über fronto-temporalen Hirnarealen definiert. Als relevant erwiesen sich Areale des mittleren und superioren temporalen Kortex der rechten Hemisphäre und der ventrale Teil des inferioren frontalen Kortex der linken Hemisphäre. In einer zweiten Datenerhebung konnte für diese Regionen eine signifikant höhere Aktivierung während der Alertnessbedingung im Vergleich zu einer visuellen und motorischen Kontrollbedingung gefunden werden. Mit dem zweiten Experiment sollten bestehende, mit dem Elektroenzephalogramm (EEG) erhobene, Befunde zur Modulation der neuronalen Verarbeitung visueller Stimuli repliziert werden. Dies geschah mithilfe eines neu entwickelten Untersuchungsparadigmas, einer modifizierten n-back Aufgabe. Wie erwartet fand sich eine erhöhte Verarbeitung aufgaben-relevanter Reize im Vergleich zu einer perzeptuellen Kontrollbedingung. Die Verarbeitung irrelevanter Reize wurde allerdings nicht unterdrückt. Explorativ fand sich ein entsprechendes Korrelat der Aufmerksamkeitslenkung über frontalen Elektroden. In einem dritten Experiment wurde das modifizierte n-back Paradigma an die Anforderungen einer NIRS Messung angepasst, um frontale Effekte der Aufmerksamkeitslenkung direkter erfassen zu können als mit dem EEG. Wie erwartet fand sich bezüglich des Beachtens wie auch des Ignorierens von Stimuli eine Beteiligung frontaler Strukturen. Auf beachtete Stimuli folgte eine bilaterale Aktivierung des dorsolateralen präfrontalen Kortex (DL-PFK) und eine Aktivierung des linken inferioren frontalen Kortex bis hin zum prä- und postzentralen Kortex. Das Ignorieren visueller Stimuli führte zu einer weitläufigen Aktivierung des rechten präfrontalen Kortex (PFK). Eine Beteiligung des linken inferioren frontalen Gyrus an der Interferenzkontrolle konnte nicht wie erwartet nachgewiesen werden. Der Vergleich der beiden Aktivierungsmuster ergab keine signifikanten Unterschiede. Die zugrunde liegenden Prozesse des Arbeitsgedächtnisses und der Interferenzkontrolle führten also zu einer Aktivierung stark überlappender Hirnregionen. Nachdem die Ergebnisse der Experimente 2 und 3 keinerlei Hinweise auf einen aktiven Prozess der Interferenzinhibition nachweisen konnten, wurde im Experiment 4 die bisher genutzte 1-back Aufgabe durch eine schwierigere 2-back Aufgabe ersetzt. Aufgrund der erhöhten Auslastung des Arbeitsgedächtnisses sollte eine stärkere Anstrengung und damit eine verstärkte frontale Aktivierung bei der Interferenzinhibition auftreten. Diese Hypothese wurde mit einer frontalen NIRS Messung überprüft (Experiment 4a). Wie erwartet führte die erhöhte Auslastung des Arbeitsgedächtnisses zu einer verstärkten Aktivierung des PFK bezüglich beachteter Reize. Hinsichtlich ignorierter Reize fand sich allerdings keine frontale Beteiligung. Parallel erhobene EEG Daten zeigten keinen Unterschied zwischen der Verarbeitung beachteter und ignorierter Gesichter. Die Verarbeitung passiv betrachteter Gesichter war im Gegensatz zu beachteten und ignorierten Gesichtern vermindert. Im zweiten Teil der Studie (Experiment 4b) wurden erstmals die okzipitalen Effekte der Aufmerksamkeitslenkung mit der NIRS erfasst. Im Einklang mit den Ergebnissen der ersten EEG Studie (Experiment 2) fand sich zwar eine verstärkte Verarbeitung beachteter, aber keine verminderte Verarbeitung ignorierter Reize. Zusammengenommen sprechen die fehlende aktive Inhibition von Distraktorreizen im okzipitalen Kortex und die vergleichbaren neuronalen Korrelate von Prozessen des Arbeitsgedächtnisses und der Interferenzinhibition im frontalen Kortex für die Hypothese einer Aufteilung von begrenzten Verarbeitungsressourcen zugunsten beachteter Reize.
Brain-computer interfaces (BCIs) could provide a muscle-independent communication channel to persons with severe paralysis by translating brain activity into device commands. As a means of communication, in particular BCIs based on event-related potentials (ERPs) as control signal have been researched. Most of these BCIs rely on visual stimulation and have been investigated with healthy participants in controlled laboratory environments. In proof-of-principle studies targeted end users gained control over BCI systems; however, these systems are not yet established as an assistive technology for persons who would most benefit from them. The main aim of this thesis is to advance the usability of ERP-BCIs for target users. To this end, five studies with BCIs have been conducted that enabled users to communicate by focusing their attention on external stimuli.
Two studies were conducted in order to demonstrate the advantages and to further improve the practical application of visual BCIs. In the first study, mental workload was experimentally manipulated during prolonged BCI operation. The study showed the robustness of the visual ERP-BCI since users maintained a satisfactory level of control despite constant distraction in the form of background noise. Moreover, neurophysiological markers that could potentially serve as indicators of high mental workload or fatigue were revealed. This is a first step towards future applications in which the BCI could adapt to the mental state of the user (e.g. pauses if high mental workload is detected to prevent false selections). In the second study, a head-mounted display (HMD), which assures that stimuli are presented in the field of view of the user, was evaluated. High accuracies and information transfer rates, similar to a conventional display, were achieved by healthy participants during a spelling task. Furthermore, a person in the locked-in state (LIS) gained control over the BCI using the HMD. The HMD might be particularly suited for initial communication attempts with persons in the LIS in situations, where mounting a conventional monitor is difficult or not feasible.
Visual ERP-BCIs could prove valuable for persons with residual control over eye muscles and sufficient vision. However, since a substantial number of target users have limited control over eye movements and/or visual impairments, BCIs based on non-visual modalities are required. Therefore, a main aspect of this thesis was to improve an auditory paradigm that should enable motor impaired users to spell by focusing attention on different tones. The two conducted studies revealed that healthy participants were able to achieve high spelling performance with the BCI already in the first session and stress the importance of the choice of the stimulus material. The employed natural tones resulted in an increase in performance compared to a previous study that used artificial tones as stimuli. Furthermore, three out of five users with a varying degree of motor impairments could gain control over the system within the five conducted sessions. Their performance increased significantly from the first to the fifth session - an effect not previously observed for visual ERP-BCIs. Hence, training is particularly important when testing auditory multiclass BCIs with potential users.
A prerequisite for user satisfaction is that the BCI technology matches user requirements. In this context, it is important to compare BCIs with already established assistive technology. Thus, the fifth study of this dissertation evaluated gaze dependent methods (EOG, eye tracking) as possible control signals for assistive technology and a binary auditory BCI with a person in the locked-in state. The study participant gained control over all tested systems and rated the ease of use of the BCI as the highest among the tested alternatives, but also rated it as the most tiring due to the high amount of attention that was needed for a simple selection. Further efforts are necessary to simplify operation of the BCI.
The involvement of end users in all steps of the design and development process of BCIs will increase the likelihood that they can eventually be used as assistive technology in daily life. The work presented in this thesis is a substantial contribution towards the goal of re-enabling communication to users who cannot rely on motor activity to convey their thoughts.