Refine
Has Fulltext
- yes (5)
Is part of the Bibliography
- yes (5)
Year of publication
- 2015 (5) (remove)
Document Type
- Doctoral Thesis (5)
Language
- English (5)
Keywords
- Brain-computer interface (2)
- EEG (2)
- Ereigniskorreliertes Potenzial (2)
- Gehirn-Computer-Schnittstelle (2)
- P300 (2)
- AAC (1)
- ALS (1)
- Alpha Neurofeedback (1)
- Amyotrophe Lateralsklerose (1)
- Apallisches Syndrom (1)
Institute
Brain-computer interfaces (BCIs) are devices that translate signals from the brain into control commands for applications. Within the last twenty years, BCI applications have been developed for communication, environmental control, entertainment, and substitution of motor functions. Since BCIs provide muscle independent communication and control of the environment by circumventing motor pathways, they are considered as assistive technologies for persons with neurological and neurodegenerative diseases leading to motor paralysis, such as amyotrophic lateral sclerosis (ALS), muscular dystrophy, spinal muscular atrophy and stroke (Kübler, Kotchoubey, Kaiser, Wolpaw, & Birbaumer, 2001). Although most researcher mention persons with severe motor impairment as target group for their BCI systems, most studies include healthy participants and studies including potential BCI end-users are sparse. Thus, there is a substantial lack of studies that investigate whether results obtained in healthy participants can be transferred to patients with neurodegenerative diseases. This clearly shows that BCI research faces a translational gap between intense BCI research and bringing BCI applications to end-users outside the lab (Kübler, Mattia, Rupp, & Tangermann, 2013). Translational studies are needed that investigate whether BCIs can be successfully used by severely disabled end-users and whether those end-users would accept BCIs as assistive devices. Another obvious discrepancy exists between a plethora of short-term studies and a sparse number of long-term studies. BCI research thus also faces a reliability gap (Kübler, Mattia, et al., 2013). Most studies present only one BCI session, however the few studies that include several testing sessions indicate high inter- and intra-individual variance in the end-users’ performance due to non-stationarity of signals. Long-term studies, however, are needed to demonstrate whether a BCI can be reliably used as assistive device over a longer period of time in the daily-life of a person. Therefore there is also a great need for reliability studies.
The purpose of the present thesis was to address these research gaps and to bring BCIs closer to end-users in need, especially into their daily-lives, following a user-centred design (UCD). The UCD was suggested as theoretical framework for bringing BCIs to end-users by Kübler and colleagues (Kübler et al., 2014; Zickler et al., 2011). This approach aims at the close and iterative interaction between BCI developers and end-users with the final goal to develop BCI systems that are accepted as assistive devices by end-users. The UCD focuses on usability, that is, how well a BCI technology matches the purpose and meets the needs and requirements of the targeted end-users and was standardized with the ISO 9241-210.
Within the UCD framework, usability of a device can be defined with regard to its effectiveness, efficiency and satisfaction. These aspects were operationalized by Kübler and colleagues to evaluate BCI-controlled applications. As suggested by Vaughan and colleagues, the number of BCI sessions, the total usage duration and the impact of the BCI on the life of the person can be considered as indicators of usefulness of the BCI in long-term daily-life use (Vaughan, Sellers, & Wolpaw, 2012). These definitions and metrics for usability and usefulness were applied for evaluating BCI applications as assistive devices in controlled settings and independent use. Three different BCI applications were tested and evaluated by in total N=10 end-users: In study 1 a motor-imagery (MI) based BCI for gaming was tested by four end-users with severe motor impairment. In study 2, a hybrid P300 event-related (ERP) based BCI for communication was tested by four severely motor restricted end-users with severe motor impairment. Study 1 and 2 are short-term studies conducted in a controlled-setting. In study 3 a P300-ERP BCI for creative expression was installed for long-term independent use at the homes of two end-users in the locked-in state. Both end-users are artists who had gradually lost the ability to paint after being diagnosed with ALS.
Results reveal that BCI controlled devices are accepted as assistive devices. Main obstacles for daily-life use were the not very aesthetic design of the EEG-cap and electrodes (cap is eye-catching and looks medical), low comfort (cables disturb, immobility, electrodes press against head if lying on a head cushion), complicated and time-consuming adjustment, low efficiency and low effectiveness, and not very high reliability (many influencing factors). While effectiveness and efficiency in the MI based BCI were lower compared to applications using the P300-ERP as input channel, the MI controlled gaming application was nevertheless better accepted by the end-users and end-users would rather like to use it compared to the communication applications. Thus, malfunctioning and errors, low speed, and the EEG cap are rather tolerated in gaming applications, compared to communication devices. Since communication is essential for daily-life, it has to be fast and reliable. BCIs for communication, at the current state of the art, are not considered competitive with other assistive devices, if other devices, such as eye-gaze, are still an option. However BCIs might be an option when controlling an application for entertainment in daily-life, if communication is still available. Results demonstrate that BCI is adopted in daily-life if it matches the end-users needs and requirements. Brain Painting serves as best representative, as it matches the artists’ need for creative expression. Caveats such as uncomfortable cap, dependence on others for set-up, and experienced low control are tolerated and do not prevent BCI use on a daily basis. Also end-users in real need of means for communication, such as persons in the locked-in state with unreliable eye-movement or no means for independent communication, do accept obstacles of the BCI, as it is the last or only solution to communicate or control devices. Thus, these aspects are “no real obstacles” but rather “challenges” that do not prevent end-users to use the BCI in their daily-lives. For instance, one end-user, who uses a BCI in her daily-life, stated: “I don’t care about aesthetic design of EEG cap and electrodes nor amplifier”. Thus, the question is not which system is superior to the other, but which system is best for an individual user with specific symptoms, needs, requirements, existing assistive solutions, support by caregivers/family etc.; it is thereby a question of indication. These factors seem to be better “predictors” for adoption of a BCI in daily-life, than common usability criterions such as effectiveness or efficiency. The face valid measures of daily-life demonstrate that BCI-controlled applications can be used in daily-life for more than 3 years, with high satisfaction for the end-users, without experts being present and despite a decrease in the amplitude of the P300 signal. Brain Painting re-enabled both artists to be creatively active in their home environment and thus improved their feelings of happiness, usefulness, self-esteem, well-being, and consequently quality of life and supports social inclusion. This thesis suggests that BCIs are valuable tools for people in the locked-in state.
The present work comprises four studies dealing with the investigation of the auditory event-related potentials (ERP) Mismatch Negativity (MMN), P300, and N400 under different attentional instructions, and with their application in patients with disorders of consciousness (DOC) to assess residual cognitive functioning. In guided interviews (study 1), practitioners working with DOC patients stated their general interest in and an objective need for the complementation of current diagnostic procedures by reliable and valid ERP-based methods. Subsequently, in study 2, simple oddball and semantic paradigms were applied to 19 behaviorally non-responsive DOC patients revealing the presence of at least one ERP in eight patients investigated. In the third and fourth study, specific attentional effects on ERPs were investigated in healthy participants to define optimal instructions and stimulus parameters. In study 3, MMN and N400 amplitudes were assessed in 18 participants, and in study 4, MMN and P300 amplitudes were assessed in 32 participants. Both studies included an ignore task (attention on simultaneous visual stimuli), a passive task, and a focused task and revealed distinct attentional effects on P300 and N400 with largest amplitudes in the focused task, smaller ones in the passive task and no ERP in the ignore task. An MMN was elicited in all tasks, but still, amplitudes differed as a function of task. In addition, study 4 included oddball paradigms comprising several deviants in different dimensions. Higher amplitudes were found in this multifeature paradigm compared to traditional oddball paradigms and larger amplitudes were elicited by deviants highly different from standards. It is concluded that ERPs represent a promising tool to complement clinical assessment of DOC patients. Application of ERP paradigms should include focused instructions, especially when using semantic material. Furthermore, multifeature paradigms have been proven especially useful eliciting large amplitudes and allowing for the investigation of several dimensions of deviants at the same time.
Brain-computer interfaces (BCIs) could provide a muscle-independent communication channel to persons with severe paralysis by translating brain activity into device commands. As a means of communication, in particular BCIs based on event-related potentials (ERPs) as control signal have been researched. Most of these BCIs rely on visual stimulation and have been investigated with healthy participants in controlled laboratory environments. In proof-of-principle studies targeted end users gained control over BCI systems; however, these systems are not yet established as an assistive technology for persons who would most benefit from them. The main aim of this thesis is to advance the usability of ERP-BCIs for target users. To this end, five studies with BCIs have been conducted that enabled users to communicate by focusing their attention on external stimuli.
Two studies were conducted in order to demonstrate the advantages and to further improve the practical application of visual BCIs. In the first study, mental workload was experimentally manipulated during prolonged BCI operation. The study showed the robustness of the visual ERP-BCI since users maintained a satisfactory level of control despite constant distraction in the form of background noise. Moreover, neurophysiological markers that could potentially serve as indicators of high mental workload or fatigue were revealed. This is a first step towards future applications in which the BCI could adapt to the mental state of the user (e.g. pauses if high mental workload is detected to prevent false selections). In the second study, a head-mounted display (HMD), which assures that stimuli are presented in the field of view of the user, was evaluated. High accuracies and information transfer rates, similar to a conventional display, were achieved by healthy participants during a spelling task. Furthermore, a person in the locked-in state (LIS) gained control over the BCI using the HMD. The HMD might be particularly suited for initial communication attempts with persons in the LIS in situations, where mounting a conventional monitor is difficult or not feasible.
Visual ERP-BCIs could prove valuable for persons with residual control over eye muscles and sufficient vision. However, since a substantial number of target users have limited control over eye movements and/or visual impairments, BCIs based on non-visual modalities are required. Therefore, a main aspect of this thesis was to improve an auditory paradigm that should enable motor impaired users to spell by focusing attention on different tones. The two conducted studies revealed that healthy participants were able to achieve high spelling performance with the BCI already in the first session and stress the importance of the choice of the stimulus material. The employed natural tones resulted in an increase in performance compared to a previous study that used artificial tones as stimuli. Furthermore, three out of five users with a varying degree of motor impairments could gain control over the system within the five conducted sessions. Their performance increased significantly from the first to the fifth session - an effect not previously observed for visual ERP-BCIs. Hence, training is particularly important when testing auditory multiclass BCIs with potential users.
A prerequisite for user satisfaction is that the BCI technology matches user requirements. In this context, it is important to compare BCIs with already established assistive technology. Thus, the fifth study of this dissertation evaluated gaze dependent methods (EOG, eye tracking) as possible control signals for assistive technology and a binary auditory BCI with a person in the locked-in state. The study participant gained control over all tested systems and rated the ease of use of the BCI as the highest among the tested alternatives, but also rated it as the most tiring due to the high amount of attention that was needed for a simple selection. Further efforts are necessary to simplify operation of the BCI.
The involvement of end users in all steps of the design and development process of BCIs will increase the likelihood that they can eventually be used as assistive technology in daily life. The work presented in this thesis is a substantial contribution towards the goal of re-enabling communication to users who cannot rely on motor activity to convey their thoughts.
The impact of acquired severe motor impairments is pervasive and may lead to a complete loss of communication and voluntary motor control, rendering the patient behaviourally unresponsive. In routine clinical care it may thus be unclear, whether some of these patients are even conscious. Given that finding a cure is unlikely, care focuses on providing the best possible quality of life (QoL), and knowing its predictors might contribute to that aim. Patients who still can communicate often report a high QoL, and several predictors have been identified. However, many instruments used to assess QoL require at least residual verbal and motor abilities. Thus, a method to assess QoL independent of these requirements is desirable. In addition, many instruments assume QoL to be temporarily stable, and little information is available on predictors of instantaneous QoL, i.e. QoL as it fluctuates from moment to moment throughout the day.
Feedback efficiency and training effects during alpha band modulation over the sensorimotor cortex
(2015)
Neural oscillations can be measured by electroencephalography (EEG) and these oscillations can be characterized by their frequency, amplitude and phase. The mechanistic properties of neural oscillations and their synchronization are able to explain various aspects of many cognitive functions such as motor control, memory, attention, information transfer across brain regions, segmentation of the sensory input and perception (Arnal and Giraud, 2012). The alpha band frequency is the dominant oscillation in the human brain. This oscillatory activity is found in the scalp EEG at frequencies around 8-13 Hz in all healthy adults (Makeig et al., 2002) and considerable interest has been generated in exploring EEG alpha oscillations with regard to their role in cognitive (Klimesch et al., 1993; Hanselmayr et al., 2005), sensorimotor (Birbaumer, 2006; Sauseng et al., 2009) and physiological (Lehmann, 1971; Niedermeyer, 1997; Kiyatkin, 2010) aspects of human life. The ability to voluntarily regulate the alpha amplitude can be learned with neurofeedback training and offers the possibility to control a brain-computer interface (BCI), a muscle independent interaction channel. BCI research is predominantly focused on the signal processing, the classification and the algorithms necessary to translate brain signals into control commands than on the person interacting with the technical system. The end-user must be properly trained to be able to successfully use the BCI and factors such as task instructions, training, and especially feedback can therefore play an important role in learning to control a BCI (Neumann and Kübler, 2003; Pfurtscheller et al., 2006, 2007; Allison and Neuper, 2010; Friedrich et al., 2012; Kaufmann et al., 2013; Lotte et al., 2013).
The main purpose of this thesis was to investigate how end-users can efficiently be trained to perform alpha band modulation recorded over their sensorimotor cortex. The herein presented work comprises three studies with healthy participants and participants with schizophrenia focusing on the effects of feedback and training time on cortical activation patterns and performance. In the first study, the application of a realistic visual feedback to support end-users in developing a concrete feeling of kinesthetic motor imagery was tested in 2D and 3D visualization modality during a single training session. Participants were able to elicit the typical event-related desynchronisation responses over sensorimotor cortex in both conditions but the most significant decrease in the alpha band power was obtained following the three-dimensional realistic visualization. The second study strengthen the hypothesis that an enriched visual feedback with information about the quality of the input signal supports an easier approach for motor imagery based BCI control and can help to enhance performance. Significantly better performance levels were measurable during five online training sessions in the groups with enriched feedback as compared to a conventional simple visual feedback group, without significant differences in performance between the unimodal (visual) and multimodal (auditory–visual) feedback modality. Furthermore, the last study, in which people with schizophrenia participated in multiple sessions with simple feedback, demonstrated that these patients can learn to voluntarily regulate their alpha band. Compared to the healthy group they required longer training times and could not achieve performance levels as high as the control group. Nonetheless, alpha neurofeedback training lead to a constant increase of the alpha resting power across all 20 training session.
To date only little is known about the effects of feedback and training time on BCI performance and cortical activation patterns. The presented work contributes to the evidence that healthy individuals can benefit from enriched feedback: A realistic presentation can support participants in getting a concrete feeling of motor imagery and enriched feedback, which instructs participants about the quality of their input signal can give support while learning to control the BCI. This thesis demonstrates that people with schizophrenia can learn to gain control of their alpha oscillations recorded over the sensorimotor cortex when participating in sufficient training sessions. In conclusion, this thesis improved current motor imagery BCI feedback protocols and enhanced our understanding of the interplay between feedback and BCI performance.