TY - JOUR A1 - Kübler, Andrea A1 - Blankertz, Benjamin A1 - Kleih, Sonja C. A1 - Kaufmann, Tobias A1 - Hammer, Eva M. T1 - Visuo-motor coordination ability predicts performance with brain-computer interfaces controlled by modulation of sensorimotor rhythms (SMR) N2 - Modulation of sensorimotor rhythms (SMR) was suggested as a control signal for brain-computer interfaces (BCI). Yet, there is a population of users estimated between 10 to 50% not able to achieve reliable control and only about 20% of users achieve high (80–100%) performance. Predicting performance prior to BCI use would facilitate selection of the most feasible system for an individual, thus constitute a practical benefit for the user, and increase our knowledge about the correlates of BCI control. In a recent study, we predicted SMR-BCI performance from psychological variables that were assessed prior to the BCI sessions and BCI control was supported with machine-learning techniques. We described two significant psychological predictors, namely the visuo-motor coordination ability and the ability to concentrate on the task. The purpose of the current study was to replicate these results thereby validating these predictors within a neurofeedback based SMR-BCI that involved no machine learning.Thirty-three healthy BCI novices participated in a calibration session and three further neurofeedback training sessions. Two variables were related with mean SMR-BCI performance: (1) a measure for the accuracy of fine motor skills, i.e., a trade for a person’s visuo-motor control ability; and (2) subject’s “attentional impulsivity”. In a linear regression they accounted for almost 20% in variance of SMR-BCI performance, but predictor (1) failed significance. Nevertheless, on the basis of our prior regression model for sensorimotor control ability we could predict current SMR-BCI performance with an average prediction error of M = 12.07%. In more than 50% of the participants, the prediction error was smaller than 10%. Hence, psychological variables played a moderate role in predicting SMR-BCI performance in a neurofeedback approach that involved no machine learning. Future studies are needed to further consolidate (or reject) the present predictors. KW - brain-computer interfaces KW - sensorimotor rhythms KW - predictors KW - visuo-motor coordination abilities KW - attentional impulsivity Y1 - 2014 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:20-opus-113084 ER - TY - JOUR A1 - Kaufmann, Tobias A1 - Herweg, Andreas A1 - Kübler, Andrea T1 - Toward brain-computer interface based wheelchair control utilizing tactually-evoked event-related potentials N2 - Background People with severe disabilities, e.g. due to neurodegenerative disease, depend on technology that allows for accurate wheelchair control. For those who cannot operate a wheelchair with a joystick, brain-computer interfaces (BCI) may offer a valuable option. Technology depending on visual or auditory input may not be feasible as these modalities are dedicated to processing of environmental stimuli (e.g. recognition of obstacles, ambient noise). Herein we thus validated the feasibility of a BCI based on tactually-evoked event-related potentials (ERP) for wheelchair control. Furthermore, we investigated use of a dynamic stopping method to improve speed of the tactile BCI system. Methods Positions of four tactile stimulators represented navigation directions (left thigh: move left; right thigh: move right; abdomen: move forward; lower neck: move backward) and N = 15 participants delivered navigation commands by focusing their attention on the desired tactile stimulus in an oddball-paradigm. Results Participants navigated a virtual wheelchair through a building and eleven participants successfully completed the task of reaching 4 checkpoints in the building. The virtual wheelchair was equipped with simulated shared-control sensors (collision avoidance), yet these sensors were rarely needed. Conclusion We conclude that most participants achieved tactile ERP-BCI control sufficient to reliably operate a wheelchair and dynamic stopping was of high value for tactile ERP classification. Finally, this paper discusses feasibility of tactile ERPs for BCI based wheelchair control. KW - Brain-computer interface KW - Event-related potentials KW - P300 KW - Tactile KW - Wheelchair KW - Dynamic stopping Y1 - 2014 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:20-opus-110042 ER - TY - JOUR A1 - Kleih, Sonja C. A1 - Herweg, Andreas A1 - Kaufmann, Tobias A1 - Staiger-Sälzer, Pit A1 - Gerstner, Natascha A1 - Kübler, Andrea T1 - The WIN-speller: a new intuitive auditory brain-computer interface spelling application JF - Frontiers in Neuroscience N2 - The objective of this study was to test the usability of a new auditory Brain-Computer Interface (BCI) application for communication. We introduce a word based, intuitive auditory spelling paradigm the WIN-speller. In the WIN-speller letters are grouped by words, such as the word KLANG representing the letters A, G, K, L, and N. Thereby, the decoding step between perceiving a code and translating it to the stimuli it represents becomes superfluous. We tested 11 healthy volunteers and four end-users with motor impairment in the copy spelling mode. Spelling was successful with an average accuracy of 84% in the healthy sample. Three of the end-users communicated with average accuracies of 80% or higher while one user was not able to communicate reliably. Even though further evaluation is required, the WIN-speller represents a potential alternative for BCI based communication in end-users. KW - Brain-Computer Interface (BCI) KW - communication KW - P300 KW - motor-impaired end-user KW - auditory Y1 - 2015 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:20-opus-125972 VL - 9 ER - TY - JOUR A1 - Kübler, Andrea A1 - Holz, Elisa M. A1 - Riccio, Angela A1 - Zickler, Claudia A1 - Kaufmann, Tobias A1 - Kleih, Sonja C. A1 - Staiger-Sälzer, Pit A1 - Desideri, Lorenzo A1 - Hoogerwerf, Evert-Jan A1 - Mattia, Donatella T1 - The User-Centered Design as Novel Perspective for Evaluating the Usability of BCI-Controlled Applications N2 - Albeit research on brain-computer interfaces (BCI) for controlling applications has expanded tremendously, we still face a translational gap when bringing BCI to end-users. To bridge this gap, we adapted the user-centered design (UCD) to BCI research and development which implies a shift from focusing on single aspects, such as accuracy and information transfer rate (ITR), to a more holistic user experience. The UCD implements an iterative process between end-users and developers based on a valid evaluation procedure. Within the UCD framework usability of a device can be defined with regard to its effectiveness, efficiency, and satisfaction. We operationalized these aspects to evaluate BCI-controlled applications. Effectiveness was regarded equivalent to accuracy of selections and efficiency to the amount of information transferred per time unit and the effort invested (workload). Satisfaction was assessed with questionnaires and visual-analogue scales. These metrics have been successfully applied to several BCI-controlled applications for communication and entertainment, which were evaluated by end-users with severe motor impairment. Results of four studies, involving a total of N = 19 end-users revealed: effectiveness was moderate to high; efficiency in terms of ITR was low to high and workload low to medium; depending on the match between user and technology, and type of application satisfaction was moderate to high. The here suggested evaluation metrics within the framework of the UCD proved to be an applicable and informative approach to evaluate BCI controlled applications, and end-users with severe impairment and in the locked-in state were able to participate in this process. KW - computer software KW - event related potentials KW - games KW - head KW - head injury KW - man-computer interface KW - prototypes KW - speech Y1 - 2014 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:20-opus-111051 ER - TY - JOUR A1 - Jin, Jing A1 - Allison, Brendan Z. A1 - Kaufmann, Tobias A1 - Kübler, Andrea A1 - Zhang, Yu A1 - Wang, Xingyu A1 - Cichocki, Andrzej T1 - The Changing Face of P300 BCIs: A Comparison of Stimulus Changes in a P300 BCI Involving Faces, Emotion, and Movement JF - PLoS One N2 - Background: One of the most common types of brain-computer interfaces (BCIs) is called a P300 BCI, since it relies on the P300 and other event-related potentials (ERPs). In the canonical P300 BCI approach, items on a monitor flash briefly to elicit the necessary ERPs. Very recent work has shown that this approach may yield lower performance than alternate paradigms in which the items do not flash but instead change in other ways, such as moving, changing colour or changing to characters overlaid with faces. Methodology/Principal Findings: The present study sought to extend this research direction by parametrically comparing different ways to change items in a P300 BCI. Healthy subjects used a P300 BCI across six different conditions. Three conditions were similar to our prior work, providing the first direct comparison of characters flashing, moving, and changing to faces. Three new conditions also explored facial motion and emotional expression. The six conditions were compared across objective measures such as classification accuracy and bit rate as well as subjective measures such as perceived difficulty. In line with recent studies, our results indicated that the character flash condition resulted in the lowest accuracy and bit rate. All four face conditions (mean accuracy >91%) yielded significantly better performance than the flash condition (mean accuracy = 75%). Conclusions/Significance: Objective results reaffirmed that the face paradigm is superior to the canonical flash approach that has dominated P300 BCIs for over 20 years. The subjective reports indicated that the conditions that yielded better performance were not considered especially burdensome. Therefore, although further work is needed to identify which face paradigm is best, it is clear that the canonical flash approach should be replaced with a face paradigm when aiming at increasing bit rate. However, the face paradigm has to be further explored with practical applications particularly with locked-in patients. KW - ERPS KW - communication KW - TO-target interval KW - visual-evoked potentials KW - brain-computer-interface KW - recognition KW - amplitude KW - paradigm KW - systems Y1 - 2012 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:20-opus-134173 VL - 7 IS - 11 ER - TY - JOUR A1 - Kaufmann, Tobias A1 - Holz, Elisa M. A1 - Kübler, Andrea T1 - Comparison of tactile, auditory, and visual modality for brain-computer interface use: a case study with a patient in the locked-in state JF - Frontiers in Human Neuroscience N2 - This paper describes a case study with a patient in the classic locked-in state, who currently has no means of independent communication. Following a user-centered approach, we investigated event-related potentials (ERP) elicited in different modalities for use in brain-computer interface (BCI) systems. Such systems could provide her with an alternative communication channel. To investigate the most viable modality for achieving BCI based communication, classic oddball paradigms (1 rare and 1 frequent stimulus, ratio 1:5) in the visual, auditory and tactile modality were conducted (2 runs per modality). Classifiers were built on one run and tested offline on another run (and vice versa). In these paradigms, the tactile modality was clearly superior to other modalities, displaying high offline accuracy even when classification was performed on single trials only. Consequently, we tested the tactile paradigm online and the patient successfully selected targets without any error. Furthermore, we investigated use of the visual or tactile modality for different BCI systems with more than two selection options. In the visual modality, several BCI paradigms were tested offline. Neither matrix-based nor so-called gaze-independent paradigms constituted a means of control. These results may thus question the gaze-independence of current gaze-independent approaches to BCI. A tactile four-choice BCI resulted in high offline classification accuracies. Yet, online use raised various issues. Although performance was clearly above chance, practical daily life use appeared unlikely when compared to other communication approaches (e.g., partner scanning). Our results emphasize the need for user-centered design in BCI development including identification of the best stimulus modality for a particular user. Finally, the paper discusses feasibility of EEG-based BCI systems for patients in classic locked-in state and compares BCI to other AT solutions that we also tested during the study. KW - brain-computer interface KW - tactile auditory and visual modality KW - locked-in syndrome KW - user-centered design KW - end-user testing KW - assistive technology Y1 - 2013 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:20-opus-97079 ER - TY - THES A1 - Kaufmann, Tobias T1 - Brain-computer interfaces based on event-related potentials: toward fast, reliable and easy-to-use communication systems for people with neurodegenerative disease T1 - Gehirn-Computer Schnittstellen basierend auf ereigniskorrelierten Potentialen: Entwicklung von schnellen, zuverlässigen und leicht zu bedienenden Kommunikationssystemen für Menschen mit neurodegenerativer Erkrankung N2 - Objective: Brain Computer Interfaces (BCI) provide a muscle independent interaction channel making them particularly valuable for individuals with severe motor impairment. Thus, different BCI systems and applications have been proposed as assistive technology (AT) solutions for such patients. The most prominent system for communication utilizes event-related potentials (ERP) obtained from the electroencephalogram (EEG) to allow for communication on a character-by-character basis. Yet in their current state of technology, daily life use cases of such systems are rare. In addition to the high EEG preparation effort, one of the main reasons is the low information throughput compared to other existing AT solutions. Furthermore, when testing BCI systems in patients, a performance drop is usually observed compared to healthy users. Patients often display a low signal-to-noise ratio of the recorded EEG and detection of brain responses may be aggravated due to internally (e.g. spasm) or externally induced artifacts (e.g. from ventilation devices). Consequently, practical BCI systems need to cope with mani-fold inter-individual differences. Whilst these high demands lead to increasing complexity of the technology, daily life use of BCI systems requires straightforward setup including an easy-to-use graphical user interface that nonprofessionals can handle without expert support. Research questions of this thesis: This dissertation project aimed at bringing forward BCI technology toward a possible integration into end-users' daily life. Four basic research questions were addressed: (1) Can we identify performance predictors so that we can provide users with individual BCI solutions without the need of multiple, demanding testing sessions? (2) Can we provide complex BCI technology in an automated, user-friendly and easy-to-use manner, so that BCIs can be used without expert support at end-users' homes? (3) How can we account for and improve the low information transfer rates as compared to other existing assistive technology solutions? (4) How can we prevent the performance drop often seen when bringing BCI technology that was tested in healthy users to those with severe motor impairment? Results and discussion: (1) Heart rate variability (HRV) as an index of inhibitory control (i.e. the ability to allocate attention resources and inhibit distracting stimuli) was significantly related to ERP-BCI performance and accounted for almost 26% of variance. HRV is easy to assess from short heartbeat recordings and may thus serve as a performance predictor for ERP-BCIs. Due to missing software solutions for appropriate processing of artifacts in heartbeat data (electrocardiogram and inter-beat interval data), our own tool was developed that is available free of charge. To date, more than 100 researchers worldwide have requested the tool. Recently, a new version was developed and released together with a website (www.artiifact.de). (2) Furthermore, a study of this thesis demonstrated that BCI technology can be incorporated into easy-to-use software, including auto-calibration and predictive text entry. Naïve, healthy nonprofessionals were able to control the software without expert support and successfully spelled words using the auto-calibrated BCI. They reported that software handling was straightforward and that they would be able to explain the system to others. However, future research is required to study transfer of the results to patient samples. (3) The commonly used ERP-BCI paradigm was significantly improved. Instead of simply highlighting visually displayed characters as is usually done, pictures of famous faces were used as stimulus material. As a result, specific brain potentials involved in face recognition and face processing were elicited. The event-related EEG thus displayed an increased signal-to-noise ratio, which facilitated the detection of ERPs extremely well. Consequently, BCI performance was significantly increased. (4) The good results of this new face-flashing paradigm achieved with healthy participants transferred well to users with neurodegenerative disease. Using a face paradigm boosted information throughput. Importantly, two users who were highly inefficient with the commonly used paradigm displayed high accuracy when exposed to the face paradigm. The increased signal-to-noise ratio of the recorded EEG thus helped them to overcome their BCI inefficiency. Significance: The presented work at hand (1) successfully identified a physiological predictor of ERP-BCI performance, (2) proved the technology ready to be operated by naïve nonprofessionals without expert support, (3) significantly improved the commonly used spelling paradigm and (4) thereby displayed a way to effectively prevent BCI inefficiency in patients with neurodegenerative disease. Additionally, missing software solutions for appropriate handling of artifacts in heartbeat data encouraged development of our own software tool that is available to the research community free of charge. In sum, this thesis significantly improved current BCI technology and enhanced our understanding of physiological correlates of BCI performance. N2 - Zielsetzung: Gehirn-Computer Schnittstellen (engl. Brain-Computer Interface, BCI) bilden einen muskel-unabhängigen Interaktionskanal, was sie besonders für Menschen mit starken, motorischen Einschränkungen wertvoll macht. Daher wurden verschiedene BCI-Systeme und -Anwendungen als unterstützende Technologien (UT) für diese Patienten vorgeschlagen. Das am häufigsten verwendete System zu Kommunikationszwecken basiert auf ereigniskorrelierten Potentialen (EKP) des Elektroenzephalogramms (EEG) und ermöglicht es Buchstabe für Buchstabe zu kommunizieren. Zum derzeitigen Stand der Technik sind Berichte über alltägliche Verwendung von BCI-Systemen jedoch selten. Zusätzlich zu dem hohen Präparationsaufwand, der mit dem Messen eines EEGs verbunden ist, ist eine der Hauptursachen der verhältnismäßig geringe Informationstransfer im Vergleich zu anderen existierenden UT-Lösungen. Zudem wird häufig beobachtet, dass das BCI-Kontrollvermögen bei Patienten deutlich niedriger ist als bei gesunden Nutzern. Das EEG von Patienten weißt häufig ein niedrigeres Signal-zu-Rausch-Verhältnis auf und die Erkennung von Hirnantworten kann durch interne (z. B. Spasmus) oder externe Artefakte (z. B. von einem Beatmungsgerät herrührend) zusätzlich erschwert werden. Somit müssen praxisrelevante BCI-Systeme mit einer Vielfalt von interindividuellen Unterschieden klar kommen. Obschon diese hohen Anforderungen zu einer zunehmend komplexeren Technologie führen, erfordert der Alltagsgebrauch von BCI-Systemen einen einfachen Aufbau inklusive leicht zu bedienender, grafischer Benutzeroberfläche, die von Laien, ohne Unterstützung von Experten, bedient werden kann. Forschungsfragestellungen dieser Dissertationsschrift: Das Dissertationsprojekt bezweckte die Weiterentwicklung von BCI-Systemen, um den Weg für eine Integration in das tägliche Leben von Benutzern zu bahnen. Vier grundlegende Forschungsfragestellungen wurden adressiert: (1) Können Prädiktoren des BCI-Kontrollvermögens gefunden werden, sodass Nutzer mit individuell angepassten BCI-Lösungen versorgt werden können, ohne dass mehrfache, anstrengende Testsitzungen notwendig sind? (2) Kann komplexe BCI-Technologie auf automatisierte, nutzerfreundliche und leicht zu bedienende Weise bereitgestellt werden, sodass BCIs, ohne die Unterstützung von Experten, zuhause verwendet werden können? (3) Wie kann man den im Vergleich zu anderen existierenden UT-Lösungen niedrigen Informationstransferraten begegnen und sie erhöhen? (4) Wie kann ein Abfall des Kontrollvermögens verhindert werden, der häufig in Erscheinung tritt, wenn man BCI-Technologie, die an Gesunden getestet wurde, zu Patienten mit starken motorischen Einschränkungen bringt? Ergebnisse und Diskussion: (1) Herzratenvariabilität als Index des inhibitorischen Kontrollvermögens (die Fähigkeit Aufmerksamkeitsressourcen bereitzustellen und ablenkende Reize zu inhibieren) wurde zu EKP-BCI-Kontrollvermögen in einen signifikanten Bezug gesetzt und klärte beinahe 26% der Varianz auf. HRV ist leicht aus kurzen Aufzeichnungen des Herzschlags zu erheben und könnte daher als Prädiktor des EKP-BCI-Kontrollvermögens dienen. Aufgrund fehlender Softwarelösungen für angemessene Artefaktbehandlung in Aufzeichnungen des Herzschlags (Elektrokardiogramm und Interbeat-Intervall Daten) wurde ein eigenes Programm entwickelt, das frei erhältlich ist. Bis heute wurde es von mehr als 100 Wissenschaftlern weltweit angefordert. Unlängst wurde zudem eine neue Version entwickelt, die zusammen mit einer Website veröffentlicht wurde (www.artiifact.de). (2) Des Weiteren zeigte eine Studie dieser Dissertation, dass BCI-Technologie samt Auto-Kalibration und Wortvervollständigung in eine leicht zu bedienende Software integriert werden kann. Ungeschulte, gesunde Probanden waren in der Lage die Software ohne Unterstützung von Experten zu bedienen und buchstabierten mit dem auto-kalibrierten BCI erfolgreich Wörter. Sie gaben an, dass die Bedienung der Software leicht zu tätigen sei und dass sie in der Lage wären, das System anderen zu erklären. Jedoch muss zukünftige Forschung klären, ob sich die Ergebnisse auf Patienten übertragen lassen. (3) Das häufig verwendete EKP-BCI-Paradigma wurde signifikant verbessert. Statt - wie normalerweise getätigt - visuell präsentierte Buchstaben einfach aufleuchten zu lassen, wurden Bilder berühmter Gesichter als Stimulationsmaterial verwendet. Hierdurch wurden spezifische Gehirnpotentiale der Gesichtserkennung und -verarbeitung ausgelöst. Das ereigniskorrelierte EEG wies daher ein höheres Signal-zu-Rausch-Verhältnis auf, was die Detektion von EKPs stark vereinfachte. Infolgedessen war das BCI-Kontrollvermögen signifikant erhöht. (4) Die guten Ergebnisse dieses neuen Gesichter-Stimulus-Paradigmas, die mit gesunden Probanden erreicht wurden, ließen sich gut auf Patienten mit neurodegenerativen Erkrankungen übertragen. Die Verwendung eines Gesichter-Paradigmas erhöhte den Informationstransfer erheblich. Zwei Nutzer, die sehr ineffizient im Umgang mit dem herkömmlichen BCI-System waren, erreichten zudem ein hohes Kontrollvermögen mit dem Gesichter-Paradigma. Das erhöhte Signal-zu-Rausch-Verhältnis des aufgezeichneten EEGs half ihnen somit ihre BCI Ineffizienz zu überwinden. Signifikanz: Die hier vorgestellte Arbeit (1) identifizierte einen physiologischen Prädiktor des EKP-BCI-Kontrollvermögens, (2) zeigte, dass die Technologie bereit ist für die Verwendung durch ungeschulte Laien ohne Unterstützung von Experten, (3) verbesserte das herkömmliche Kommunikationsparadigma signifikant, und (4) zeigte hierdurch einen Weg auf, die BCI Ineffizienz von Patienten mit neurodegenerativen Erkrankungen effektiv zu verhindern. Die fehlende Softwarelösung zur angemessenen Behandlung von Artefakten in Aufzeichnungen des Herzschlags animierte zudem zur Entwicklung einer eigenen Anwendung, die der Wissenschaftsgemeinschaft kostenfrei zur Verfügung gestellt wird. Zusammenfassend kann gesagt werden, dass dieses Dissertationsprojekt somit derzeitige BCI-Technologie signifikant verbesserte und unser Verständnis physiologischer Korrelate des BCI-Kontrollvermögens erweiterte. KW - Gehirn-Computer-Schnittstelle KW - Herzfrequenzvariabilität KW - Nervendegeneration KW - BCI KW - HRV Y1 - 2013 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:20-opus-83441 ER -