Refine
Has Fulltext
- yes (23)
Is part of the Bibliography
- yes (23)
Year of publication
Document Type
- Doctoral Thesis (23) (remove)
Keywords
- Mensch-Maschine-Kommunikation (5)
- Lernen (3)
- Psychologie (3)
- Benutzeroberfläche (2)
- Evolutionspsychologie (2)
- Gefühl (2)
- Human-Computer Interaction (2)
- Medien (2)
- Medienkonsum (2)
- Mensch-Maschine Interaktion (2)
Institute
- Institut Mensch - Computer - Medien (23) (remove)
Ownership and usage of personal voice assistant devices like Amazon Echo or Google Home have increased drastically over the last decade since their market launch. This thesis builds upon existing computers are social actors (CASA) and media equation research that is concerned with humans displaying social reactions usually exclusive to human-human interaction when interacting with media and technological devices. CASA research has been conducted with a variety of technological devices such as desktop computers, smartphones, embodied virtual agents, and robots. However, despite their increasing popularity, little empirical work has been done to examine social reactions towards these personal stand-alone voice assistant devices, also referred to as smart speakers. Thus, this dissertation aims to adopt the CASA approach to empirically evaluate social responses to smart speakers. With this goal in mind, four laboratory experiments with a total of 407 participants have been conducted for this thesis. Results show that participants display a wide range of social reactions when interacting with voice assistants. This includes the utilization of politeness strategies such as the interviewer-bias, which led to participants giving better evaluations directly to a smart speaker device compared to a separate computer. Participants also displayed prosocial behavior toward a smart speaker after interdependence and thus a team affiliation had been induced. In a third study, participants applied gender stereotypes to a smart speaker not only in self-reports but also exhibited conformal behavior patterns based on the voice the device used. In a fourth and final study, participants followed the rule of reciprocity and provided help to a smart speaker device that helped them in a prior interaction. This effect was also moderated by subjects’ personalities, indicating that individual differences are relevant for CASA research. Consequently, this thesis provides strong empirical support for a voice assistants are social actors paradigm. This doctoral dissertation demonstrates the power and utility of this research paradigm for media psychological research and shows how considering voice assistant devices as social actors lead to a more profound understanding of voice-based technology. The findings discussed in this thesis also have implications for these devices that need to be carefully considered both in future research as well as in practical design.
Few topics have been the subject of more controversy than those encapsulated by the terms "sex" and "gender". Social-cultural and biological-evolutionary argumentation patterns frequently clash and especially the public debate appears to be stuck in a stalemate between the two competing parties.
From a psychological perspective both topics appear deeply intertwined and are not easy to be separated. This study pursues an integrative approach to better understand the roots of differences best subsumed under the term sex/gender. It will become apparent that both nature and nurture variables interact and form the complex system of human behavior and experience.
For formative evaluations of user experience (UX) a variety of methods have been developed over the years. However, most techniques require the users to interact with the study as a secondary task. This active involvement in the evaluation is not inclusive of all users and potentially biases the experience currently being studied. Yet there is a lack of methods for situations in which the user has no spare cognitive resources. This condition occurs when 1) users' cognitive abilities are impaired (e.g., people with dementia) or 2) users are confronted with very demanding tasks (e.g., air traffic controllers). In this work we focus on emotions as a key component of UX and propose the new structured observation method Proxemo for formative UX evaluations. Proxemo allows qualified observers to document users' emotions by proxy in real time and then directly link them to triggers. Technically this is achieved by synchronising the timestamps of emotions documented by observers with a video recording of the interaction.
In order to facilitate the documentation of observed emotions in highly diverse contexts we conceptualise and implement two separate versions of a documentation aid named Proxemo App. For formative UX evaluations of technology-supported reminiscence sessions with people with dementia, we create a smartwatch app to discreetly document emotions from the categories anger, general alertness, pleasure, wistfulness and pride. For formative UX evaluations of prototypical user interfaces with air traffic controllers we create a smartphone app to efficiently document emotions from the categories anger, boredom, surprise, stress and pride. Descriptive case studies in both application domains indicate the feasibility and utility of the method Proxemo and the appropriateness of the respectively adapted design of the Proxemo App.
The third part of this work is a series of meta-evaluation studies to determine quality criteria of Proxemo. We evaluate Proxemo regarding its reliability, validity, thoroughness and effectiveness, and compare Proxemo's efficiency and the observers' experience to documentation with pen and paper. Proxemo is reliable, as well as more efficient, thorough and effective than handwritten notes and provides a better UX to observers. Proxemo compares well with existing methods where benchmarks are available.
With Proxemo we contribute a validated structured observation method that has shown to meet requirements formative UX evaluations in the extreme contexts of users with cognitive impairments or high task demands. Proxemo is agnostic regarding researchers' theoretical approaches and unites reductionist and holistic perspectives within one method.
Future work should explore the applicability of Proxemo for further domains and extend the list of audited quality criteria to include, for instance, downstream utility. With respect to basic research we strive to better understand the sources leading observers to empathic judgments and propose reminisce and older adults as model environment for investigating mixed emotions.
Emotional shifts are often a fundamental part of the narrative experience and engrained into the schematic structures of stories. Recent theoretical work suggests that these shifts are key for narrative influence and are interconnected with transportation, a known mechanism of narrative effects. Empirical research examining this proposition is still scarce, inconclusive, and lacking measures that assess the experience of emotional shifts throughout a narrative to explain effects. This thesis aims to contribute to this research lacuna and investigates the link between emotional shifts, transportation, and story-consistent outcomes using different methods to measure emotional shifts in the moment they occur (Manuscript #1 and #2), and using various narrative stimuli (audiovisual, written, auditive).
Manuscript #1 uses real-time-response (RTR) measurement to examine the relationship of valence shifts experienced during film viewing with transportation and post-exposure self-reported emotional flow. Manuscript #2 reports a pilot study and two experiments in which a self-probed emotional retrospection task is used to measure the number and intensity of emotional shifts during reading. I investigate the effect of reviews on transportation, the link between transportation and emotional shifts, and their respective associations with story-consistent attitudes, social sharing intentions, and donation behavior. In Manuscript #3, narrative structures are manipulated. Two experiments examine the effects of audio stories with shifting (positive-negative-positive) vs. positive-only emotional trajectories on the experience of happiness- and sadness-shifts, transportation, and post-exposure emotional flow.
Transportation was positively linked to valence shifts (M#1), and the number and intensity of emotional shifts (M#2), and emotional flow (M#1, M#3). In M#3, transportation was predicted by shifts in happiness, but not sadness. Emotional flow was linked to shifts in happiness, sadness, and RTR valence (M#1, M#3). Emotional shifts and transportation were associated with social sharing intentions, but only transportation was linked to some story-consistent attitudes (affective attitudes in particular).
With the continuous development of artificial intelligence, there is an effort to let the expressed mind of robots resemble more and more human-like minds. However, just as the human-like appearance of robots can lead to feelings of aversion to such robots, recent research has shown that the apparent mind expressed by machines can also be responsible for their negative evaluations. This work strives to explore facets of aversion evoked by machines with human-like mind (uncanny valley of mind) within three empirical projects from a psychological point of view in different contexts, including the resulting consequences.
In Manuscript #1, the perspective of previous work in the research area is reversed and thus shows that humans feel eeriness in response to robots that can read human minds, a capability unknown from human-human interaction. In Manuscript #2, it is explored whether empathy for a robot being harmed by a human is a way to alleviate the uncanny valley of mind. A result of this work worth highlighting is that aversion in this study did not arise from the manipulation of the robot’s mental capabilities but from its attributed incompetence and failure. The results of Manuscript #3 highlight that status threat is revealed if humans perform worse than machines in a work-relevant task requiring human-like mental capabilities, while higher status threat is linked with a higher willingness to interact, due to the machine’s perceived usefulness.
In sum, if explanatory variables and concrete scenarios are considered, people will react fairly positively to machines with human-like mental capabilities. As long as the machine’s usefulness is palpable to people, but machines are not fully autonomous, people seem willing to interact with them, accepting aversion in favor of the expected benefits.
Die Rehabilitation von Gangstörungen bei Patienten mit MS und Schlaganfall erfolgt häufig mithilfe eines konventionellen Laufbandtrainings. Einige Studien haben bereits gezeigt, dass durch eine Erweiterung dieses Trainings um eine virtuelle Realität die Motivation der Patienten gesteigert und die Therapieergebnisse verbessert werden können.
In der vorliegenden Studie wurde eine immersive VR-Anwendung (unter Verwendung eines HMD) für die Gangrehabilitation von Patienten evaluiert. Hierbei wurden ihre Anwendbarkeit und Akzeptanz geprüft sowie ihre Kurzzeiteffekte mit einer semi-immersiven Präsentation (unter Verwendung eines Monitors) und mit einem konventionellen Laufbandtraining ohne VR verglichen. Der Fokus lag insbesondere auf der Untersuchung der Anwendbarkeit beider Systeme und der Auswirkungen auf die Laufgeschwindigkeit und Motivation der Benutzer.
Im Rahmen einer Studie mit Innersubjekt-Design nahmen zunächst 36 gesunde Teilnehmer und anschließend 14 Patienten mit MS oder Schlaganfall an drei experimentellen Bedingungen (VR über HMD, VR über Monitor, Laufbandtraining ohne VR) teil.
Sowohl in der Studie mit gesunden Teilnehmern als auch in der Patientenstudie zeigte sich in der HMD-Bedingung eine höhere Laufgeschwindigkeit als beim Laufbandtraining ohne VR und in der Monitor-Bedingung. Die gesunden Studienteilnehmer berichteten über eine höhere Motivation nach der HMD-Bedingung als nach den anderen Bedingungen. Es traten in beiden Gruppen keine Nebenwirkungen im Sinne einer Simulator Sickness auf und es wurden auch keine Erhöhungen der Herzfrequenzen nach den VR-Bedingungen detektiert. Die Bewertungen des Präsenzerlebens waren in beiden Gruppen in der HMD-Bedingung höher als in der Monitor-Bedingung. Beide VR-Bedingungen erhielten hohe Bewertungen für die Benutzerfreundlichkeit. Die meisten der gesunden Teilnehmer (89 %) und Patienten (71 %) präferierten das HMD-basierte Laufbandtraining unter den drei Trainingsformen und die meisten Patienten könnten sich vorstellen, es häufiger zu nutzen.
Mit der vorliegenden Studie wurde eine strukturierte Evaluation der Anwendbarkeit eines immersiven VR-Systems für die Gangrehabilitation geprüft und dieses erstmals in den direkten Vergleich zu einem semi-immersiven System und einem konventionellen Training ohne VR gesetzt. Die Studie bestätigte die Praktikabilität der Kombination eines Laufbandtrainings mit immersiver VR. Aufgrund ihrer hohen Benutzerfreundlichkeit und der geringen Nebenwirkungen scheint diese Trainingsform besonders für Patienten geeignet zu sein, um deren Trainingsmotivation und Trainingserfolge, wie z. B. die Laufgeschwindigkeit, zu steigern. Da immersive VR-Systeme allerdings nach wie vor spezifische technische Installationsprozeduren erfordern, sollte für die spezifische klinische Anwendung eine Kosten-Nutzen-Bewertung erfolgen.
Computer games are highly immersive, engaging, and motivating learning environments. By providing a tutorial at the start of a new game, players learn the basics of the game's underlying principles as well as practice how to successfully play the game. During the actual gameplay, players repetitively apply this knowledge, thus improving it due to repetition. Computer games also challenge players with a constant stream of new challenges which increase in difficulty over time. As a result, computer games even require players to transfer their knowledge to master these new challenges. A computer game consists of several game mechanics. Game mechanics are the rules of a computer game and encode the game's underlying principles. They create the virtual environments, generate a game's challenges and allow players to interact with the game. Game mechanics also can encode real world knowledge. This knowledge may be acquired by players via gameplay. However, the actual process of knowledge encoding and knowledge learning using game mechanics has not been thoroughly defined, yet. This thesis therefore proposes a theoretical model to define the knowledge learning using game mechanics: the Gamified Knowledge Encoding. The model is applied to design a serious game for affine transformations, i.e., GEtiT, and to predict the learning outcome of playing a computer game that encodes orbital mechanics in its game mechanics, i.e., Kerbal Space Program. To assess the effects of different visualization technologies on the overall learning outcome, GEtiT visualizes the gameplay in desktop-3D and immersive virtual reality. The model's applicability for effective game design as well as GEtiT's overall design are evaluated in a usability study. The learning outcome of playing GEtiT and Kerbal Space Program is assessed in four additional user studies. The studies' results validate the use of the Gamified Knowledge Encoding for the purpose of developing effective serious games and to predict the learning outcome of existing serious games. GEtiT and Kerbal Space Program yield a similar training effect but a higher motivation to tackle the assignments in comparison to a traditional learning method. In conclusion, this thesis expands the understanding of using game mechanics for an effective learning of knowledge. The presented results are of high importance for researches, educators, and developers as they also provide guidelines for the development of effective serious games.
Manifestations of aggressive driving, such as tailgating, speeding, or swearing, are not trivial offenses but are serious problems with hazardous consequences—for the offender as well as the target of aggression. Aggression on the road erases the joy of driving, affects heart health, causes traffic jams, and increases the risk of traffic accidents. This work is aimed at developing a technology-driven solution to mitigate aggressive driving according to the principles of Persuasive Technology. Persuasive Technology is a scientific field dealing with computerized software or information systems that are designed to reinforce, change, or shape attitudes, behaviors, or both without using coercion or deception.
Against this background, the Driving Feedback Avatar (DFA) was developed through this work. The system is a visual in-car interface that provides the driver with feedback on aggressive driving. The main element is an abstract avatar displayed in the vehicle. The feedback is transmitted through the emotional state of this avatar, i.e., if the driver behaves aggressively, the avatar becomes increasingly angry (negative feedback). If no aggressive action occurs, the avatar is more relaxed (positive feedback). In addition, directly after an aggressive action is recognized by the system, the display is flashing briefly to give the driver an instant feedback on his action.
Five empirical studies were carried out as part of the human-centered design process of the DFA. They were aimed at understanding the user and the use context of the future system, ideating system ideas, and evaluating a system prototype. The initial research question was about the triggers of aggressive driving. In a driver study on a public road, 34 participants reported their emotions and their triggers while they were driving (study 1). The second research question asked for interventions to cope with aggression in everyday life. For this purpose, 15 experts dealing with the treatment of aggressive individuals were interviewed (study 2). In total, 75 triggers of aggressive driving and 34 anti-aggression interventions were identified. Inspired by these findings, 108 participants generated more than 100 ideas of how to mitigate aggressive driving using technology in a series of ideation workshops (study 3). Based on these ideas, the concept of the DFA was elaborated on. In an online survey, the concept was evaluated by 1,047 German respondents to get a first assessment of its perception (study 4). Later on, the DFA was implemented into a prototype and evaluated in an experimental driving study with 32 participants, focusing on the system’s effectiveness (study 5). The DFA had only weak and, in part, unexpected effects on aggressive driving that require a deeper discussion.
With the DFA, this work has shown that there is room to change aggressive driving through Persuasive Technology. However, this is a very sensitive issue with special requirements regarding the design of avatar-based feedback systems in the context of aggressive driving. Moreover, this work makes a significant contribution through the number of empirical insights gained on the problem of aggressive driving and wants to encourage future research and design activities in this regard.
Hintergrundmusik wird in verschiedenen audiovisuellen Medienformaten häufig und meist mit einer ganz bestimmten Intention eingesetzt. Ziel dieser Dissertation war es, durch eine umfangreiche Aufarbeitung bisheriger Forschung Faktoren zu ermitteln und empirisch zu testen, die beeinflussen, dass Hintergrundmusik in audiovisuellen Medienformaten prognostizierbar die ihr zugesprochenen Funktionen erfüllt. Als interdisziplinärer Forschungsgegenstand bedarf Hintergrundmusik eines möglichst ausgewogenen Blickwinkels, der Musik- und Medienkontext-Spezifika (und deren potentielle Interaktionen) gleichermaßen berücksichtigt. Um Hintergrundmusik als komplexem audiovisuellen Stimulus in empirischer Forschung gerecht zu werden, spielen zudem auch praktische Implikationen eine große Rolle. Diese Herausforderungen berücksichtigend wurde die Wirksamkeit von Hintergrundmusik in fünf Studien im Kontext von drei verschiedenen Medienformaten untersucht. Da Werbung, Film und informationsvermittelnde Medienformate (wie Dokumentationen und TV-Magazine) die drei Kernfunktionen von Medien – Persuasion, Unterhaltung und Information – repräsentieren, sollte auf Grundlage dieses Dreiklangs die Bandbreite potenzieller Wirkungen von effektiv eingesetzter Musik und von Faktoren, die ihre Wirkung beeinflussen, möglichst umfassend (wenn auch sicher nicht vollständig) abgebildet werden. Über alle Medienformate hinweg kann als wichtiger, die Wirksamkeit von Hintergrundmusik verstärkender Einflussfaktor eine Kongruenz, d.h. eine intuitiv wahrgenommene Passung von Musik und Medienkontext ausgemacht werden, die durch eine sorgfältige Abstimmung der Spezifika von Musik und Medienformat auf emotionaler, auf assoziativer und auf struktureller Ebene erreicht werden kann. Findet diese Anwendung, kann Musik systematisch die Wirksamkeit von Werbespots steigern (Studie 1 und 2), gezielt Bedeutung vermitteln und dadurch die Wahrnehmung und Interpretation von (deutungsoffenen) Filmszenen prägen (Studie 3 und 4) oder unter bestimmten Bedingungen das persuasive Potenzial eines informationsvermittelnden Medienformats steigern und so die Meinungsbildung der Rezipierenden (zumindest kurzfristig) beeinflussen (Studie 5). Die Arbeit verdeutlicht, wie mittels interdisziplinärer Perspektivierung und der Beachtung praktischer Implikationen bereits etabliertes Wissen verstetigt und neue Erkenntnisse zur Verwendung und Wirkung von Hintergrundmusik für Wissenschaft und Medienpraxis abgeleitet werden können – inklusive eines Ausblicks auf daraus resultierende Potenziale für zukünftige Forschung.
In der vorliegenden experimentellen Studie wurde die visuelle Aufmerksamkeit von Anästhesisten während der Einleitung einer Allgemeinanästhesie in Abhängigkeit von ihrer Erfahrung mithilfe eines mobilen Eye-Tracking-Gerätes untersucht. 12 Assistenten mit durchschnittlich 1,3 Jahren klinischer Erfahrung und ebenfalls 12 Fachärzte mit durchschnittlich circa 10 Jahren klinischer Erfahrung nahmen an der Studie teil. Ebenso wurde der simulierte Fall mit der Anästhesieeinleitung am Patienten verglichen. Beide Anästhesisten-Gruppen führten mit der Eye-Tracking-Brille jeweils eine Einleitung so-wohl an einem Simulator im Simulationsraum als auch am Patienten im Einleitungsraum vor dem OP-Saal durch. Diese Brille zeichnete dabei Daten zu Fixationspunkten und Blickbewegungen der Probanden auf. Angelehnt an Schulz et al.21 wurden 24 Areas of Interest definiert und diese den Gruppen „manuelle Tätigkeiten“, „Überwachung“ und „weitere Beobachtungspunkte“ zugeordnet. Als abhängige Variable für die statistische Auswertung wurde die relative Verweildauer in Prozent genutzt und eine multivariate ANOVA gerechnet.
Es ergab sich im Wesentlichen kein signifikanter Effekt des Faktors Erfahrung. Die Assistenten verteilten ihre visuelle Aufmerksamkeit nicht signifikant anders als die erfahreneren Anästhesisten und verhielten sich folglich in Bezug darauf weitgehend gleich. Der Erwerb dieses Verhaltens findet demnach anscheinend schon sehr früh statt, sodass mit 1,3 Jahren Erfahrung in dieser Hinsicht kein Unterschied zu deutlich mehr Erfahrung auftritt. Ein halbstandardisiertes Interview stützt diese Annahme. Der Faktor Umgebung beeinflusste aber signifikant das Verhalten der Anästhesisten. In der Simula-tion widmeten beide Gruppen sowohl der „Überwachung“ insgesamt als auch „manu-ellen Tätigkeiten“ während der Vorbereitungsphase mehr visuelle Aufmerksamkeit als in der Narkoseeinleitung am Patienten. Das ist einerseits mit den Einschränkungen der Simulationspuppe zu erklären und liegt andererseits wahrscheinlich an der ungewohn-ten Umgebung und der unbekannten Pflegekraft, sodass die Anästhesisten das Material länger kontrollierten. Folglich schauten beide Gruppen während der Narkoseeinleitung am Patienten häufiger auf „weitere Beobachtungspunkte“, was auch durch die höhere Komplexität und Störanfälligkeit dieser Situation schlüssig wirkt.
Optimierungsmöglichkeiten der Bedingungen im Simulationsraum werden angespro-chen, Anschlussstudien vorgeschlagen. Es konnte gezeigt werden, dass der Einsatz eines Eye-Tracking-Gerätes auch während der hochsensiblen Einleitung einer Allgemein-anästhesie am Patienten problemlos möglich ist. Darüber hinaus liefert die Studie nun eine stark standardisierte Versuchsmethode, welche für weitere Forschungsfragen sehr empfohlen werden kann.