Refine
Has Fulltext
- yes (22)
Is part of the Bibliography
- yes (22)
Year of publication
Document Type
- Doctoral Thesis (22) (remove)
Keywords
- Mensch-Maschine-Kommunikation (5)
- Lernen (3)
- Psychologie (3)
- Benutzeroberfläche (2)
- Gefühl (2)
- Human-Computer Interaction (2)
- Medien (2)
- Medienkonsum (2)
- Mensch-Maschine Interaktion (2)
- Metakognition (2)
Institute
- Institut Mensch - Computer - Medien (22) (remove)
Ownership and usage of personal voice assistant devices like Amazon Echo or Google Home have increased drastically over the last decade since their market launch. This thesis builds upon existing computers are social actors (CASA) and media equation research that is concerned with humans displaying social reactions usually exclusive to human-human interaction when interacting with media and technological devices. CASA research has been conducted with a variety of technological devices such as desktop computers, smartphones, embodied virtual agents, and robots. However, despite their increasing popularity, little empirical work has been done to examine social reactions towards these personal stand-alone voice assistant devices, also referred to as smart speakers. Thus, this dissertation aims to adopt the CASA approach to empirically evaluate social responses to smart speakers. With this goal in mind, four laboratory experiments with a total of 407 participants have been conducted for this thesis. Results show that participants display a wide range of social reactions when interacting with voice assistants. This includes the utilization of politeness strategies such as the interviewer-bias, which led to participants giving better evaluations directly to a smart speaker device compared to a separate computer. Participants also displayed prosocial behavior toward a smart speaker after interdependence and thus a team affiliation had been induced. In a third study, participants applied gender stereotypes to a smart speaker not only in self-reports but also exhibited conformal behavior patterns based on the voice the device used. In a fourth and final study, participants followed the rule of reciprocity and provided help to a smart speaker device that helped them in a prior interaction. This effect was also moderated by subjects’ personalities, indicating that individual differences are relevant for CASA research. Consequently, this thesis provides strong empirical support for a voice assistants are social actors paradigm. This doctoral dissertation demonstrates the power and utility of this research paradigm for media psychological research and shows how considering voice assistant devices as social actors lead to a more profound understanding of voice-based technology. The findings discussed in this thesis also have implications for these devices that need to be carefully considered both in future research as well as in practical design.
In der vorliegenden experimentellen Studie wurde die visuelle Aufmerksamkeit von Anästhesisten während der Einleitung einer Allgemeinanästhesie in Abhängigkeit von ihrer Erfahrung mithilfe eines mobilen Eye-Tracking-Gerätes untersucht. 12 Assistenten mit durchschnittlich 1,3 Jahren klinischer Erfahrung und ebenfalls 12 Fachärzte mit durchschnittlich circa 10 Jahren klinischer Erfahrung nahmen an der Studie teil. Ebenso wurde der simulierte Fall mit der Anästhesieeinleitung am Patienten verglichen. Beide Anästhesisten-Gruppen führten mit der Eye-Tracking-Brille jeweils eine Einleitung so-wohl an einem Simulator im Simulationsraum als auch am Patienten im Einleitungsraum vor dem OP-Saal durch. Diese Brille zeichnete dabei Daten zu Fixationspunkten und Blickbewegungen der Probanden auf. Angelehnt an Schulz et al.21 wurden 24 Areas of Interest definiert und diese den Gruppen „manuelle Tätigkeiten“, „Überwachung“ und „weitere Beobachtungspunkte“ zugeordnet. Als abhängige Variable für die statistische Auswertung wurde die relative Verweildauer in Prozent genutzt und eine multivariate ANOVA gerechnet.
Es ergab sich im Wesentlichen kein signifikanter Effekt des Faktors Erfahrung. Die Assistenten verteilten ihre visuelle Aufmerksamkeit nicht signifikant anders als die erfahreneren Anästhesisten und verhielten sich folglich in Bezug darauf weitgehend gleich. Der Erwerb dieses Verhaltens findet demnach anscheinend schon sehr früh statt, sodass mit 1,3 Jahren Erfahrung in dieser Hinsicht kein Unterschied zu deutlich mehr Erfahrung auftritt. Ein halbstandardisiertes Interview stützt diese Annahme. Der Faktor Umgebung beeinflusste aber signifikant das Verhalten der Anästhesisten. In der Simula-tion widmeten beide Gruppen sowohl der „Überwachung“ insgesamt als auch „manu-ellen Tätigkeiten“ während der Vorbereitungsphase mehr visuelle Aufmerksamkeit als in der Narkoseeinleitung am Patienten. Das ist einerseits mit den Einschränkungen der Simulationspuppe zu erklären und liegt andererseits wahrscheinlich an der ungewohn-ten Umgebung und der unbekannten Pflegekraft, sodass die Anästhesisten das Material länger kontrollierten. Folglich schauten beide Gruppen während der Narkoseeinleitung am Patienten häufiger auf „weitere Beobachtungspunkte“, was auch durch die höhere Komplexität und Störanfälligkeit dieser Situation schlüssig wirkt.
Optimierungsmöglichkeiten der Bedingungen im Simulationsraum werden angespro-chen, Anschlussstudien vorgeschlagen. Es konnte gezeigt werden, dass der Einsatz eines Eye-Tracking-Gerätes auch während der hochsensiblen Einleitung einer Allgemein-anästhesie am Patienten problemlos möglich ist. Darüber hinaus liefert die Studie nun eine stark standardisierte Versuchsmethode, welche für weitere Forschungsfragen sehr empfohlen werden kann.
Emotional shifts are often a fundamental part of the narrative experience and engrained into the schematic structures of stories. Recent theoretical work suggests that these shifts are key for narrative influence and are interconnected with transportation, a known mechanism of narrative effects. Empirical research examining this proposition is still scarce, inconclusive, and lacking measures that assess the experience of emotional shifts throughout a narrative to explain effects. This thesis aims to contribute to this research lacuna and investigates the link between emotional shifts, transportation, and story-consistent outcomes using different methods to measure emotional shifts in the moment they occur (Manuscript #1 and #2), and using various narrative stimuli (audiovisual, written, auditive).
Manuscript #1 uses real-time-response (RTR) measurement to examine the relationship of valence shifts experienced during film viewing with transportation and post-exposure self-reported emotional flow. Manuscript #2 reports a pilot study and two experiments in which a self-probed emotional retrospection task is used to measure the number and intensity of emotional shifts during reading. I investigate the effect of reviews on transportation, the link between transportation and emotional shifts, and their respective associations with story-consistent attitudes, social sharing intentions, and donation behavior. In Manuscript #3, narrative structures are manipulated. Two experiments examine the effects of audio stories with shifting (positive-negative-positive) vs. positive-only emotional trajectories on the experience of happiness- and sadness-shifts, transportation, and post-exposure emotional flow.
Transportation was positively linked to valence shifts (M#1), and the number and intensity of emotional shifts (M#2), and emotional flow (M#1, M#3). In M#3, transportation was predicted by shifts in happiness, but not sadness. Emotional flow was linked to shifts in happiness, sadness, and RTR valence (M#1, M#3). Emotional shifts and transportation were associated with social sharing intentions, but only transportation was linked to some story-consistent attitudes (affective attitudes in particular).
Spatial presence is a state in which media users temporarily overlook the mediated nature of their experience.
This study discusses stimulus-dependent structure in spontaneous eye-blink behavior as analternative to presence selfreport measures. To this end, theories and empirical evidence on presence, spontaneous eye-blink behavior, and existing approaches for presence assessment are used to link antecedent processes of presence, especially attention, to presence and structure in blinking behavior.
Three experiments in different media environments relate three different methods for quantification of stimulus-dependent structure to an established presence scale. The results are not conclusive, but raise questions on presence and its measurement, and advance the understanding of stimulus-dependent structure in spontaneous eye-blink behavior.
For formative evaluations of user experience (UX) a variety of methods have been developed over the years. However, most techniques require the users to interact with the study as a secondary task. This active involvement in the evaluation is not inclusive of all users and potentially biases the experience currently being studied. Yet there is a lack of methods for situations in which the user has no spare cognitive resources. This condition occurs when 1) users' cognitive abilities are impaired (e.g., people with dementia) or 2) users are confronted with very demanding tasks (e.g., air traffic controllers). In this work we focus on emotions as a key component of UX and propose the new structured observation method Proxemo for formative UX evaluations. Proxemo allows qualified observers to document users' emotions by proxy in real time and then directly link them to triggers. Technically this is achieved by synchronising the timestamps of emotions documented by observers with a video recording of the interaction.
In order to facilitate the documentation of observed emotions in highly diverse contexts we conceptualise and implement two separate versions of a documentation aid named Proxemo App. For formative UX evaluations of technology-supported reminiscence sessions with people with dementia, we create a smartwatch app to discreetly document emotions from the categories anger, general alertness, pleasure, wistfulness and pride. For formative UX evaluations of prototypical user interfaces with air traffic controllers we create a smartphone app to efficiently document emotions from the categories anger, boredom, surprise, stress and pride. Descriptive case studies in both application domains indicate the feasibility and utility of the method Proxemo and the appropriateness of the respectively adapted design of the Proxemo App.
The third part of this work is a series of meta-evaluation studies to determine quality criteria of Proxemo. We evaluate Proxemo regarding its reliability, validity, thoroughness and effectiveness, and compare Proxemo's efficiency and the observers' experience to documentation with pen and paper. Proxemo is reliable, as well as more efficient, thorough and effective than handwritten notes and provides a better UX to observers. Proxemo compares well with existing methods where benchmarks are available.
With Proxemo we contribute a validated structured observation method that has shown to meet requirements formative UX evaluations in the extreme contexts of users with cognitive impairments or high task demands. Proxemo is agnostic regarding researchers' theoretical approaches and unites reductionist and holistic perspectives within one method.
Future work should explore the applicability of Proxemo for further domains and extend the list of audited quality criteria to include, for instance, downstream utility. With respect to basic research we strive to better understand the sources leading observers to empathic judgments and propose reminisce and older adults as model environment for investigating mixed emotions.
Manifestations of aggressive driving, such as tailgating, speeding, or swearing, are not trivial offenses but are serious problems with hazardous consequences—for the offender as well as the target of aggression. Aggression on the road erases the joy of driving, affects heart health, causes traffic jams, and increases the risk of traffic accidents. This work is aimed at developing a technology-driven solution to mitigate aggressive driving according to the principles of Persuasive Technology. Persuasive Technology is a scientific field dealing with computerized software or information systems that are designed to reinforce, change, or shape attitudes, behaviors, or both without using coercion or deception.
Against this background, the Driving Feedback Avatar (DFA) was developed through this work. The system is a visual in-car interface that provides the driver with feedback on aggressive driving. The main element is an abstract avatar displayed in the vehicle. The feedback is transmitted through the emotional state of this avatar, i.e., if the driver behaves aggressively, the avatar becomes increasingly angry (negative feedback). If no aggressive action occurs, the avatar is more relaxed (positive feedback). In addition, directly after an aggressive action is recognized by the system, the display is flashing briefly to give the driver an instant feedback on his action.
Five empirical studies were carried out as part of the human-centered design process of the DFA. They were aimed at understanding the user and the use context of the future system, ideating system ideas, and evaluating a system prototype. The initial research question was about the triggers of aggressive driving. In a driver study on a public road, 34 participants reported their emotions and their triggers while they were driving (study 1). The second research question asked for interventions to cope with aggression in everyday life. For this purpose, 15 experts dealing with the treatment of aggressive individuals were interviewed (study 2). In total, 75 triggers of aggressive driving and 34 anti-aggression interventions were identified. Inspired by these findings, 108 participants generated more than 100 ideas of how to mitigate aggressive driving using technology in a series of ideation workshops (study 3). Based on these ideas, the concept of the DFA was elaborated on. In an online survey, the concept was evaluated by 1,047 German respondents to get a first assessment of its perception (study 4). Later on, the DFA was implemented into a prototype and evaluated in an experimental driving study with 32 participants, focusing on the system’s effectiveness (study 5). The DFA had only weak and, in part, unexpected effects on aggressive driving that require a deeper discussion.
With the DFA, this work has shown that there is room to change aggressive driving through Persuasive Technology. However, this is a very sensitive issue with special requirements regarding the design of avatar-based feedback systems in the context of aggressive driving. Moreover, this work makes a significant contribution through the number of empirical insights gained on the problem of aggressive driving and wants to encourage future research and design activities in this regard.
The rising use of new media has given rise to public discussions about their possible negative consequences. The social sciences have answered these concerns, providing many studies investigating different media types (e.g., social media, video games) and different related variables (e.g., psychological well-being, academic achievement). Within this big body of research, some research results have confirmed negative associations with frequent media use; other studies have found no or even positive relationships. With heterogeneous results, it is difficult to obtain a clear picture of the relationships and causalities of new media. The method of meta-analysis allows a synthesis of all existing data, providing an overall effect size as well as moderator and mediator analyses which might explain the heterogeneity. Three manuscripts present meta-analytic evidence related to a) the relationship between social media use and academic achievement, b) the relationship between video gaming and overweight, and c) the relationship between social media and psychological correlates. Manuscript #1 found small relationships which depend on the usage pattern of social media. The relationship is positive, as long as social media use is related to school. Manuscript #2 showed that children’s and adolescents’ video gaming is independent from their body mass, while adults who play more have a higher body mass. Manuscript #3 summarized existing meta-analytic evidence that links social media with psychological wellbeing, academic achievement, and narcissism with small to moderate effect sizes. All three manuscripts underscore the potential of meta-analyses to synthesize previous research and to identify moderators. Although meta-analyses are not necessarily superior to other approaches because of their limitations (e.g. limited information or quality of primary studies) they are very promising for media psychology. Meta-analyses can reduce complexity and might be helpful for the communication of research results to the general public.
In this thesis, metacognition research is connected with fluency research. Thereby, the focus lies on how disfluency can be used to improve metacognitive monitoring (i.e., students` judgments during the learning process). Improving metacognitive monitoring is important in educational contexts in order to foster performance. Theories about metacognition and self-regulated learning suppose that monitoring affects control and performance. Accurate monitoring is necessary to initiate adequate control and better performance. However, previous research shows that students are often not able to accurately monitor their learning with meaningful text material. Inaccurate monitoring can result in inadequate control and low performance.
One reason for inaccurate monitoring is that students use cues for their judgments that are not valid predictors of their performance. Because fluency might be such a cue, the first aim of this thesis is to investigate under which conditions fluency is used as a cue for judgments during the learning process. A fluent text is easy to process and, hence, it should be judged as easy to learn and as easy to remember. Inversely, a disfluent text is difficult to process, for example because of a disfluent font type (e.g., Mistral) or because of deleted letters (e.g., l_tt_rs). Hence, a disfluent text should be judged as difficult to learn and as difficult to remember. This assumption is confirmed when students learn with both fluent and disfluent material. When fluency is manipulated between persons, fluency seems to be less obvious as a cue for judgments. However, there are only a few studies that investigated the effects of fluency on judgments when fluency is manipulated between persons. Results from Experiment 1 (using deleted letters for disfluent text) and from Experiment 4 (using Mistral for disfluent text) in this thesis support the assumption that fluency is used as a cue for judgments in between-person designs. Thereby, however, the interplay with the type of judgment and the learning stage seems to matter.
Another condition when fluency affects judgments was investigated in Experiment 2 and 3. The aim of these experiments was to investigate if disfluency leads to analytic monitoring and if analytic monitoring sustains for succeeding fluent material. If disfluency activates analytic monitoring that remains for succeeding fluent material, fluency should no longer be used as a cue for judgments. Results widely support this assumption for deleted letters (Experiment 2) as well as for the font type Mistral (Experiment 3). Thereby, again the interplay between the type of judgment and the learning stage matters.
Besides the investigation of conditions when fluency is used as a cue for different types of judgments during the learning process, another aim of this thesis is to investigate if disfluency leads to accurate monitoring. Results from Experiment 3 and 4 support the assumption that Mistral can reduce overconfidence. This is the case when fluency is manipulated between persons or when students first learn with a fluent and then with a disfluent text. Dependent from the type of judgment and the learning stage, disfluency can lead even to underconfidence or to improved relative monitoring accuracy (Experiment 4).
Improving monitoring accuracy is only useful when monitoring is implemented into better control and better performance. The effect of monitoring accuracy on control and performance was in the focus of Experiment 4. Results show that accurate monitoring does not result in improved control and performance. Thus, further research is required to develop interventions that do not only improve monitoring accuracy but that also help students to implement accurate monitoring into better control and performance.
Summing up, the aim of this thesis is to investigate under which conditions fluency is used as a cue for judgments during the learning process, how disfluency can be used to improve monitoring accuracy, and if improved monitoring accuracy leads to improved performance. By connecting metacognition research and fluency research, further theories about metacognition and theories about fluency are specified. Results show that not only the type of fluency and the design, but also the type of judgment, the type of monitoring accuracy, and the learning stage should be taken into account. Understanding conditions that affect the interplay between metacognitive processes and performance as well as understanding the underlying mechanisms is necessary to enable systematic research and to apply findings into educational settings.
Im Rahmen der vorliegenden Arbeit wurden vier Experimente zur Eignung von Marginalien als Lernhilfen im Hypertext durchgeführt. Die grundlegende Annahme lautet dabei, dass Marginalien als Kommentar zum Text aufgefasst werden und somit im Vergleich zu intratextuellen Lernhilfen wie Überschriften oder absatzeinleitenden Makropropositionen zu einer interaktiven und tieferen Verarbeitung der Lerninhalte führen. Als Lernmedium wurden eine hierarchische Hypertextumgebung zum Thema Fragebogenkonstruktion und eine netzförmige Hypertextumgebung zur Bedeutung des Buchdrucks in der Medientheorie eingesetzt.
Experiment 1 (N= 41) verglich mittels between-Design die Lernleistung bei Marginalien mit einer Präsentation derselben Makropropositionen als absatzeinleitende Topic-Sätze und einer Platzierung der Makropropositionen am Absatzende. Die Ergebnisse zeigen, dass absatzweise Marginalien im Vergleich zu absatzeinleitenden Makropropositionen und der Kontrollgruppe zu einem besseren Abschneiden bei geschlossenen Inferenzfragen führen. Hinsichtlich geschlossener Fragen zur Textbasis konnten jedoch die absatzeinleitenden Makropropositionen im Vergleich mit den beiden anderen Bedingungen die besten Ergebnisse erzielen.
Experiment 2 (N= 105) verglich den Einfluss von Marginalien mit Überschriften und einer Kontrollgruppe ohne absatzweise Explikation der Makrostruktur auf das Schreiben einer Zusammenfassung des Lerntextes. Zusätzlich wurden erneut geschlossene Inferenzfragen präsentiert. Ergänzend wurde das Rezeptionsverhalten mittels Blickbewegungsmessung ermittelt. Dabei zeigten sich signifikante Unterschiede zwischen Überschriften und Marginalien. Marginalien wurden in der hierarchischen Hypertextumgebung allgemein seltener gelesen als Überschriften und zeigten auch hinsichtlich der Anzahl der strategischen Rezeptionen und der absatzeinleitenden Rezeption geringere Werte. Einzig nach der Rezeption des zugehörigen Absatzes wurden Marginalien häufiger konsultiert als Überschriften. Diese Unterschiede gingen einher mit signifikanten Einbußen der Lernleistung der Marginalienbedingung im Vergleich zur Überschriftenbedingung. So erinnerten Lerner mit Marginalien weniger explizite Makropropositionen des Lerntextes, weniger Fakteninformationen, sowie weniger Inhalte verschiedener Hypertextknoten und bildeten außerdem weniger eigene Makropropositionen. Hinsichtlich der letzten beiden Variablen war die Marginalienbedingung sogar der Kontrollbedingung unterlegen.
Experiment 3 (N = 54) verwendete im Gegensatz zu den Experimenten 1 und 2 einen netzförmig organisierten Hypertext mit embedded Links anstelle eines Navigationsmenüs. Die untersuchten Versuchsbedingungen sowie die Messung der Lernleistung waren jedoch analog zu Experiment 1. Auch hier konnte ein Effekt von Marginalien auf die Inferenzleistung nachgewiesen werden. Allerdings schnitten Marginalien nur besser als die absatzeinleitenden Makropropositionen ab, wohin-gegen kein Unterschied zur Kontrollbedingung festgestellt werden konnten. Hinsichtlich der Leistung bei geschlossenen Faktenfragen konnte die Überlegenheit absatzeinleitender Makropropositionen gegenüber den anderen beiden Präsentationsformen der Makrostruktur erneut bestätigt werden.
Experiment 4 (N= 75) verglich analog zu Experiment 2 unter Verwendung der netzförmigen Lernumgebung aus Experiment 3 erneut den Einfluss von Marginalien, Überschriften und einer Kontrollbedingung ohne explizite absatzweise Makropropositionen auf das Schreiben einer Zusammenfassung sowie die Beantwortung geschlossener Inferenzfragen. Auch die Blickbewegungsmessung kam wieder zum Einsatz. Die Ergebnisse von Experiment 2 konnten jedoch nicht bestätigt werden. Es fanden sich keine signifikanten Unterschiede hinsichtlich der Lernleistung zwischen den drei Versuchsbedingungen und auch hinsichtlich des Rezeptionsverhaltens konnte eine Angleichung von Marginalien und Überschriften festgestellt werden. Hinsichtlich der Lernleistung wird angenommen, dass die embedded Links in Kombination mit der Instruktion, eine Zusammenfassung zu schreiben mit den Überschriften und den Marginalien, die jedoch im Vergleich zu Experiment 2 fast vollständig wie Überschriften genutzt wurden, interferiert haben und somit eine Hemmung dieser Lernhilfen stattgefunden hat.
Anhand der vier durchgeführten Experimente wird gefolgert, dass Marginalien als Explikation der lokalen Makrostruktur sowohl bei hierarchisch strukturiertem Hypertext als auch bei netzförmig organisiertem Hypertext unter der Instruktion eines verstehenden Lernens eine Verbesserung der Inferenzleistung bewirken können. Lautet die Instruktion jedoch, eine Zusammenfassung der In-halte zu schreiben, sind Marginalien speziell bei hierarchisch strukturiertem Hypertext wenig geeignet, die Lernleistung zu fördern.
Intuitive Benutzung wird in dieser Arbeit definiert als das Ausmaß, mit dem ein Produkt mental effizient und effektiv genutzt wird, was mit einem starken metakognitiven Gefühl von Flüssigkeit einhergeht. Aktuelle Methoden verfügen nicht über eine ausreichend hohe zeitliche Anwendungseffizienz, um im Industrieprojekt 3D-GUIde effektiv zur Evaluation von Interaktionspatterns für 3D-Creation-Oriented-User-Interfaces (3D-CUIs) eingesetzt werden zu können. Diese Interaktionspatterns beschreiben strukturiert, wie 3D-CUIs als User Interfaces zur Erstellung von dreidimensionalen Inhalten gestaltet werden müssen, um intuitive Benutzung zu unterstützen. In dieser Arbeit werden daher zwei neue Evaluationsmethoden vorgeschlagen: 1) IntuiBeat-F als formative Evaluationsmethode und 2) IntuiBeat-S als summative Evaluationsmethode. Basierend auf Default-Interventionist-Theorien und bestehenden Definitionen intuitiver Benutzung werden die mentale Beanspruchung als zentrales objektives, das metakognitive Gefühl von Flüssigkeit als zentrales subjektives und die Effektivität als zentrales pragmatisches mit intuitiver Benutzung assoziiertes Merkmal identifiziert. Die Evaluation intuitiver Benutzung mithilfe von IntuiBeat-F und IntuiBeat-S ist vielversprechend, da es sich bei beiden Methoden um Inhibition basierende Rhythmuszweitaufgaben handelt und diese somit mentale Beanspruchung objektiv erfassen können. Das Potential beider Methoden wird im Hinblick auf vorherige Forschungsarbeiten zur zeitlich effizienten Evaluation von 3D-CUIs aus der Mensch-Computer-Interaktion und der Psychologie diskutiert. Aus dieser Diskussion werden empirische Forschungsfragen abgeleitet. Die erste Forschungsfrage untersucht die wissenschaftliche Güte von IntuiBeat-S. Im ersten, zweiten und dritten Experiment werden Paare von 3D-CUIs miteinander summativ verglichen (d.h. weniger vs. stärker intuitiv benutzbare User Interfaces). Dabei wird die wissenschaftliche Güte von IntuiBeat-S hinsichtlich der Hauptgütekriterien Objektivität, Reliabilität und Validität beurteilt. Die Ergebnisse zeigen, dass IntuiBeat-S eine hohe wissenschaftliche Güte bei der summativen Evaluation besitzt. Zudem macht es bei der Anwendung von IntuiBeat-S keinen Unterschied, ob der Rhythmus über die Ferse oder den Fußballen eingeben wird, und ob als Stichproben Studierende mit höherer oder geringerer Vorerfahrung bezüglich der Nutzung von 3D-CUIs verwendet werden. Die zweite Forschungsfrage untersucht die wissenschaftliche Güte von IntuiBeat-F. Im vierten, fünften, sechsten und siebten Experiment werden 3D-CUIs einzeln formativ evaluiert (d.h. entweder ein weniger oder stärker intuitiv benutzbares User Interface). Dabei wird die wissenschaftliche Güte von IntuiBeat-F hinsichtlich der Hauptgütekriterien Gründlichkeit, Gültigkeit und Zuverlässigkeit beurteilt. Die Ergebnisse zeigen, dass IntuiBeat-F eine hohe wissenschaftliche Güte bei der formativen Evaluation besitzt. Diese liegt bei strikter Anwendung der Methode (d.h. Berücksichtigung ausschließlich mit der Methode entdeckter Nutzungsprobleme) zwar höher, ist aber bei wenig strikter Anwendung der Methode (d.h. Berücksichtigung auch unabhängig von der Methode entdeckter Nutzungsprobleme) noch ausreichend hoch. Jedoch konnte erst die Entwicklung und Einführung einer zusätzlichen Analysesoftware im Zuge des sechsten und siebten Experiments die wissenschaftliche Güte von IntuiBeat-F hinsichtlich aller drei Hauptgütekriterien demonstrieren, da ohne deren Unterstützung IntuiBeat-F vom Evaluator nicht ausreichend gründlich angewendet wird. Die dritte Forschungsfrage untersucht, wie hoch die zeitliche Anwendungseffizienz beider Methoden als wichtiger Aspekt praktischer Güte im Vergleich zu bereits vorhandenen Evaluationsmethoden für intuitive Benutzung ist. Bezüglich der summativen Evaluation wird im zweiten Experiment eine höhere zeitliche Anwendungseffizienz von IntuiBeat-S im Vergleich zum aktuellen summativen Benchmark, der CHAI-Methode, sowohl bei der Evaluation von weniger als auch bei der von stärker intuitiv benutzbaren 3D-CUIs demonstriert. Auch bezüglich der formativen Evaluation konnten die Ergebnisse der letzten vier Experimente zeigen, dass die zeitliche Anwendungseffizienz von IntuiBeat-F im Vergleich zum aktuellen formativen Benchmark, dem Nutzertest mit retrospektivem Think-Aloud- Protokoll, sowohl bei der Evaluation von weniger als auch stärker intuitiv benutzbaren 3D-CUIs höher liegt. Dieser Unterschied bleibt bestehend, egal ob eine zusätzliche Analysesoftware vom Evaluator verwendet wird oder nicht. Als Ergebnis aller Experimente lässt sich feststellen, dass die wissenschaftliche Güte und die zeitliche Anwendungseffizienz beider Methoden zur Evaluation intuitiver Benutzung von 3D-CUIs mehr als zufriedenstellend beurteilt werden kann. Die Arbeit wird mit einer Diskussion des geleisteten Forschungsbeitrags geschlossen. Dabei werden Anregungen für künftige Forschung aus theoretischer (z.B. Berücksichtigung des Gefühls von Flüssigkeit bei der Evaluation), praktischer (z.B. Untersuchung der Anwendbarkeit beider Methoden in anderen Domänen) und methodischer (z.B. Beurteilung der praktischen Güte beider Methoden anhand anderer Kriterien) Perspektive gegeben.
The field of human-computer interaction (HCI) strives for innovative user interfaces. Innovative and novel user interfaces are a challenge for a growing population of older users and endanger older adults to be excluded from an increasingly digital world. This is because older adults often have lower cognitive abilities and little prior experiences with technology.
This thesis aims at resolving the tension between innovation and age-inclusiveness by developing user interfaces that can be used regardless of cognitive abilities and technology-dependent prior knowledge.
The method of image-schematic metaphors holds promises for innovative and age-inclusive interaction design. Image-schematic metaphors represent a form of technology-independent prior knowledge. They reveal basic mental models and can be gathered in language (e.g. bank account is container from "I put money into my bank account").
Based on a discussion of previous applications of image-schematic metaphors in HCI, the present work derives three empirical research questions regarding image-schematic metaphors for innovative and age-inclusive interaction design.
The first research question addresses the yet untested assumption that younger and older adults overlap in their technology-independent prior knowledge and, therefore, their usage of image-schematic metaphors. In study 1, a total of 41 participants described abstract concepts from the domains of online banking and everyday life. In study 2, ten contextual interviews were conducted. In both studies, younger and older adults showed a substantial overlap of 70% to 75%, indicating that also their mental models overlap substantially.
The second research question addresses the applicability and potential of image-schematic metaphors for innovative design from the perspective of designers. In study 3, 18 student design teams completed an ideation process with either an affinity diagram as the industry standard, image-schematic metaphors or both methods in combination and created paper prototypes. The image-schematic metaphor method alone, but not the combination of both methods, was readily adopted and applied just as a well as the more familiar standard method.
In study 4, professional interaction designers created prototypes either with or without image-schematic metaphors. In both studies, the method of image-schematic metaphors was perceived as applicable and creativity stimulating.
The third research question addresses whether designs that explicitly follow image-schematic metaphors are more innovative and age-inclusive regarding differences in cognitive abilities and prior technological knowledge. In two experimental studies (study 5 and 6) involving a total of 54 younger and 53 older adults, prototypes that were designed with image-schematic metaphors were perceived as more innovative compared to those who were designed without image-schematic metaphors. Moreover, the impact of prior technological knowledge on interaction was reduced for prototypes that had been designed with image-schematic metaphors. However, participants' cognitive abilities and age still influenced the interaction significantly.
The present work provides empirical as well as methodological findings that can help to promote the method of image-schematic metaphors in interaction design. As a result of these studies it can be concluded that the image-schematic metaphors are an applicable and effective method for innovative user interfaces that can be used regardless of prior technological knowledge.
Affective states in the context of learning and achievement can influence the learning process essentially. The impact of affective states can be both directly on the learning performance and indirectly mediated via, for example, motivational processes. Positive activating affect is often associated with increased memory skills as well as advantages in creative problem solving. Negative activating affect on the other hand is regarded to impair learning outcomes because of promoting task-irrelevant thinking. While these relationships were found to be relatively stable in correlation studies, causal relationships have been examined rarely so far. This dissertation aims to investigate the effects of positive and negative affective states in multimedia learning settings and to identify potential moderating factors. Therefore, three experimental empirical studies on university students were conducted. In Experiment 1, N = 57 university students were randomly allocated to either a positive or negative affect induction group. Affects were elicited using short film clips. After a 20-minute learning phase in a hypertext-based multimedia learning environment on “functional neuroanatomy” the learners’ knowledge as well as transfer performance were measured. It was assumed that inducing positive activating affect should enhance learning performance. Eliciting negative activating affect on the other hand should impair learning performance. However, it was found that the induction of negative activating affect prior to the learning phase resulted in slight deteriorations in knowledge. Contrary to the assumptions, inducing positive activating affect before the learning phase did not improve learning performance. Experiment 2 induced positive activating affect directly during learning. To induce affective states during the entire duration of the learning phase, Experiment 2 used an emotional design paradigm. Therefore, N = 111 university students were randomly assigned to learn either in an affect inducing multimedia learning environment (use of warm colours and round shapes) or an affectively neutral counterpart (using shades of grey and angular shapes) on the same topic as in Experiment 1. Again, knowledge as well as transfer performance were measured after learning for 20 minutes. In addition, positive and negative affective states were measured before and after learning. Complex interaction patterns between the treatment and initial affective states were found. Specifically, learners with high levels of positive affect before learning showed better transfer performance when they learned in the affect inducing learning environment. Regarding knowledge, those participants who reported high levels of negative activating affect prior to the learning period performed worse. However, the effect on knowledge did not occur for those students learning in the affect inducing learning environment. For knowledge, the treatment therefore protected against poorer performance due to high levels of negative affective states. Results of Experiment 2 showed that the induction of positive activating affect influenced learning performance positively when taking into account affective states prior to the learning phase. In order to confirm these interaction effects, a conceptual replication of the previous experiment was conducted in Experiment 3. Experiment 3 largely retained the former study design, but changed the learning materials and tests used. Analogous to Experiment 2, N = 145 university students learning for 20 minutes in either an affect inducing or an affectively neutral multimedia learning environment on “eukaryotic cell”. To strengthen the treatment, Experiment 3 also used anthropomorphic design elements to induce affective states next to warm colours and round shapes. Moreover, in order to assess the change in affective states more exactly, an additional measurement of positive and negative affective states after half of the learning time was inserted. Knowledge and transfer were assessed again to measure learning performance. The learners’ memory skills were used as an additional learning outcome. To control the influence of potential confounding variables, the participants’ general and current achievement motivation as well as interest, and emotion regulation skills were measured. Contrary to the assumptions, Experiment 3 could not confirm the interaction effects of Experiment 2. Instead, there was a significant impact of positive activating affect prior to the learning phase on transfer, irrespective of the learners’ group affiliation. This effect was further independent of the control variables that were measured. Nevertheless, the results of Experiment 3 fit into the picture of findings regarding “emotional design” in hypermedia learning settings. To date, the few publications that have used this approach propose heterogeneous results, even when using identical materials and procedures.
The impact of stories in their ability to shape our view on the world has long been a central topic in communication science and media psychology. While reading a book or watching a movie, we are transported into story worlds and we identify with depicted protagonists. Several studies showed that high levels of transportation lead to greater story-consistent beliefs. Similar effects were found for identification. However, much less is known how and in which direction stories could affect the self. Five experimental studies were conducted and summarized in three manuscripts. Manuscript #1 explored the moderating role of transportation that could shift one’s self-perception towards traits of a depicted story character (assimilation) or away from him/her (contrast). Manuscript #2 focused on downward social comparisons with a protagonist and possible contrast effects on participants’ self-perception in relation to others, their motives and behavior. Thereby, the mediating role of transportation and identification were investigated. Finally, upward social comparison with a protagonist and related emotions (e.g., envy) that mediate possible effects on one’s self perception and behavioral intentions were investigated in manuscript #3.
This dissertation project contributes to the literature on stories and the self. Consistent with previous work, assimilation effects were found for highly transported recipients. However, stories might also elicit contrast effects on recipients’ selves and behavioral intentions that are opposite to a depicted character. Extending prior research, there were evidence that transportation and envy are important process variables explaining assimilation vs. contrast effects.
With the continuous development of artificial intelligence, there is an effort to let the expressed mind of robots resemble more and more human-like minds. However, just as the human-like appearance of robots can lead to feelings of aversion to such robots, recent research has shown that the apparent mind expressed by machines can also be responsible for their negative evaluations. This work strives to explore facets of aversion evoked by machines with human-like mind (uncanny valley of mind) within three empirical projects from a psychological point of view in different contexts, including the resulting consequences.
In Manuscript #1, the perspective of previous work in the research area is reversed and thus shows that humans feel eeriness in response to robots that can read human minds, a capability unknown from human-human interaction. In Manuscript #2, it is explored whether empathy for a robot being harmed by a human is a way to alleviate the uncanny valley of mind. A result of this work worth highlighting is that aversion in this study did not arise from the manipulation of the robot’s mental capabilities but from its attributed incompetence and failure. The results of Manuscript #3 highlight that status threat is revealed if humans perform worse than machines in a work-relevant task requiring human-like mental capabilities, while higher status threat is linked with a higher willingness to interact, due to the machine’s perceived usefulness.
In sum, if explanatory variables and concrete scenarios are considered, people will react fairly positively to machines with human-like mental capabilities. As long as the machine’s usefulness is palpable to people, but machines are not fully autonomous, people seem willing to interact with them, accepting aversion in favor of the expected benefits.
Die vorliegende Rahmenschrift der kumulativen Dissertation umfasst zunächst einen einleitenden Teil, der die zentralen Begriffe „prosoziales Verhalten“ und „prosoziale Musik“ definiert. Anschließend werden der Stand der Forschung zu den Inhalten populärer Musik und zur Wirkung prosozialer Musik aufgezeigt. Im darauffolgenden Abschnitt werden die theoretischen Grundlagen für die Wirkungsstudien dieser Arbeit dargestellt und diskutiert. Das theoretische Gerüst bilden das General Learning Model sowie das Reciprocal Feedback Model of Musical Response. Aspekte dieser theoretischen Ansätze werden schließlich kombiniert, um sie in ein eigenes Musikwirkungsmodell zu überführen. Das übergeordnete Forschungsvorhaben wird in zwei zentrale Vorhaben aufgeteilt – die Analyse der Repräsentation und die Untersuchung der Wirkung prosozialer Musik – und im anschließenden Kapitel dargestellt. Im Zentrum des Dissertationsprojekts stehen die vier empirischen Arbeiten, mit denen die Forschungsvorhaben realisiert wurden. Um die Repräsentation pro-sozialen Verhaltens in populärer Musik zu untersuchen, wurde eine Inhaltsanalyse durchgeführt (erschienen bei Musicae Scientiae). Zur Überprüfung der Wirkung prosozialer Musik wurden eine experimentelle Feldstudie (erschienen bei Psychology of Music), zwei aufeinander aufbau-ende Online-Experimente (erschienen bei Musicae Scientiae) und schließlich ein mehrfaktorielles Online-Experiment (erschienen bei Psychology of Music) realisiert. Diese Studien werden in der anschließenden Synopse kurz dargestellt und zueinander in Bezug gesetzt. Den Schluss der Rahmenschrift bilden eine Zusammenfassung und Diskussion der Ergebnisse sowie ein Fazit mit Ausblick auf mögliche weitere Untersuchungen.
Die Rehabilitation von Gangstörungen bei Patienten mit MS und Schlaganfall erfolgt häufig mithilfe eines konventionellen Laufbandtrainings. Einige Studien haben bereits gezeigt, dass durch eine Erweiterung dieses Trainings um eine virtuelle Realität die Motivation der Patienten gesteigert und die Therapieergebnisse verbessert werden können.
In der vorliegenden Studie wurde eine immersive VR-Anwendung (unter Verwendung eines HMD) für die Gangrehabilitation von Patienten evaluiert. Hierbei wurden ihre Anwendbarkeit und Akzeptanz geprüft sowie ihre Kurzzeiteffekte mit einer semi-immersiven Präsentation (unter Verwendung eines Monitors) und mit einem konventionellen Laufbandtraining ohne VR verglichen. Der Fokus lag insbesondere auf der Untersuchung der Anwendbarkeit beider Systeme und der Auswirkungen auf die Laufgeschwindigkeit und Motivation der Benutzer.
Im Rahmen einer Studie mit Innersubjekt-Design nahmen zunächst 36 gesunde Teilnehmer und anschließend 14 Patienten mit MS oder Schlaganfall an drei experimentellen Bedingungen (VR über HMD, VR über Monitor, Laufbandtraining ohne VR) teil.
Sowohl in der Studie mit gesunden Teilnehmern als auch in der Patientenstudie zeigte sich in der HMD-Bedingung eine höhere Laufgeschwindigkeit als beim Laufbandtraining ohne VR und in der Monitor-Bedingung. Die gesunden Studienteilnehmer berichteten über eine höhere Motivation nach der HMD-Bedingung als nach den anderen Bedingungen. Es traten in beiden Gruppen keine Nebenwirkungen im Sinne einer Simulator Sickness auf und es wurden auch keine Erhöhungen der Herzfrequenzen nach den VR-Bedingungen detektiert. Die Bewertungen des Präsenzerlebens waren in beiden Gruppen in der HMD-Bedingung höher als in der Monitor-Bedingung. Beide VR-Bedingungen erhielten hohe Bewertungen für die Benutzerfreundlichkeit. Die meisten der gesunden Teilnehmer (89 %) und Patienten (71 %) präferierten das HMD-basierte Laufbandtraining unter den drei Trainingsformen und die meisten Patienten könnten sich vorstellen, es häufiger zu nutzen.
Mit der vorliegenden Studie wurde eine strukturierte Evaluation der Anwendbarkeit eines immersiven VR-Systems für die Gangrehabilitation geprüft und dieses erstmals in den direkten Vergleich zu einem semi-immersiven System und einem konventionellen Training ohne VR gesetzt. Die Studie bestätigte die Praktikabilität der Kombination eines Laufbandtrainings mit immersiver VR. Aufgrund ihrer hohen Benutzerfreundlichkeit und der geringen Nebenwirkungen scheint diese Trainingsform besonders für Patienten geeignet zu sein, um deren Trainingsmotivation und Trainingserfolge, wie z. B. die Laufgeschwindigkeit, zu steigern. Da immersive VR-Systeme allerdings nach wie vor spezifische technische Installationsprozeduren erfordern, sollte für die spezifische klinische Anwendung eine Kosten-Nutzen-Bewertung erfolgen.
Errors in Prospective Memory
(2019)
Prospective memory is the ability to implement intentions at a later point in time in response to a specified cue. Such prospective memory tasks often occur in daily living and workplace situations. However, in contrast to retrospective memory there has been relatively little research on prospective memory. The studies by Harris (1984) and Einstein and MacDaniel (1990) served as a starting point for a now steadily growing area of research. Based on this emerging field of study this dissertation presents and connects and five journal articles, which further explore prospective memory by focusing on its potential errors.
The first article addresses the question if additional cognitive resources are needed after a prospective memory cue occurs to keep the intention active until it is implemented. The theory by Einstein, McDaniel, Williford, Pagan and Dismukes (2003), which suggested this active maintenance, could not be replicated. The second article demonstrated that interruptions between cue and the window of opportunity to implement the intention reduce prospective memory performance, especially if the interruption is tied with a change of context. Article three to five were focused on the erroneous implementation of a no longer active prospective memory task, so called commission errors. The suggested mechanism for their occurrence, the dual-mechanism account (Bugg, Scullin, & Rauvola, 2016), was not suited to explain the present results. A modification for the dual-mechanism account was formulated, which can account for prior work, as well as for the present data.
The results of all five articles also indicate that the moment of cue retrieval is even more relevant for prospective memory and its errors than previously accounted for.
Hintergrundmusik wird in verschiedenen audiovisuellen Medienformaten häufig und meist mit einer ganz bestimmten Intention eingesetzt. Ziel dieser Dissertation war es, durch eine umfangreiche Aufarbeitung bisheriger Forschung Faktoren zu ermitteln und empirisch zu testen, die beeinflussen, dass Hintergrundmusik in audiovisuellen Medienformaten prognostizierbar die ihr zugesprochenen Funktionen erfüllt. Als interdisziplinärer Forschungsgegenstand bedarf Hintergrundmusik eines möglichst ausgewogenen Blickwinkels, der Musik- und Medienkontext-Spezifika (und deren potentielle Interaktionen) gleichermaßen berücksichtigt. Um Hintergrundmusik als komplexem audiovisuellen Stimulus in empirischer Forschung gerecht zu werden, spielen zudem auch praktische Implikationen eine große Rolle. Diese Herausforderungen berücksichtigend wurde die Wirksamkeit von Hintergrundmusik in fünf Studien im Kontext von drei verschiedenen Medienformaten untersucht. Da Werbung, Film und informationsvermittelnde Medienformate (wie Dokumentationen und TV-Magazine) die drei Kernfunktionen von Medien – Persuasion, Unterhaltung und Information – repräsentieren, sollte auf Grundlage dieses Dreiklangs die Bandbreite potenzieller Wirkungen von effektiv eingesetzter Musik und von Faktoren, die ihre Wirkung beeinflussen, möglichst umfassend (wenn auch sicher nicht vollständig) abgebildet werden. Über alle Medienformate hinweg kann als wichtiger, die Wirksamkeit von Hintergrundmusik verstärkender Einflussfaktor eine Kongruenz, d.h. eine intuitiv wahrgenommene Passung von Musik und Medienkontext ausgemacht werden, die durch eine sorgfältige Abstimmung der Spezifika von Musik und Medienformat auf emotionaler, auf assoziativer und auf struktureller Ebene erreicht werden kann. Findet diese Anwendung, kann Musik systematisch die Wirksamkeit von Werbespots steigern (Studie 1 und 2), gezielt Bedeutung vermitteln und dadurch die Wahrnehmung und Interpretation von (deutungsoffenen) Filmszenen prägen (Studie 3 und 4) oder unter bestimmten Bedingungen das persuasive Potenzial eines informationsvermittelnden Medienformats steigern und so die Meinungsbildung der Rezipierenden (zumindest kurzfristig) beeinflussen (Studie 5). Die Arbeit verdeutlicht, wie mittels interdisziplinärer Perspektivierung und der Beachtung praktischer Implikationen bereits etabliertes Wissen verstetigt und neue Erkenntnisse zur Verwendung und Wirkung von Hintergrundmusik für Wissenschaft und Medienpraxis abgeleitet werden können – inklusive eines Ausblicks auf daraus resultierende Potenziale für zukünftige Forschung.
Costly signaling with mobile devices: An evolutionary psychological perspective on smartphones
(2016)
In the last decade, mobile device ownership has largely increased. In particular, smartphone ownership is constantly rising (A. Smith, 2015; Statista, 2016a), and there is a real hype for luxury brand smartphones (Griffin, 2015). These observations raise the question of which functions smartphones serve in addition to their original purposes of making and receiving calls, searching for information, and organizing. Beyond these obvious functions, studies suggest that smartphones express fashion, lifestyle, and one’s economic status (e.g., Bødker et al., 2009; Statista, 2016b; Vanden Abeele, Antheunis, & Schouten, 2014). Specifically, individuals seem to purchase and use conspicuous luxury brand smartphones to display and enhance status (D. Kim et al., 2014; Müller-Lietzkow et al., 2014; Suki, 2013). But how does owning a conspicuous, high-status smartphone contribute to status, and which benefits may these status boosts provide to their owners? From an evolutionary perspective, status carries a lot of advantages, particularly for males; high status grants them priority access to resources and correlates with their mating success (van Vugt & Tybur, 2016). In this sense, research suggests that men conspicuously display their cell phones to attract mates and to distinguish themselves from rivals (Lycett & Dunbar, 2000). In a similar vein, evolutionarily informed studies on conspicuous consumption indicate that the purchase and display of conspicuous luxuries (including mobile phones and smartphones) relate to a man’s interest in uncommitted sexual relationships and enhance his desirability as a short-term mate (Hennighausen & Schwab, 2014; Saad, 2013; Sundie et al., 2011). Drawing on these findings, this doctoral dissertation investigated how a man is perceived given that he is an owner of a high-status (vs. nonconspicuous, low-status) smartphone as a romantic partner and male rival. This was done in three experiments. In addition, it was examined how male conspicuous consumption of smartphones interacted with further traits that signal a man’s mate quality, namely facial attractiveness (Studies 1 and 2) and social dominance (Study 3). Study 1 revealed that men and women perceived a male owner of a conspicuous smartphone as a less desirable long-term mate and as more inclined toward short-term mating. Study 2 replicated these results and showed that men and women assigned traits that are associated with short-term mating (e.g., low loyalty, interest in flirts, availability of tangible resources) to a male owner of a conspicuous smartphone and perceived him as a stronger male rival and mate poacher, and less as a friend. The results of Study 2 further suggested that specifically more attractive men might benefit from owning a conspicuous smartphone in a short-term mating context and might be hence considered as stronger male rivals. Study 3 partially replicated the findings of Studies 1 and 2 pertaining to the effects of owning a conspicuous smartphone. Study 3 did not show different effects of conspicuous consumption of smartphones on perceptions of a man dependent on the level of his social dominance.
To conclude, the findings of this doctoral dissertation suggest that owning a conspicuous, high-status smartphone might not only serve proximate functions (e.g., making and receiving calls, organization) but also ultimate functions, which relate to mating and reproduction. The results indicate that owning a conspicuous smartphone might yield benefits for men in a short-term rather than in a long-term mating context. Furthermore, more attractive men appear to benefit more from owning a conspicuous smartphone than less attractive men. These findings provide further insights into the motivations that underlie men’s purchases and displays of conspicuous, high-status smartphones from luxury brands that reach beyond the proximate causes frequently described in media and consumer psychological research. By applying an evolutionary perspective, this doctoral dissertation demonstrates the power and utility of this research paradigm for media psychological research and shows how combining a proximate and ultimate perspective adds to a more profound understanding of smartphone phenomena.
Using color in user interface design is both art and science. Often, designers focus on aesthetic properties of color, but neglect that it also carries meaning and entails profound psychological consequences. Color psychology, filling this gap, is in its infancy, and lacks a theoretical approach that predicts and explains color-meaning associations shared by a large group of people in a large variety of contexts.
To amend this situation, this work develops Conceptual Metaphor Theory of Color (CMToC), which predicts and explains cross-cultural and experience-based semantic color associations. The theory is based on the idea from cognitive linguistics that the study of metaphorical language provides valuable insights into our mental models involving color. A discussion of three types of metaphors that cover associations with physical and abstract concepts in light of existing empirical evidence provides the basis for deriving empirical research questions.
The first research question addresses the use of color for conveying physical information like weight in user interfaces. The results of four online surveys involving a total of 295 German and Japanese participants show the relative impact of hue, saturation and brightness for associations with 16 physical properties. Two thirds of these color associations were correctly predicted by CMToC. Participants frequently matched physical properties to colors based on sensorimotor correspondences and participants of both cultures did not considerably vary in their performance.
The second research question addresses the use of color for conveying abstract information like importance in user interfaces. In one experimental study, a total of 75 German and Japanese participants validated color-to-abstract mappings in form of color population stereotypes like important is dark. The majority of these color associations (86%) were correctly predicted by CMToC. Again, participants of both cultures did not considerably vary in their performance.
The third research question addresses whether predicted color associations with physical and abstract information are processed automatically as a precondition for intuitive use. The results of three studies involving a total of 85 German and Japanese participants show on the example of temperature that color automatically influences the identification speed of related physical properties, but not vice versa. Color and abstract information were not automatically associated.
As a result of these studies it can be concluded that predictions of CMToC are cross-culturally valid for user interface design. Derived implicit associations with physical properties and explicit associations with abstract concepts can inform design decisions in both hard- and software user interface design.
Computer games are highly immersive, engaging, and motivating learning environments. By providing a tutorial at the start of a new game, players learn the basics of the game's underlying principles as well as practice how to successfully play the game. During the actual gameplay, players repetitively apply this knowledge, thus improving it due to repetition. Computer games also challenge players with a constant stream of new challenges which increase in difficulty over time. As a result, computer games even require players to transfer their knowledge to master these new challenges. A computer game consists of several game mechanics. Game mechanics are the rules of a computer game and encode the game's underlying principles. They create the virtual environments, generate a game's challenges and allow players to interact with the game. Game mechanics also can encode real world knowledge. This knowledge may be acquired by players via gameplay. However, the actual process of knowledge encoding and knowledge learning using game mechanics has not been thoroughly defined, yet. This thesis therefore proposes a theoretical model to define the knowledge learning using game mechanics: the Gamified Knowledge Encoding. The model is applied to design a serious game for affine transformations, i.e., GEtiT, and to predict the learning outcome of playing a computer game that encodes orbital mechanics in its game mechanics, i.e., Kerbal Space Program. To assess the effects of different visualization technologies on the overall learning outcome, GEtiT visualizes the gameplay in desktop-3D and immersive virtual reality. The model's applicability for effective game design as well as GEtiT's overall design are evaluated in a usability study. The learning outcome of playing GEtiT and Kerbal Space Program is assessed in four additional user studies. The studies' results validate the use of the Gamified Knowledge Encoding for the purpose of developing effective serious games and to predict the learning outcome of existing serious games. GEtiT and Kerbal Space Program yield a similar training effect but a higher motivation to tackle the assignments in comparison to a traditional learning method. In conclusion, this thesis expands the understanding of using game mechanics for an effective learning of knowledge. The presented results are of high importance for researches, educators, and developers as they also provide guidelines for the development of effective serious games.
The current dissertation addresses the analysis of technology-enhanced learning processes by using Process Mining techniques. For this purpose, students’ coded think-aloud data served as the measurement of the learning process, in order to assess the potential of this analysis method for evaluating the impact of instructional support.
The increasing use of digital media in higher education and further educational sectors enables new potentials. However, it also poses new challenges to students, especially regarding the self-regulation of their learning process. To help students with optimally making progress towards their learning goals, instructional support is provided during learning. Besides the use of questionnaires and tests for the assessment of learning, researchers make use increasingly of process data to evaluate the effects of provided support. The analysis of observed behavioral traces while learning (e.g., log files, eye movements, verbal reports) allows detailed insights into the student’s activities as well as the impact of interventions on the learning process. However, new analytical challenges emerge, especially when going beyond the analysis of pure frequencies of observed events. For example, the question how to deal with temporal dynamics and sequences of learning activities arises. Against this background, the current dissertation concentrates on the application of Process Mining techniques for the detailed analysis of learning processes. In particular, the focus is on the additional value of this approach in comparison to a frequency-based analysis, and therefore on the potential of Process Mining for the evaluation of instructional support.
An extensive laboratory study with 70 university students, which was conducted to investigate the impact of a support measure, served as the basis for pursuing the research agenda of this dissertation. Metacognitive prompts supported students in the experimental group (n = 35) during a 40-minute hypermedia learning session; whereas the control group (n = 35) received no support. Approximately three weeks later, all students participated in another learning session; however, this time all students learned without any help. The participants were instructed to verbalize their learning activities concurrently while learning. In the three analyses of this dissertation, the coded think aloud data were examined in detail by using frequency-based methods as well as Process Mining techniques.
The first analysis addressed the comparison of the learning activities between the experimental and control groups during the first learning session. This study concentrated on the research questions whether metacognitive prompting increases the number of metacognitive learning activities, whether a higher number of these learning activities corresponds with learning outcome (mediation), and which differences regarding the sequential structure of learning activities can be revealed. The second analysis investigated the impact of the individual prompts as well as the conditions of their effectiveness on the micro level. In addition to Process Mining, we used a data mining approach to compare the findings of both analysis methods. More specifically, we classified the prompts by their effectiveness, and we examined the learning activities preceding and following the presentation of instructional support. Finally, the third analysis considered the long-term effects of metacognitive prompting on the learning process during another learning session without support. It was the key objective of this study to examine which fostered learning activities and process patterns remained stable during the second learning session.
Overall, all three analyses indicated the additional value of Process Mining in comparison to a frequency-based analysis. Especially when conceptualizing the learning process as a dynamic sequence of multiple activities, Process Mining allows identifying regulatory loops and crucial routing points of the process. These findings might contribute to optimizing intervention strategies. However, before drawing conclusions for the design of instructional support based on the revealed process patterns, additional analyses need to investigate the generalizability of results. Moreover, the application of Process Mining remains challenging because guidelines for analytical decisions and parameter settings in technology-enhanced learning context are currently missing. Therefore, future studies need to examine further the potential of Process Mining as well as related analysis methods to provide researchers with concrete recommendations for use. Nevertheless, the application of Process Mining techniques can already contribute to advance the understanding of the impact of instructional support through the use of fine-grained process data.