Refine
Is part of the Bibliography
- yes (20) (remove)
Year of publication
Document Type
- Doctoral Thesis (15)
- Conference Proceeding (4)
- Bachelor Thesis (1)
Language
- English (20) (remove)
Keywords
- Virtuelle Realität (20) (remove)
Software frameworks for Realtime Interactive Systems (RIS), e.g., in the areas of Virtual, Augmented, and Mixed Reality (VR, AR, and MR) or computer games, facilitate a multitude of functionalities by coupling diverse software modules. In this context, no uniform methodology for coupling these modules does exist; instead various purpose-built solutions have been proposed. As a consequence, important software qualities, such as maintainability, reusability, and adaptability, are impeded.
Many modern systems provide additional support for the integration of Artificial Intelligence (AI) methods to create so called intelligent virtual environments. These methods exacerbate the above-mentioned problem of coupling software modules in the thus created Intelligent Realtime Interactive Systems (IRIS) even more. This, on the one hand, is due to the commonly applied specialized data structures and asynchronous execution schemes, and the requirement for high consistency regarding content-wise coupled but functionally decoupled forms of data representation on the other.
This work proposes an approach to decoupling software modules in IRIS, which is based on the abstraction of architecture elements using a semantic Knowledge Representation Layer (KRL). The layer facilitates decoupling the required modules, provides a means for ensuring interface compatibility and consistency, and in the end constitutes an interface for symbolic AI methods.
Latency is an inherent problem of computing systems. Each computation takes time until the result is available. Virtual reality systems use elaborated computer resources to create virtual experiences. The latency of those systems is often ignored or assumed as small enough to provide a good experience.
This cumulative thesis is comprised of published peer reviewed research papers exploring the behaviour and effects of latency. Contrary to the common description of time invariant latency, latency is shown to fluctuate. Few other researchers have looked into this time variant behaviour. This thesis explores time variant latency with a focus on randomly occurring latency spikes. Latency spikes are observed both for small algorithms and as end to end latency in complete virtual reality systems. Most latency measurements gather close to the mean latency with potentially multiple smaller clusters of larger latency values and rare extreme outliers. The latency behaviour differs for different implementations of an algorithm. Operating system schedulers and programming language environments such as garbage collectors contribute to the overall latency behaviour. The thesis demonstrates these influences on the example of different implementations of message passing.
The plethora of latency sources result in an unpredictable latency behaviour. Measuring and reporting it in scientific experiments is important. This thesis describes established approaches to measuring latency and proposes an enhanced setup to gather detailed information. The thesis proposes to dissect the measured data with a stacked z-outlier-test to separate the clusters of latency measurements for better reporting.
Latency in virtual reality applications can degrade the experience in multiple ways. The thesis focuses on cybersickness as a major detrimental effect. An approach to simulate time variant latency is proposed to make latency available as an independent variable in experiments to understand latency's effects. An experiment with modified latency shows that latency spikes can contribute to cybersickness. A review of related research shows that different time invariant latency behaviour also contributes to cybersickness.
Renewal of fear is one form of relapse that occurs after successful therapy, resulting from an encounter with a feared object in a context different from the context of the exposure therapy. According to Bouton (1994), the return of fear, provoked by context change, indicates that the fear was not erased in the first place. More importantly, the return of fear indicates that during the exposure session a new association was learned that connected the feared object with “no fear”; yet, as Bouton further argues, this association is context dependent. Such dependence could explain effects like renewal. In a new context, the therapeutic association will not be expressed and thus will no longer inhibit the fear. The assumption that an association is context dependent has been tested and showed robust results (Balooch & Neumann, 2011; Siavash Bandarian Balooch, Neumann, & Boschen, 2012; Culver, Stoyanova, & Craske, 2011; Kim & Richardson, 2009; Neumann & Kitlertsirivatana, 2010). Research for the treatment of anxiety disorders, aiming to reduce fear and, more importantly, prevent relapse, is flourishing. There are several exposure protocols currently under investigation: multiple contexts exposure (MCE), which aims at reducing the return of fear due to renewal (e.g., Balooch & Neumann, 2011); prolonged exposure (PE), which aims at strengthening the inhibitory association during the extinction learning (e.g., Thomas, Vurbic, & Novak, 2009); and reconsolidation update (RU), which aims at “updating” the reconsolidation process by briefly exposing the CS+ before the actual extinction takes place (Schiller et al., 2010). So far, however, few clinical studies conducted on humans have investigated these novel treatment protocols, and as far as I know none has investigated the mechanisms of action behind these protocols with a human clinical sample. The present thesis has three main goals. The first is to demonstrate that exposure therapy in multiple contexts reduces the likelihood of renewal. The second is to examine the mechanisms contributing to the effect of MCE and the third is to shed light on the concept of context in the framework of the conditioning and extinction paradigm. To this end, three studies were conducted. The first study investigated the effect of MCE on renewal, the second and third studies examined working mechanisms of MCE. In the first study thirty spider-phobic participants were exposed four times to a virtual spider. The exposure trials were conducted either in one single context or in four different contexts. Finally, all participants completed both a virtual renewal test, with the virtual spider presented in a novel virtual context, and an in vivo behavioral avoidance test with a real spider. This study successfully demonstrated the efficacy of MCE on reducing renewal. Study 2 investigated the working mechanisms behind MCE by utilizing a differential conditioning paradigm and conducting the extinction in multiple contexts, targeting similar renewal attenuation as achieved in study 1. This was followed by two tests that attempted to reveal extinction-relevant associations like ones causing context inhibitory effects. This study had three main hypotheses: (1) The extinction context is associated with the exposure, and thus operates as a safety signal at some point during the extinction; it will therefore compete with the safety learning of the CS, leading to a decreased extinction effect on the CS if the extinction is conducted in only one context. (2) The elements (e.g., room color, furniture) of the extinction context are connected to the therapeutic association and therefore should serve as reminders of the extinction, causing a stronger fear inhibition when presented during a test. (3) Therapy process factors, according to emotional processing theory, determine the renewal effect (e.g., initial fear activation, and within-session and between-session activation are correlated with the strength of renewal). In this study, however, no differences between the groups at the renewal phase were observed, presumably because the extinction was too strong to enable a renewal of fear at the test phase conducted immediately following the extinction. This hence rendered the two inhibitory tests useless. Study 3 aimed at defining the concept of context in the conditioning and exposure framework. Study 3 utilized the phenomenon known as generalization decrement, whereby a conditioned response is reduced due to change in the environment. This allowed context similarity to be quantified. After an acquisition phase in one context, participants were tested in one of three contexts, two of which differed in only one dimension (configuration of objects vs. features). The third group was tested in the same context and served as control group. The goal was to show that both configuration and features play an important role in the definition of context. There was, however, no significant statistical difference between the groups at the test phases, likely because of context novelty effects (participants exposed to a new context following extinction in another context expected a second extinction phase, and thus demonstrated greater fear than expected in all three groups).
Observing the Digital Self
(2021)
Facebook, Instagram, Twitter & Co. Social media have become an essential part of everyday life for many people in recent years, and as such, it is impossible to imagine a life without them. It seems self-evident to operate as an active prosumer in the net via various end devices. We create personal profiles in various social networks, exchange ideas, and connect with others. We take part in virtual events, and above all: we actively shape the web.
The photo and video platform Instagram is one of the most popular social networking sites. Since 2010, the online service has offered its users the opportunity for personal development and space for creativity. Therefore, the personal profiles serve not only participatory reasons but also facilitate acts of self-representation.
In addition to apparently visible aspects, questions about self-perception arise: How do users experience and evaluate their activities in virtual space? How do they perceive their actions between the offline and online world, and how intertwined are these spheres? Through an ethnographical approach, this work represents the attempt to look beyond the self-evident aspects of the digital self. For this purpose, two Instagram users were accompanied for more than a year.
Social attention is a ubiquitous, but also enigmatic and sometimes elusive phenomenon.
We direct our gaze at other human beings to see what they are doing
and to guess their intentions, but we may also absorb social events en passant as
they unfold in the corner of the eye. We use our gaze as a discrete communication
channel, sometimes conveying pieces of information which would be difficult
to explicate, but we may also find ourselves avoiding eye-contact with others in
moments when self-disclosure is fear-laden. We experience our gaze as the most
genuine expression of our will, but research also suggests considerable levels of
predictability and automaticity in our gaze behavior. The phenomenon’s complexity
has hindered researchers from developing a unified framework which can
conclusively accommodate all of its aspects, or from even agreeing on the most
promising research methodologies.
The present work follows a multi-methods approach, taking on several aspects
of the phenomenon from various directions. Participants in study 1 viewed dynamic
social scenes on a computer screen. Here, low-level physical saliency (i.e.
color, contrast, or motion) and human heads both attracted gaze to a similar extent,
providing a comparison of two vastly different classes of gaze predictors in
direct juxtaposition. In study 2, participants with varying degrees of social anxiety
walked in a public train station while their eye movements were tracked. With
increasing levels of social anxiety, participants showed a relative avoidance of gaze
at near compared to distant people. When replicating the experiment in a laboratory
situation with a matched participant group, social anxiety did not modulate
gaze behavior, fueling the debate around appropriate experimental designs in the
field. Study 3 employed virtual reality (VR) to investigate social gaze in a complex
and immersive, but still highly controlled situation. In this situation, participants
exhibited a gaze behavior which may be more typical for real-life compared to laboratory situations as they avoided gaze contact with a virtual conspecific unless
she gazed at them. This study provided important insights into gaze behavior in
virtual social situations, helping to better estimate the possible benefits of this
new research approach. Throughout all three experiments, participants showed
consistent inter-individual differences in their gaze behavior. However, the present
work could not resolve if these differences are linked to psychologically meaningful
traits or if they instead have an epiphenomenal character.
Virtual reality and related media and communication technologies have a growing
impact on professional application fields and our daily life. Virtual environments
have the potential to change the way we perceive ourselves and how we interact
with others. In comparison to other technologies, virtual reality allows for the
convincing display of a virtual self-representation, an avatar, to oneself and also to
others. This is referred to as user embodiment. Avatars can be of varying realism
and abstraction in their appearance and in the behaviors they convey. Such userembodying
interfaces, in turn, can impact the perception of the self as well as
the perception of interactions. For researchers, designers, and developers it is of
particular interest to understand these perceptual impacts, to apply them to therapy,
assistive applications, social platforms, or games, for example. The present thesis
investigates and relates these impacts with regard to three areas: intrapersonal
effects, interpersonal effects, and effects of social augmentations provided by the
simulation.
With regard to intrapersonal effects, we specifically explore which simulation
properties impact the illusion of owning and controlling a virtual body, as well
as a perceived change in body schema. Our studies lead to the construction of
an instrument to measure these dimensions and our results indicate that these
dimensions are especially affected by the level of immersion, the simulation latency,
as well as the level of personalization of the avatar.
With regard to interpersonal effects we compare physical and user-embodied social
interactions, as well as different degrees of freedom in the replication of nonverbal
behavior. Our results suggest that functional levels of interaction are maintained,
whereas aspects of presence can be affected by avatar-mediated interactions, and
collaborative motor coordination can be disturbed by immersive simulations.
Social interaction is composed of many unknown symbols and harmonic patterns
that define our understanding and interpersonal rapport. For successful virtual
social interactions, a mere replication of physical world behaviors to virtual environments
may seem feasible. However, the potential of mediated social interactions
goes beyond this mere replication. In a third vein of research, we propose and
evaluate alternative concepts on how computers can be used to actively engage in
mediating social interactions, namely hybrid avatar-agent technologies. Specifically,
we investigated the possibilities to augment social behaviors by modifying and
transforming user input according to social phenomena and behavior, such as nonverbal
mimicry, directed gaze, joint attention, and grouping. Based on our results
we argue that such technologies could be beneficial for computer-mediated social
interactions such as to compensate for lacking sensory input and disturbances in
data transmission or to increase aspects of social presence by visual substitution or
amplification of social behaviors.
Based on related work and presented findings, the present thesis proposes the
perspective of considering computers as social mediators. Concluding from prototypes
and empirical studies, the potential of technology to be an active mediator of social
perception with regard to the perception of the self, as well as the perception of
social interactions may benefit our society by enabling further methods for diagnosis,
treatment, and training, as well as the inclusion of individuals with social disorders.
To this regard, we discuss implications for our society and ethical aspects. This
thesis extends previous empirical work and further presents novel instruments,
concepts, and implications to open up new perspectives for the development of
virtual reality, mixed reality, and augmented reality applications.
The use of digital media by children and young people offers opportunities for communication, collaboration, and participation. However, to prepare them for the risks and challenges of media usage, promoting digital competencies of students and teachers is an indispensable goal for educational institutions. To meet this requirement, teacher education must be opened to innovative pedagogical concepts for initial teacher education that considers new technologies in a reflective, action-oriented way to promote competencies. Therefore, this work aims to promote the technological pedagogical content knowledge (TPACK) of prospective teachers that enables the purposeful integration of social virtual reality (social VR) into the classroom. Consequently, a pedagogical concept is developed and evaluated in an iterative research and development process following the design- based research approach (DBR) through four consecutive studies. The first study involved an analysis of the requirements of teachers and students for the effective use of social VR in the classroom. The second study examined how prospective teachers perceive teaching and learning activities within two theory-driven scenarios in social VR. The third study investigated the development of Technological Pedagogical Content Knowledge (TPACK) among students in social VR compared to video-based communication. Finally, the fourth study measured the development of TPACK in social VR using epistemic network analysis, finding that social VR can be an effective tool for teacher education, emphasizing the importance of authentic contexts and practical experiences for effective teaching in social VR. In the concluding chapter, appropriate implications for teacher education research and practice are derived from findings. For example, that a deeper understanding of TPACK as metacognitive awareness could enhance teacher education for media integration. It also highlights the need for digital literacy in seminars that address new technologies, emphasizing the importance of considering moral values and sustainability when using VR.
Computer games are highly immersive, engaging, and motivating learning environments. By providing a tutorial at the start of a new game, players learn the basics of the game's underlying principles as well as practice how to successfully play the game. During the actual gameplay, players repetitively apply this knowledge, thus improving it due to repetition. Computer games also challenge players with a constant stream of new challenges which increase in difficulty over time. As a result, computer games even require players to transfer their knowledge to master these new challenges. A computer game consists of several game mechanics. Game mechanics are the rules of a computer game and encode the game's underlying principles. They create the virtual environments, generate a game's challenges and allow players to interact with the game. Game mechanics also can encode real world knowledge. This knowledge may be acquired by players via gameplay. However, the actual process of knowledge encoding and knowledge learning using game mechanics has not been thoroughly defined, yet. This thesis therefore proposes a theoretical model to define the knowledge learning using game mechanics: the Gamified Knowledge Encoding. The model is applied to design a serious game for affine transformations, i.e., GEtiT, and to predict the learning outcome of playing a computer game that encodes orbital mechanics in its game mechanics, i.e., Kerbal Space Program. To assess the effects of different visualization technologies on the overall learning outcome, GEtiT visualizes the gameplay in desktop-3D and immersive virtual reality. The model's applicability for effective game design as well as GEtiT's overall design are evaluated in a usability study. The learning outcome of playing GEtiT and Kerbal Space Program is assessed in four additional user studies. The studies' results validate the use of the Gamified Knowledge Encoding for the purpose of developing effective serious games and to predict the learning outcome of existing serious games. GEtiT and Kerbal Space Program yield a similar training effect but a higher motivation to tackle the assignments in comparison to a traditional learning method. In conclusion, this thesis expands the understanding of using game mechanics for an effective learning of knowledge. The presented results are of high importance for researches, educators, and developers as they also provide guidelines for the development of effective serious games.
Anxiety research is one of the major psychological research domains and looks back on decades of research activity. Traditionally, novel theories and approaches are tested utilizing animal models. One way to study inherent anxiety in rodents is the elevated plus-maze (EPM). The EPM is a plus-shaped platform with two closed, i.e., walled, arms and two open unwalled arms. If given the opportunity to freely explore the apparatus, rodents instinctively avoid the open arms to protect themselves from predators. Hence, they spent less time on open and more time on closed arms, which is behaviorally associated with general anxiety. In the course of the pharmacological validation, it was found that this exploratory pattern can be reversed by anxiolytic substances, e.g., benzodiazepines, or potentiated by anxiogenics. One of the significant advantages of the EPM is that no prior training session is required in contrast to conditioning studies, thus allowing to observe natural behavior. Therefore, together with the economic and uncomplicated setup, the EPM has become a standard preclinical rodent anxiety test over the decades. In order to validate these rodent anxiety tests, there have recently been attempts to retranslate them to humans. A paramount of cross-species validation is not only the simple transferability of these animal tests but also the observation of anxiety behaviors that are evolutionarily conserved across species. Accordingly, it could be possible to conclude various factors associated with the etiology and maintenance of anxiety disorders in humans. So far, convincing translations of the EPM to humans are still lacking. For that reason, the primary aim of this dissertation is to retranslate the EPM throughout three studies and to evaluate cross-species validity critically. Secondly, the undertaken studies are set out to observe ambulatory activity equivalent to rodent EPM behavior, i.e., open arm avoidance. Thirdly, the undertaken studies aimed to assess the extent to which trait anxiety influences human exploratory activity on the platform to associate it with the assumption that rodent EPM-behavior is a reflection of general anxiety. Finally, virtual reality (VR) was the method of choice to maintain the economic advantage and adjust the EPM size to humans. Study 1 (N = 30) was set up to directly transfer the rodent EPM regarding test design and experimental procedure using a Computer Automatic Virtual Environment (CAVE). The results revealed that humans unlike rodents display a general open arms approach during free exploration. However, open arm avoidance was associated with high trait anxiety and acrophobia (fear of height), which was initially assessed as a control variable due to the virtual platform height. Regression analyses and subjective anxiety ratings hinted at a more significant influence of acrophobia on open arm avoidance. In addition, it was assumed that the open arms approach might have resulted from claustrophobic tendencies experienced in the closed arms due to the high walls. Study 2 (N = 61) sought to differentiate the influence of trait anxiety and acrophobia and adapt the virtual EPM to humans. Therefore, parts of the platform held a semi-transparent grid-floor texture, and the wall height on the closed arms was reduced to standard handrail level. Moreover, participants were priorly screened to exclude clinically significant levels of acrophobia, claustrophobia, and agoraphobia. The data on general exploratory activity showed no arm preference. Regression analyses confirmed that acrophobia is related to open arm avoidance, corroborating the finding of Study 1. Surprisingly, for trait anxiety, the result of Study 1 could not be replicated. Instead, for trait anxiety, no significant effect was found indicating that predominantly fear of heights shapes human EPM behavior even on a subclinical stage. In Study 3 (N = 57), the EPM was embedded into a city setting to 1) create a more natural human environment and 2) eliminate height. Furthermore, a head-mounted display was utilized for VR presentation, and arousal ratings were introduced. Participants were screened for high and low levels of trait anxiety and agoraphobia, and claustrophobia. Replicating the findings of Study 2, no difference in open and closed arm activity was observed, and no effect was found in relationship with trait anxiety. The data on anxiety ratings and claustrophobia suggest a positive correlation indicating that in this city EPM, claustrophobic tendencies might play a role in closed arm avoidance. In summary, this thesis added valuable insights into the retranslation of a well-established standard anxiety test used in rodents. However, it also majorly challenges current findings on the cross-species validity of the EPM. Various explanatory models for the results are critically discussed and associated with clinical implications concerning future research.
People who suffer Social Anxiety Disorder (SAD) are under substantial personal distress and endure impaired normal functioning in at least some parts of everyday life. Next, to the personal suffering, there are also the immense public health costs to consider, as SAD is the most common anxiety disorder and thereby one of the major psychiatric disorders in general. Over the last years, fundamental research found cognitive factors as essential components in the development and maintenance of social fears. Following leading cognitive models, avoidance behaviors are thought to be an important factor in maintaining the developed social anxieties. Therefore, this thesis aims to deepen the knowledge of avoidance behaviors exhibited in social anxiety, which allows to get a better understanding of how SAD is maintained.
To reach this goal three studies were conducted, each using a different research approach. In the first study cutting-edge Virtual Reality (VR) equipment was used to immerse participants in a virtual environment. In this virtual setting, High Socially Anxious (HSA) individuals and matched controls had to execute a social Approach-Avoidance Task (AAT). In the task, participants had to pass a virtual person displaying neutral or angry facial expressions. By using a highly immersive VR apparatus, the first described study took the initial step in establishing a new VR task for the implicit research on social approach-avoidance behaviors. By moving freely through a VR environment, participants experienced near real-life social situations. By tracking body and head movements, physical and attentional approach-avoidance processes were studied.
The second study looked at differences in attention shifts initiated by gaze-cues of neutral or emotional faces. Comparing HSA and controls, enabled a closer look at attention re-allocation with special focus on social stimuli. Further, context conditioning was used to compare task performance in a safe and in a threatening environment. Next to behavioral performance, the study also investigated neural activity using Electroencephalography (EEG) primarily looking at the N2pc component.
In the third study, eye movements of HSA and Low Socially Anxious (LSA) were analyzed using an eye-tracking apparatus while participants executed a computer task. The participants’ tasks consisted of the detection of either social or non-social stimuli in complex visual settings. The study intended to compare attention shifts towards social components between these two tasks and how high levels of social anxiety influence them. In other words, the measurements of eye movements enabled the investigation to what extent social attention is task-dependent and how it is influenced by social anxiety.
With the three described studies, three different approaches were used to get an in-depth understanding of what avoidance behaviors in SAD are and to which extent they are exhibited. Overall, the results showed that HSA individuals exhibited exaggerated physical and attentional avoidance behavior. Furthermore, the results highlighted that the task profoundly influences attention allocation. Finally, all evidence indicates that avoidance behaviors in SAD are exceedingly complex. They are not merely based on the fear of a particular stimulus, but rather involve highly compound cognitive processes, which surpass the simple avoidance of threatening stimuli. To conclude, it is essential that further research is conducted with special focus on SAD, its maintaining factors, and the influence of the chosen research task and method.