004 Datenverarbeitung; Informatik
Refine
Has Fulltext
- yes (78)
Is part of the Bibliography
- yes (78)
Year of publication
Document Type
- Journal article (78) (remove)
Keywords
- virtual reality (11)
- machine learning (5)
- augmented reality (3)
- immersion (3)
- Deep learning (2)
- Quadrocopter (2)
- Quadrotor (2)
- XR (2)
- artificial intelligence (2)
- automation (2)
- deep learning (2)
- education (2)
- endoscopy (2)
- exposure (2)
- fully convolutional neural networks (2)
- gastroenterology (2)
- historical document analysis (2)
- human-computer interaction (2)
- navigation (2)
- neural networks (2)
- ontology (2)
- prediction (2)
- self-aware computing (2)
- virtual environments (2)
- 3D-reconstruction methods (1)
- 3DTK toolkit (1)
- 4D-GIS (1)
- AVA (1)
- Aufwandsanalyse (1)
- Automatisierte Prüfungskorrektur (1)
- Autonomous UAV (1)
- Brüder Grimm Privatbibliothek (1)
- CLIP (1)
- Convolutional Neural Network (1)
- Cost Analysis (1)
- DNA storage (1)
- EPM (1)
- Educational Measurement (I2.399) (1)
- Entscheidungsfindung (1)
- Erkennung handschriftlicher Artefakte (1)
- Ethik (1)
- Forces (1)
- GNSS/INS integrated navigation (1)
- Grimm brothers personal library (1)
- HMD (Head-Mounted Display) (1)
- HTTP adaptive video streaming (1)
- INS/LIDAR integrated navigation (1)
- IT security (1)
- Image Aesthetic Assessment (1)
- Informatik (1)
- Intelligent Virtual Agents (1)
- InteractionSuitcase (1)
- Internet of Things (1)
- IoT (1)
- Kerneldensity estimation (1)
- Klima (1)
- Künstliche Intelligenz (1)
- LoRaWAN (1)
- Modell (1)
- Multiple-Choice Examination (1)
- Multiple-Choice Prüfungen (1)
- NP-hardness (1)
- Neuronales Netz (1)
- Optical Flow (1)
- Poisson surface reconstruction (1)
- RGB-D (1)
- Robotics (1)
- Self-Evaluation Programs (I2.399.780) (1)
- Structure-from-Motion (1)
- Terramechanics (1)
- Torque (1)
- WhatsApp (1)
- Wheel (1)
- XR-artificial intelligence combination (1)
- XR-artificial intelligence continuum (1)
- YouTube (1)
- acrophobia (1)
- adaptation models (1)
- adult learning (1)
- aerodynamics (1)
- agents (1)
- annotation (1)
- anomaly detection (1)
- anomaly prediction (1)
- ant-colony optimization (1)
- anthropomorphism (1)
- anxiety (1)
- application design (1)
- approximation algorithm (1)
- arithmetic calculations (1)
- autonomous (1)
- autonomous UAV (1)
- availability (1)
- avatar embodiment (1)
- avatars (1)
- background knowledge (1)
- baseline detection (1)
- behavior perception (1)
- binary tanglegram (1)
- biosignals (1)
- camera orientation (1)
- carbon (1)
- certifying algorithm (1)
- chain cover (1)
- channel management (1)
- climate (1)
- co-authorships (1)
- co-inventorships (1)
- coherence (1)
- collaboration (1)
- collision (1)
- communication models (1)
- communication networks (1)
- congruence (1)
- content-based image retrieval (1)
- continuous-time SLAM (1)
- convex bipartite graph (1)
- convolutional neural network (1)
- cost-sensitive learning (1)
- crossing minimization (1)
- crowdsensing (1)
- crowdsourced measurements (1)
- cultural and media studies (1)
- culturally aware (1)
- data warehouse (1)
- decision support system (1)
- decision-making (1)
- deep metric learning (1)
- deformation-based method (1)
- design (1)
- design cycle (1)
- detection time simulation (1)
- digital twin (1)
- dimensions of proximity (1)
- distributed control (1)
- dynamic programming (1)
- eHealth (1)
- educational tool (1)
- electronic health records (1)
- elevated plus-maze (1)
- embedding techniques (1)
- emotions (1)
- encryption (1)
- endurance (1)
- event detection (1)
- exercise intensity (1)
- experience (1)
- experimental evaluation (1)
- extended reality (XR) (1)
- failure prediction (1)
- fault detection (1)
- feature matching (1)
- few-shot learning (1)
- fixed-parameter tractability (1)
- food quality (1)
- foreign language learning and teaching (1)
- formation flight (1)
- fruit temperature (1)
- future energy grid exploration (1)
- games (1)
- gamification (1)
- genetic algorithm (1)
- graph algorithm (1)
- group-based communication (1)
- handwriting (1)
- handwritten artefact recognition (1)
- hierarchy (1)
- historical images (1)
- hospital data (1)
- human body weight (1)
- human computer interaction (HCI) (1)
- human-artificial intelligence interaction (1)
- human-artificial intelligence interface (1)
- human-centered design (1)
- human-centered, human-robot (1)
- human–computer interaction (1)
- illusion of self-motion (1)
- image classification (1)
- image processing (1)
- imbalanced regression (1)
- immersive classroom (1)
- immersive classroom management (1)
- immersive technologies (1)
- implicit association test (1)
- induced matching (1)
- informal education (1)
- information extraction (1)
- information systems and information technology (1)
- intelligent transportation systems (1)
- intelligent vehicles (1)
- intelligent virtual agents (1)
- intelligent voice assistant (1)
- intercultural learning and teaching (1)
- interdisciplinary education (1)
- internet traffic (1)
- invasive vascular interventions (1)
- iowa gambling task (1)
- key-insight extraction (1)
- kinect (1)
- language-image pre-training (1)
- layout recognition (1)
- learning environments (1)
- light-gated proteins (1)
- local energy system (1)
- logistics (1)
- long-term analysis (1)
- map projections (1)
- mapping (1)
- mathematical model (1)
- measurements (1)
- media analysis (1)
- medical records (1)
- medieval manuscripts (1)
- meditation (1)
- mindfulness (1)
- misconceptions (1)
- mixed reality (1)
- mixed-cultural (1)
- mixed-cultural settings (1)
- mobile instant messaging (1)
- mobile messaging application (1)
- mobile networks (1)
- mobile streaming (1)
- model following (1)
- model output statistics (1)
- model-based diagnosis (1)
- multimodal fusion (1)
- multimodal interface (1)
- multiple myeloma (1)
- multirotors (1)
- multiscale encoder (1)
- nano-satellite (1)
- nanocellulose (1)
- natural interfaces (1)
- natural language processing (1)
- neume notation (1)
- neural architecture (1)
- non-native accent (1)
- object detection (1)
- octree (1)
- optical music recognition (1)
- passage of time (1)
- passive haptic feedback (1)
- perception (1)
- performance (1)
- performance analysis (1)
- performance prediction (1)
- place-illusion (1)
- plausibility (1)
- plausibility-illusion (1)
- point cloud (1)
- point cloud compression (1)
- point-to-plane measure (1)
- point-to-point measure (1)
- pollution (1)
- positioning (1)
- precision horticulture (1)
- precision training (1)
- presence (1)
- private chat groups (1)
- procedural fusion methods (1)
- prompt engineering (1)
- protein chip (1)
- psychophyisology (1)
- public speaking (1)
- quadcopter (1)
- quadcopters (1)
- quality assurance (1)
- quality evaluation (1)
- quality of experience (1)
- quality of experience prediction (1)
- radiology (1)
- ransomware (1)
- real world evidence (1)
- real-world application (1)
- realism (1)
- recommender system (1)
- regelbasierte Nachbearbeitung (1)
- research methods (1)
- rich vehicle routing problem (1)
- robustness (1)
- rotors (1)
- rule based post processing (1)
- sample weighting (1)
- satisfiability problems (1)
- scalability (1)
- scalable quadcopter (1)
- scheduling (1)
- science, technology and society (1)
- secure group communication (1)
- segmentation (1)
- self-adaptive (1)
- self-adaptive systems (1)
- self-aware computing systems (1)
- self-managing systems (1)
- semantic fusion (1)
- sensor fusion (1)
- sentinel (1)
- serious games (1)
- sesnsors (1)
- simulation (1)
- simulation system (1)
- single-electron transistors (1)
- sketching (1)
- smart meter data utilization (1)
- smart speaker (1)
- social VR (1)
- social interaction (1)
- social relationship (1)
- social robot (1)
- social robotics (1)
- social role (1)
- socially interactive agents (1)
- spatial presence (1)
- statistical validity (1)
- statistics and numerical data (1)
- stereotypes (1)
- stroke (1)
- student simulation (1)
- stylus (1)
- sunburn (1)
- supervised learning (1)
- surface model (1)
- survey (1)
- switching navigation (1)
- systematic literature review (1)
- systematic review (1)
- table extraction (1)
- table understanding (1)
- taxonomy (1)
- teacher education (1)
- technology-supported learning (1)
- text line detection (1)
- text supervision (1)
- theory (1)
- therapeutic application (1)
- thermal camera (1)
- thermal point cloud (1)
- time calibration (1)
- time perception (1)
- tools (1)
- trait anxiety (1)
- transformer (1)
- translational neuroscience (1)
- transport microenvironments (1)
- transportation (1)
- unmanned aerial vehicle (1)
- unmanned aerial vehicles (1)
- usability evaluation (1)
- use cases (1)
- user experience (1)
- user interaction (1)
- user study (1)
- vection (1)
- vehicle dynamics (1)
- vehicular navigation (1)
- verbal behaviour (1)
- virtual agent (1)
- virtual agent interaction (1)
- virtual humans (1)
- virtual reality training (1)
- virtual stimuli (1)
- virtual tunnel (1)
- virtual-reality-continuum (1)
- waypoint parameter (1)
- wearable (1)
Institute
- Institut für Informatik (78) (remove)
Semantic Fusion for Natural Multimodal Interfaces using Concurrent Augmented Transition Networks
(2018)
Semantic fusion is a central requirement of many multimodal interfaces. Procedural methods like finite-state transducers and augmented transition networks have proven to be beneficial to implement semantic fusion. They are compliant with rapid development cycles that are common for the development of user interfaces, in contrast to machine-learning approaches that require time-costly training and optimization. We identify seven fundamental requirements for the implementation of semantic fusion: Action derivation, continuous feedback, context-sensitivity, temporal relation support, access to the interaction context, as well as the support of chronologically unsorted and probabilistic input. A subsequent analysis reveals, however, that there is currently no solution for fulfilling the latter two requirements. As the main contribution of this article, we thus present the Concurrent Cursor concept to compensate these shortcomings. In addition, we showcase a reference implementation, the Concurrent Augmented Transition Network (cATN), that validates the concept’s feasibility in a series of proof of concept demonstrations as well as through a comparative benchmark. The cATN fulfills all identified requirements and fills the lack amongst previous solutions. It supports the rapid prototyping of multimodal interfaces by means of five concrete traits: Its declarative nature, the recursiveness of the underlying transition network, the network abstraction constructs of its description language, the utilized semantic queries, and an abstraction layer for lexical information. Our reference implementation was and is used in various student projects, theses, as well as master-level courses. It is openly available and showcases that non-experts can effectively implement multimodal interfaces, even for non-trivial applications in mixed and virtual reality.