Principal Investigators
Prof. Dr.-Ing Katrin Wolf, Berlin University of Applied Sciences and Technology
Prof. Dr. Albrecht Schmidt, LMU Munich
Illusionary Surface Interfaces is a research project within the Scalable Interaction Paradigms for Pervasive Computing Environments (SPP2199). The project aims to investigate how haptic sensations can be induced with as little hardware as possible, as future technologies might rely on interfaces where haptic illusions are necessary to provide users with haptic feedback. Traditional computers typically refer (through visual affordances) to both the perceived and actual properties of the interface, suggesting not only fundamental functionalities but also determining and communicating how humans possibly use the system. Such rich information visualization may, however, not suit the way we want pervasive computers and computational everyday environments to look and feel. We aim to create novel interactive experiences that exploit multisensory illusions in order to extend the range of interface properties that can be displayed, using only everyday object surfaces as interfaces. In a manner similar to the 'rubber hand illusion', in which people can be induced to perceive a physical touch based purely on what they see, we will support visual and haptic feedback induced by augmented vision and sound. Instead of changing the objects' physicality, we will visually and auditorily augment them using 'smart glasses' and projectors, while at the same time augmenting them haptically by inducing multisensory illusion. Technically, this includes sensing user interaction using machine learning tools and multimodal presentation of information.
Main Research Question
How can illusionary surface interfaces support creating better and more usable, tangible and touch-based interactions with pervasive computers?
Sub-Research Questions
How can we improve interactive surfaces and objects using multisensory illusions in our personal space or a control room? What are effective and robust multimodal methods to enhance the haptic experience with everyday objects? How can we comprehensively capture relevant and multimodal parameters that describe the user experience for physical interaction with artefacts? How does physical interaction on a set of tangible and touch interaction elements impact human perception, experience, and behaviour?
Publications
Using Pseudo-Stiffness to Enrich the Haptic Experience in Virtual Reality — Weiss, Villa, Schmidt, Mayer, Müller. CHI 2023
Using Body Language of Avatars in VR Meetings as Communication Status Cue — Kurzweg, Reinhardt, Nabok, Wolf. MuC 2021
When Realities Interweave: Exploring the Design Space of Immersive Tangible XR — Uhl, Schrom-Feiertag, Regal, Hirsch, Weiss, Tscheligi. TEI 2023
PLAY ME! Influencing Game Decisions through Suggestions made by Augmented Characters — Kurzweg, Reinhardt, Stoll, Wirth, Wolf. MUM 2020
Visuo-Haptic Interaction — Wolf, Kurzweg, Weiss, Brewster, Schmidt. AVI 2022