Principal Investigators

Prof. Dr.-Ing Katrin Wolf, Berlin University of Applied Sciences and Technology (Homepage)
Prof. Dr. Albrecht Schmidt, LMU Munich (Homepage)

Illusionary Surface Interfaces is a research project within the Scalable Interaction Paradigms for Pervasive Computing Environments (SPP2199). The project aims to investigate how haptic sensations can be induced with less hardware as possible, as future technologies might rely on interfaces where haptic illusions are necessary to provide users with haptic feedback. Traditional computers typically refer (through visual affordances) to both the perceived and actual properties of the interface – suggesting not only fundamental functionalities but also determining and communicating how humans possibly use the system. Such rich information visualization may, however, not suit the way we want pervasive computers and computational everyday environments to look and feel. We aim to create novel interactive experiences, that exploit multisensory illusions in order to extend the range of interface properties that can be displayed, using only everyday object surfaces as interfaces. In a manner similar to the “rubber hand illusion”, in which people can be induced to perceive a physical touch based purely on what they see, we will support visual and haptic feedback induced by augmented vision and sound. Instead of changing the objects’ physicality, we will visually and auditory augment them using “smart glasses” and projectors, while at the same time augmenting them haptically by inducing multisensory illusion. Technically, this includes sensing user interaction using machine learning tools and multimodal presentation of information.

Main Research Question

How can illusionary surface interfaces support creating better and more usable, tangible and touch-based interactions with pervasive computers?

Sub-Research Questions

1. How can we improve interactive surfaces and objects using multisensory illusions in our personal space or a control room?
2. What are effective and robust multimodal methods to enhance the haptic experience with everyday objects?
3. How can we comprehensively capture relevant and multimodal parameters that describe the user experience for physical interaction with artefacts?
4. How does physical interaction on a set of tangible and touch interaction elements impact human perception, experience, and behaviour?

PhD Students