Combining Touch, Mid-Air Gesture and Floor Mat Interaction on Public Displays

How can a single public display support multiple interaction modalities simultaneously?

This study investigates a novel approach to simultaneously use the qualities of touch and mid-air gestures or floor mat interaction on a single public display. We envision how a single display may enable multiple users to retrieve information from the same display by interacting from different distances and via different affordances.

We demonstrate that although the concurrent use of multiple interaction modalities appeared functionally possible and has the potential to augment a single display with both personal and public functionalities, it is hampered by issues relating to display and interaction blindness, in addition to social discomfort and what we propose to name affordance blindness. We describe this blindness as the inability to understand the interaction modalities of a public display.


  • Coenen, J., Claes, S., Vande Moere, A. (2017). The Concurrent Use of Touch and Mid-Air Gestures or Floor Mat Interaction on a Public Display. International Symposium on Pervasive Displays. PerDis'17. Lugano, Switzerland, 7-9 June 2017 ( 9) ACM.
  • This paper won the best paper award at the Pervasive Displays 2017 Conference.
Secured By miniOrange