Mid-Air Gestural Interaction with a Large Fogscreen

Vera Remizova; Antti Sand; I. Scott MacKenzie; Oleg Špakov; Katariina Nyyssönen; Ismo Rakkolainen; Anneli Kylliäinen; Veikko Surakka; Yulia Gizatdinova

doi:10.3390/mti7070063

Mid-Air Gestural Interaction with a Large Fogscreen

Vera Remizova^*
, Antti Sand
, I. Scott MacKenzie
, Oleg Špakov
, Katariina Nyyssönen
, Ismo Rakkolainen
, Anneli Kylliäinen
, Veikko Surakka
, Yulia Gizatdinova

^*Corresponding author for this work

Research output: Contribution to journal › Article › Scientific › peer-review

9 Citations (Scopus)

99 Downloads (Pure)

Abstract

Projected walk-through fogscreens have been created, but there is little research on the evaluation of the interaction performance with fogscreens. The present study investigated mid-air hand gestures for interaction with a large fogscreen. Participants (N = 20) selected objects from a fogscreen using tapping and dwell-based gestural techniques, with and without vibrotactile/haptic feedback. In terms of Fitts’ law, the throughput was about 1.4 bps to 2.6 bps, suggesting that gestural interaction with a large fogscreen is a suitable and effective input method. Our results also suggest that tapping without haptic feedback has good performance and potential for interaction with a fogscreen, and that tactile feedback is not necessary for effective mid-air interaction. These findings have implications for the design of gestural interfaces suitable for interaction with fogscreens.

Original language	English
Article number	63
Journal	Multimodal Technologies and Interaction
Volume	7
Issue number	7
DOIs	https://doi.org/10.3390/mti7070063
Publication status	Published - Jun 2023
Publication type	A1 Journal article-refereed

Funding

The Faculty of Information Technology and Communication Sciences at Tampere University: funding for the doctoral studies of Vera Remizova; The Research Council of Finland: grant #326430; The Research Council of Finland: grant #351492.

Keywords

Fitts’ law
fogscreen
haptic feedback
mid-air hand gestures
touchless user interface

Publication forum classification

Publication forum level 1

ASJC Scopus subject areas

Neuroscience (miscellaneous)
Human-Computer Interaction
Computer Science Applications
Computer Networks and Communications

Access to Document

10.3390/mti7070063Licence: CC BY

mti-07-00063-v3Final published version, 1.22 MBLicence: CC BY

https://urn.fi/URN:NBN:fi:tuni-202308227714Licence: CC BY

Psychology Clinic PSYKE
Kylliäinen, A. (Manager), Helminen, T. (Contact) & Lauttia, J. (Contact)
Welfare Sciences
Facility/equipment: Research infrastructure

Cite this

@article{6604eff60d2b4a23a54c78341c43e51b,

title = "Mid-Air Gestural Interaction with a Large Fogscreen",

abstract = "Projected walk-through fogscreens have been created, but there is little research on the evaluation of the interaction performance with fogscreens. The present study investigated mid-air hand gestures for interaction with a large fogscreen. Participants (N = 20) selected objects from a fogscreen using tapping and dwell-based gestural techniques, with and without vibrotactile/haptic feedback. In terms of Fitts{\textquoteright} law, the throughput was about 1.4 bps to 2.6 bps, suggesting that gestural interaction with a large fogscreen is a suitable and effective input method. Our results also suggest that tapping without haptic feedback has good performance and potential for interaction with a fogscreen, and that tactile feedback is not necessary for effective mid-air interaction. These findings have implications for the design of gestural interfaces suitable for interaction with fogscreens.",

keywords = "Fitts{\textquoteright} law, fogscreen, haptic feedback, mid-air hand gestures, touchless user interface",

author = "Vera Remizova and Antti Sand and MacKenzie, \{I. Scott\} and Oleg {\v S}pakov and Katariina Nyyss{\"o}nen and Ismo Rakkolainen and Anneli Kylli{\"a}inen and Veikko Surakka and Yulia Gizatdinova",

note = "Funding Information: The Faculty of Information Technology and Communication Sciences at Tampere University: funding for the doctoral studies of Vera Remizova; The Research Council of Finland: grant \#326430; The Research Council of Finland: grant \#351492. Publisher Copyright: {\textcopyright} 2023 by the authors.",

year = "2023",

month = jun,

doi = "10.3390/mti7070063",

language = "English",

volume = "7",

journal = "Multimodal Technologies and Interaction",

issn = "2414-4088",

publisher = "Multidisciplinary Digital Publishing Institute (MDPI)",

number = "7",

}

TY - JOUR

T1 - Mid-Air Gestural Interaction with a Large Fogscreen

AU - Remizova, Vera

AU - Sand, Antti

AU - MacKenzie, I. Scott

AU - Špakov, Oleg

AU - Nyyssönen, Katariina

AU - Rakkolainen, Ismo

AU - Kylliäinen, Anneli

AU - Surakka, Veikko

AU - Gizatdinova, Yulia

N1 - Funding Information: The Faculty of Information Technology and Communication Sciences at Tampere University: funding for the doctoral studies of Vera Remizova; The Research Council of Finland: grant #326430; The Research Council of Finland: grant #351492. Publisher Copyright: © 2023 by the authors.

PY - 2023/6

Y1 - 2023/6

N2 - Projected walk-through fogscreens have been created, but there is little research on the evaluation of the interaction performance with fogscreens. The present study investigated mid-air hand gestures for interaction with a large fogscreen. Participants (N = 20) selected objects from a fogscreen using tapping and dwell-based gestural techniques, with and without vibrotactile/haptic feedback. In terms of Fitts’ law, the throughput was about 1.4 bps to 2.6 bps, suggesting that gestural interaction with a large fogscreen is a suitable and effective input method. Our results also suggest that tapping without haptic feedback has good performance and potential for interaction with a fogscreen, and that tactile feedback is not necessary for effective mid-air interaction. These findings have implications for the design of gestural interfaces suitable for interaction with fogscreens.

AB - Projected walk-through fogscreens have been created, but there is little research on the evaluation of the interaction performance with fogscreens. The present study investigated mid-air hand gestures for interaction with a large fogscreen. Participants (N = 20) selected objects from a fogscreen using tapping and dwell-based gestural techniques, with and without vibrotactile/haptic feedback. In terms of Fitts’ law, the throughput was about 1.4 bps to 2.6 bps, suggesting that gestural interaction with a large fogscreen is a suitable and effective input method. Our results also suggest that tapping without haptic feedback has good performance and potential for interaction with a fogscreen, and that tactile feedback is not necessary for effective mid-air interaction. These findings have implications for the design of gestural interfaces suitable for interaction with fogscreens.

KW - Fitts’ law

KW - fogscreen

KW - haptic feedback

KW - mid-air hand gestures

KW - touchless user interface

U2 - 10.3390/mti7070063

DO - 10.3390/mti7070063

M3 - Article

AN - SCOPUS:85166221940

SN - 2414-4088

VL - 7

JO - Multimodal Technologies and Interaction

JF - Multimodal Technologies and Interaction

IS - 7

M1 - 63

ER -

Mid-Air Gestural Interaction with a Large Fogscreen

Abstract

Funding

Keywords

Publication forum classification

ASJC Scopus subject areas

Access to Document

Fingerprint

Equipment

Psychology Clinic PSYKE

Cite this