Where's My Cellphone: Non-contact based Hand-Gestures and Ultrasound haptic feedback for Secondary Task Interaction while Driving

Ahmed Farooq; Tomi Nukarinen; Antti Sand; Hanna Venesvirta; Oleg Spakov; Veikko Surakka; Roope Raisamo

doi:10.1109/SENSORS47087.2021.9639734

Where's My Cellphone: Non-contact based Hand-Gestures and Ultrasound haptic feedback for Secondary Task Interaction while Driving

Ahmed Farooq, Tomi Nukarinen, Antti Sand, Hanna Venesvirta, Oleg Spakov, Veikko Surakka, Roope Raisamo

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

Abstract

Drivers regularly use their smartphones to perform secondary tasks while driving, which can negatively impact traffic safety. In such complex interaction, multimodal feedback has been associated with lowering driver distraction. We investigated four methods for completing a phone-based secondary task while driving: smartphone in hand, smartphone in a rack, buttons on the steering wheel with Head-up-display (HUD), and mid-air gestures with an ultrasound haptic feedback and a HUD. Participants (N=16) drove the Lane Change Test (LCT) simulator with each method to complete predefined secondary tasks. To measure performance in primary task, we recorded lane deviations and for secondary task we measured response times and errors. Additionally, the participants filled in the NASA-TLX questionnaire and ranked each method according to their preferences. The results showed that the performance and preference for the hand and rack conditions were similar, while performance with buttons and gestures was worse, even with ultrasound haptic feedback, than in hand and rack conditions. The results highlight the importance of rigorous user testing when introducing new modalities for in-vehicle interaction to enhance primary and secondary task performance.

Original language	English
Title of host publication	2021 IEEE Sensors
Publisher	IEEE
Pages	1-4
Number of pages	4
ISBN (Electronic)	978-1-7281-9501-8
DOIs	https://doi.org/10.1109/SENSORS47087.2021.9639734
Publication status	Published - 2021
Publication type	A4 Article in conference proceedings
Event	IEEE Sensors - , Australia Duration: 31 Oct 2021 → 3 Nov 2021

Publication series

Name	Proceedings of IEEE Sensors
ISSN (Electronic)	2168-9229

Conference

Conference	IEEE Sensors
Country/Territory	Australia
Period	31/10/21 → 3/11/21

Keywords

Ultrasonic imaging
Ultrasonic variables measurement
Atmospheric measurements
Measurement uncertainty
Wheels
Particle measurements
Haptic interfaces
Tactile feedback
mid-air gestures
Ultra-haptics
in-vehicle interaction
smartphone interaction
head-up display

Publication forum classification

Publication forum level 1

Access to Document

10.1109/SENSORS47087.2021.9639734

Farooq_SN21_Where's My Cellphone
This publication is copyrighted. You may download, display and print it for Your own personal use. Commercial use is prohibited.
Accepted author manuscript, 459 KBLicence: Unspecified

https://urn.fi/URN:NBN:fi:tuni-202202282201

Cite this

@inproceedings{53cc05ce8573484d9adf055ea10b7bcc,

title = "Where's My Cellphone: Non-contact based Hand-Gestures and Ultrasound haptic feedback for Secondary Task Interaction while Driving",

abstract = "Drivers regularly use their smartphones to perform secondary tasks while driving, which can negatively impact traffic safety. In such complex interaction, multimodal feedback has been associated with lowering driver distraction. We investigated four methods for completing a phone-based secondary task while driving: smartphone in hand, smartphone in a rack, buttons on the steering wheel with Head-up-display (HUD), and mid-air gestures with an ultrasound haptic feedback and a HUD. Participants (N=16) drove the Lane Change Test (LCT) simulator with each method to complete predefined secondary tasks. To measure performance in primary task, we recorded lane deviations and for secondary task we measured response times and errors. Additionally, the participants filled in the NASA-TLX questionnaire and ranked each method according to their preferences. The results showed that the performance and preference for the hand and rack conditions were similar, while performance with buttons and gestures was worse, even with ultrasound haptic feedback, than in hand and rack conditions. The results highlight the importance of rigorous user testing when introducing new modalities for in-vehicle interaction to enhance primary and secondary task performance.",

keywords = "Ultrasonic imaging, Ultrasonic variables measurement, Atmospheric measurements, Measurement uncertainty, Wheels, Particle measurements, Haptic interfaces, Tactile feedback, mid-air gestures, Ultra-haptics, in-vehicle interaction, smartphone interaction, head-up display",

author = "Ahmed Farooq and Tomi Nukarinen and Antti Sand and Hanna Venesvirta and Oleg Spakov and Veikko Surakka and Roope Raisamo",

year = "2021",

doi = "10.1109/SENSORS47087.2021.9639734",

language = "English",

series = "Proceedings of IEEE Sensors",

publisher = "IEEE",

pages = "1--4",

booktitle = "2021 IEEE Sensors",

note = "IEEE Sensors ; Conference date: 31-10-2021 Through 03-11-2021",

}

Farooq, A , Nukarinen, T , Sand, A , Venesvirta, H , Spakov, O , Surakka, V & Raisamo, R 2021, Where's My Cellphone: Non-contact based Hand-Gestures and Ultrasound haptic feedback for Secondary Task Interaction while Driving. in 2021 IEEE Sensors. Proceedings of IEEE Sensors, IEEE, pp. 1-4, IEEE Sensors, Australia, 31/10/21. https://doi.org/10.1109/SENSORS47087.2021.9639734

Where's My Cellphone: Non-contact based Hand-Gestures and Ultrasound haptic feedback for Secondary Task Interaction while Driving. / Farooq, Ahmed ; Nukarinen, Tomi ; Sand, Antti et al.

2021 IEEE Sensors. IEEE, 2021. p. 1-4 (Proceedings of IEEE Sensors).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

TY - GEN

T1 - Where's My Cellphone: Non-contact based Hand-Gestures and Ultrasound haptic feedback for Secondary Task Interaction while Driving

AU - Farooq, Ahmed

AU - Nukarinen, Tomi

AU - Sand, Antti

AU - Venesvirta, Hanna

AU - Spakov, Oleg

AU - Surakka, Veikko

AU - Raisamo, Roope

PY - 2021

Y1 - 2021

N2 - Drivers regularly use their smartphones to perform secondary tasks while driving, which can negatively impact traffic safety. In such complex interaction, multimodal feedback has been associated with lowering driver distraction. We investigated four methods for completing a phone-based secondary task while driving: smartphone in hand, smartphone in a rack, buttons on the steering wheel with Head-up-display (HUD), and mid-air gestures with an ultrasound haptic feedback and a HUD. Participants (N=16) drove the Lane Change Test (LCT) simulator with each method to complete predefined secondary tasks. To measure performance in primary task, we recorded lane deviations and for secondary task we measured response times and errors. Additionally, the participants filled in the NASA-TLX questionnaire and ranked each method according to their preferences. The results showed that the performance and preference for the hand and rack conditions were similar, while performance with buttons and gestures was worse, even with ultrasound haptic feedback, than in hand and rack conditions. The results highlight the importance of rigorous user testing when introducing new modalities for in-vehicle interaction to enhance primary and secondary task performance.

AB - Drivers regularly use their smartphones to perform secondary tasks while driving, which can negatively impact traffic safety. In such complex interaction, multimodal feedback has been associated with lowering driver distraction. We investigated four methods for completing a phone-based secondary task while driving: smartphone in hand, smartphone in a rack, buttons on the steering wheel with Head-up-display (HUD), and mid-air gestures with an ultrasound haptic feedback and a HUD. Participants (N=16) drove the Lane Change Test (LCT) simulator with each method to complete predefined secondary tasks. To measure performance in primary task, we recorded lane deviations and for secondary task we measured response times and errors. Additionally, the participants filled in the NASA-TLX questionnaire and ranked each method according to their preferences. The results showed that the performance and preference for the hand and rack conditions were similar, while performance with buttons and gestures was worse, even with ultrasound haptic feedback, than in hand and rack conditions. The results highlight the importance of rigorous user testing when introducing new modalities for in-vehicle interaction to enhance primary and secondary task performance.

KW - Ultrasonic imaging

KW - Ultrasonic variables measurement

KW - Atmospheric measurements

KW - Measurement uncertainty

KW - Wheels

KW - Particle measurements

KW - Haptic interfaces

KW - Tactile feedback

KW - mid-air gestures

KW - Ultra-haptics

KW - in-vehicle interaction

KW - smartphone interaction

KW - head-up display

U2 - 10.1109/SENSORS47087.2021.9639734

DO - 10.1109/SENSORS47087.2021.9639734

M3 - Conference contribution

T3 - Proceedings of IEEE Sensors

SP - 1

EP - 4

BT - 2021 IEEE Sensors

PB - IEEE

T2 - IEEE Sensors

Y2 - 31 October 2021 through 3 November 2021

ER -

Where's My Cellphone: Non-contact based Hand-Gestures and Ultrasound haptic feedback for Secondary Task Interaction while Driving

Abstract

Publication series

Conference

Keywords

Publication forum classification

Access to Document

Fingerprint

Cite this