AR-based interaction for human-robot collaborative manufacturing

Antti Hietanen; Roel Stephan Pieters; Minna Lanz; Jyrki Latokartano; Joni Kämäräinen

doi:10.1016/j.rcim.2019.101891

AR-based interaction for human-robot collaborative manufacturing

Antti Hietanen, Roel Stephan Pieters, Minna Lanz, Jyrki Latokartano, Joni Kämäräinen

Research output: Contribution to journal › Article › Scientific › peer-review

159 Citations (Scopus)

80 Downloads (Pure)

Abstract

Industrial standards define safety requirements for Human-Robot Collaboration (HRC) in industrial manufacturing. The standards particularly require real-time monitoring and securing of the minimum protective distance between a robot and an operator. This paper proposes a depth-sensor based model for workspace monitoring and an interactive Augmented Reality (AR) User Interface (UI) for safe HRC. The AR UI is implemented on two different hardware: a projector-mirror setup and a wearable AR gear (HoloLens). The workspace model and UIs are evaluated in a realistic diesel engine assembly task. The AR-based interactive UIs provide 21–24% and 57–64% reduction in the task completion and robot idle time, respectively, as compared to a baseline without interaction and workspace sharing. However, user experience assessment reveal that HoloLens based AR is not yet suitable for industrial manufacturing while the projector-mirror setup shows clear improvements in safety and work ergonomics.

Original language	English
Article number	101891
Journal	Robotics and Computer-Integrated Manufacturing
Volume	63
Issue number	2020
DOIs	https://doi.org/10.1016/j.rcim.2019.101891
Publication status	Published - Nov 2019
Publication type	A1 Journal article-refereed

Publication forum classification

Publication forum level 3

Access to Document

10.1016/j.rcim.2019.101891Licence: CC BY-NC-ND

AR-based interaction for human-robot collaborative manufacturing 2019Final published version, 1.88 MBLicence: CC BY-NC-ND

http://urn.fi/URN:NBN:fi:tuni-202002122026Licence: CC BY-NC-ND

Cite this

@article{7a5349a532434d12bb74ca57a2508f4d,

title = "AR-based interaction for human-robot collaborative manufacturing",

abstract = "Industrial standards define safety requirements for Human-Robot Collaboration (HRC) in industrial manufacturing. The standards particularly require real-time monitoring and securing of the minimum protective distance between a robot and an operator. This paper proposes a depth-sensor based model for workspace monitoring and an interactive Augmented Reality (AR) User Interface (UI) for safe HRC. The AR UI is implemented on two different hardware: a projector-mirror setup and a wearable AR gear (HoloLens). The workspace model and UIs are evaluated in a realistic diesel engine assembly task. The AR-based interactive UIs provide 21–24% and 57–64% reduction in the task completion and robot idle time, respectively, as compared to a baseline without interaction and workspace sharing. However, user experience assessment reveal that HoloLens based AR is not yet suitable for industrial manufacturing while the projector-mirror setup shows clear improvements in safety and work ergonomics.",

author = "Antti Hietanen and Pieters, {Roel Stephan} and Minna Lanz and Jyrki Latokartano and Joni K{\"a}m{\"a}r{\"a}inen",

year = "2019",

month = nov,

doi = "10.1016/j.rcim.2019.101891",

language = "English",

volume = "63",

journal = "Robotics and Computer-Integrated Manufacturing",

issn = "0736-5845",

publisher = "Elsevier",

number = "2020",

}

TY - JOUR

T1 - AR-based interaction for human-robot collaborative manufacturing

AU - Hietanen, Antti

AU - Pieters, Roel Stephan

AU - Lanz, Minna

AU - Latokartano, Jyrki

AU - Kämäräinen, Joni

PY - 2019/11

Y1 - 2019/11

N2 - Industrial standards define safety requirements for Human-Robot Collaboration (HRC) in industrial manufacturing. The standards particularly require real-time monitoring and securing of the minimum protective distance between a robot and an operator. This paper proposes a depth-sensor based model for workspace monitoring and an interactive Augmented Reality (AR) User Interface (UI) for safe HRC. The AR UI is implemented on two different hardware: a projector-mirror setup and a wearable AR gear (HoloLens). The workspace model and UIs are evaluated in a realistic diesel engine assembly task. The AR-based interactive UIs provide 21–24% and 57–64% reduction in the task completion and robot idle time, respectively, as compared to a baseline without interaction and workspace sharing. However, user experience assessment reveal that HoloLens based AR is not yet suitable for industrial manufacturing while the projector-mirror setup shows clear improvements in safety and work ergonomics.

AB - Industrial standards define safety requirements for Human-Robot Collaboration (HRC) in industrial manufacturing. The standards particularly require real-time monitoring and securing of the minimum protective distance between a robot and an operator. This paper proposes a depth-sensor based model for workspace monitoring and an interactive Augmented Reality (AR) User Interface (UI) for safe HRC. The AR UI is implemented on two different hardware: a projector-mirror setup and a wearable AR gear (HoloLens). The workspace model and UIs are evaluated in a realistic diesel engine assembly task. The AR-based interactive UIs provide 21–24% and 57–64% reduction in the task completion and robot idle time, respectively, as compared to a baseline without interaction and workspace sharing. However, user experience assessment reveal that HoloLens based AR is not yet suitable for industrial manufacturing while the projector-mirror setup shows clear improvements in safety and work ergonomics.

U2 - 10.1016/j.rcim.2019.101891

DO - 10.1016/j.rcim.2019.101891

M3 - Article

SN - 0736-5845

VL - 63

JO - Robotics and Computer-Integrated Manufacturing

JF - Robotics and Computer-Integrated Manufacturing

IS - 2020

M1 - 101891

ER -

AR-based interaction for human-robot collaborative manufacturing

Abstract

Publication forum classification

Access to Document

Fingerprint

Cite this