AR-based interaction for human-robot collaborative manufacturing

Antti Hietanen; Roel Stephan Pieters; Minna Lanz; Jyrki Latokartano; Joni Kämäräinen

doi:10.1016/j.rcim.2019.101891

AR-based interaction for human-robot collaborative manufacturing

Tutkimustuotos: Artikkeli › Tieteellinen › vertaisarvioitu

231 Sitaatiot (Scopus)

90 Lataukset (Pure)

Abstrakti

Industrial standards define safety requirements for Human-Robot Collaboration (HRC) in industrial manufacturing. The standards particularly require real-time monitoring and securing of the minimum protective distance between a robot and an operator. This paper proposes a depth-sensor based model for workspace monitoring and an interactive Augmented Reality (AR) User Interface (UI) for safe HRC. The AR UI is implemented on two different hardware: a projector-mirror setup and a wearable AR gear (HoloLens). The workspace model and UIs are evaluated in a realistic diesel engine assembly task. The AR-based interactive UIs provide 21–24% and 57–64% reduction in the task completion and robot idle time, respectively, as compared to a baseline without interaction and workspace sharing. However, user experience assessment reveal that HoloLens based AR is not yet suitable for industrial manufacturing while the projector-mirror setup shows clear improvements in safety and work ergonomics.

Alkuperäiskieli	Englanti
Artikkeli	101891
Julkaisu	Robotics and Computer-Integrated Manufacturing
Vuosikerta	63
Numero	2020
DOI - pysyväislinkit	https://doi.org/10.1016/j.rcim.2019.101891
Tila	Julkaistu - marrask. 2019
OKM-julkaisutyyppi	A1 Alkuperäisartikkeli tieteellisessä aikakauslehdessä

Julkaisufoorumi-taso

Jufo-taso 3

Pääsy asiakirjaan

10.1016/j.rcim.2019.101891Lisenssi: CC BY-NC-ND

AR-based interaction for human-robot collaborative manufacturing 2019Final published version, 1,88 MBLisenssi: CC BY-NC-ND

http://urn.fi/URN:NBN:fi:tuni-202002122026Lisenssi: CC BY-NC-ND

Siteeraa tätä

@article{7a5349a532434d12bb74ca57a2508f4d,

title = "AR-based interaction for human-robot collaborative manufacturing",

abstract = "Industrial standards define safety requirements for Human-Robot Collaboration (HRC) in industrial manufacturing. The standards particularly require real-time monitoring and securing of the minimum protective distance between a robot and an operator. This paper proposes a depth-sensor based model for workspace monitoring and an interactive Augmented Reality (AR) User Interface (UI) for safe HRC. The AR UI is implemented on two different hardware: a projector-mirror setup and a wearable AR gear (HoloLens). The workspace model and UIs are evaluated in a realistic diesel engine assembly task. The AR-based interactive UIs provide 21–24\% and 57–64\% reduction in the task completion and robot idle time, respectively, as compared to a baseline without interaction and workspace sharing. However, user experience assessment reveal that HoloLens based AR is not yet suitable for industrial manufacturing while the projector-mirror setup shows clear improvements in safety and work ergonomics.",

author = "Antti Hietanen and Pieters, \{Roel Stephan\} and Minna Lanz and Jyrki Latokartano and Joni K{\"a}m{\"a}r{\"a}inen",

year = "2019",

month = nov,

doi = "10.1016/j.rcim.2019.101891",

language = "English",

volume = "63",

journal = "Robotics and Computer-Integrated Manufacturing",

issn = "0736-5845",

publisher = "Elsevier",

number = "2020",

}

TY - JOUR

T1 - AR-based interaction for human-robot collaborative manufacturing

AU - Hietanen, Antti

AU - Pieters, Roel Stephan

AU - Lanz, Minna

AU - Latokartano, Jyrki

AU - Kämäräinen, Joni

PY - 2019/11

Y1 - 2019/11

N2 - Industrial standards define safety requirements for Human-Robot Collaboration (HRC) in industrial manufacturing. The standards particularly require real-time monitoring and securing of the minimum protective distance between a robot and an operator. This paper proposes a depth-sensor based model for workspace monitoring and an interactive Augmented Reality (AR) User Interface (UI) for safe HRC. The AR UI is implemented on two different hardware: a projector-mirror setup and a wearable AR gear (HoloLens). The workspace model and UIs are evaluated in a realistic diesel engine assembly task. The AR-based interactive UIs provide 21–24% and 57–64% reduction in the task completion and robot idle time, respectively, as compared to a baseline without interaction and workspace sharing. However, user experience assessment reveal that HoloLens based AR is not yet suitable for industrial manufacturing while the projector-mirror setup shows clear improvements in safety and work ergonomics.

AB - Industrial standards define safety requirements for Human-Robot Collaboration (HRC) in industrial manufacturing. The standards particularly require real-time monitoring and securing of the minimum protective distance between a robot and an operator. This paper proposes a depth-sensor based model for workspace monitoring and an interactive Augmented Reality (AR) User Interface (UI) for safe HRC. The AR UI is implemented on two different hardware: a projector-mirror setup and a wearable AR gear (HoloLens). The workspace model and UIs are evaluated in a realistic diesel engine assembly task. The AR-based interactive UIs provide 21–24% and 57–64% reduction in the task completion and robot idle time, respectively, as compared to a baseline without interaction and workspace sharing. However, user experience assessment reveal that HoloLens based AR is not yet suitable for industrial manufacturing while the projector-mirror setup shows clear improvements in safety and work ergonomics.

U2 - 10.1016/j.rcim.2019.101891

DO - 10.1016/j.rcim.2019.101891

M3 - Article

SN - 0736-5845

VL - 63

JO - Robotics and Computer-Integrated Manufacturing

JF - Robotics and Computer-Integrated Manufacturing

IS - 2020

M1 - 101891

ER -

AR-based interaction for human-robot collaborative manufacturing

Abstrakti

Julkaisufoorumi-taso

Pääsy asiakirjaan

Sormenjälki

Siteeraa tätä