Mobile and adaptive User interface for human robot collaboration in assembly tasks

Dmitrii Monakhov; Jyrki Latokartano; Minna Lanz; Roel Pieters; Joni-Kristian Kämäräinen

doi:10.1109/ICAR53236.2021.9659401

Mobile and adaptive User interface for human robot collaboration in assembly tasks

Dmitrii Monakhov, Jyrki Latokartano, Minna Lanz, Roel Pieters, Joni-Kristian Kämäräinen

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

3 Citations (Scopus)

16 Downloads (Pure)

Abstract

The manufacturing sector is constantly looking for more efficient ways of production. The Industry 4.0 related technologies such as augmented and mixed reality, connectivity and digitalisation as well as the current trend of robotisation have resulted a number of technical solutions to support the production in factories. The combination of human-robot collaboration and augmented reality shows good promises. The challenges in this case come from the need to reconfigure the physical production layout and how to deliver the digital instructions to the operator. This paper introduces a model for collaborative assembly tasks that uses a mobile user interface based on the depth sensors and a projector. The novelty of this research comes from the adaptivity of the user interface, as it can be freely moved between the tasks around the workstation based on the operator needs and requirements of the tasks. The ability to move projection surface is achieved by detecting the surface position using Aruco markers and computing required transformation of the projector image.

Original language	English
Title of host publication	2021 20th International Conference on Advanced Robotics (ICAR)
Publisher	IEEE
Pages	812-817
Number of pages	6
ISBN (Electronic)	9781665436847
ISBN (Print)	9781665436854
DOIs	https://doi.org/10.1109/ICAR53236.2021.9659401
Publication status	Published - 2021
Publication type	A4 Article in conference proceedings
Event	International Conference on Advanced Robotics - Ljubljana, Slovenia Duration: 6 Dec 2021 → 10 Dec 2021

Conference

Conference	International Conference on Advanced Robotics
Country/Territory	Slovenia
City	Ljubljana
Period	6/12/21 → 10/12/21

Publication forum classification

Publication forum level 1

ASJC Scopus subject areas

Artificial Intelligence
Human-Computer Interaction
Software

Access to Document

10.1109/ICAR53236.2021.9659401Licence: Unspecified

ICAR21_ieeeconf_ICAR2021_Monakhov_final
©2022 IEEE
Accepted author manuscript, 5.59 MBLicence: Unspecified

https://urn.fi/URN:NBN:fi:tuni-202212129068Licence: Unspecified

Cite this

@inproceedings{dd3101a5848243ab809af2e0557dcfec,

title = "Mobile and adaptive User interface for human robot collaboration in assembly tasks",

abstract = "The manufacturing sector is constantly looking for more efficient ways of production. The Industry 4.0 related technologies such as augmented and mixed reality, connectivity and digitalisation as well as the current trend of robotisation have resulted a number of technical solutions to support the production in factories. The combination of human-robot collaboration and augmented reality shows good promises. The challenges in this case come from the need to reconfigure the physical production layout and how to deliver the digital instructions to the operator. This paper introduces a model for collaborative assembly tasks that uses a mobile user interface based on the depth sensors and a projector. The novelty of this research comes from the adaptivity of the user interface, as it can be freely moved between the tasks around the workstation based on the operator needs and requirements of the tasks. The ability to move projection surface is achieved by detecting the surface position using Aruco markers and computing required transformation of the projector image. ",

author = "Dmitrii Monakhov and Jyrki Latokartano and Minna Lanz and Roel Pieters and Joni-Kristian K{\"a}m{\"a}r{\"a}inen",

note = "Funding Information: This project has received funding from the European Union{\textquoteright}s Horizon 2020 research and innovation programme Funding Information: under grant agreement No. 825196. Funding Information: This project has received funding from the European Union s Horizon 2020 research and innovation programme under grant agreement No. 825196. Publisher Copyright: {\textcopyright} 2021 IEEE.; International Conference on Advanced Robotics ; Conference date: 06-12-2021 Through 10-12-2021",

year = "2021",

doi = "10.1109/ICAR53236.2021.9659401",

language = "English",

isbn = "9781665436854",

pages = "812--817",

booktitle = "2021 20th International Conference on Advanced Robotics (ICAR)",

publisher = "IEEE",

}

TY - GEN

T1 - Mobile and adaptive User interface for human robot collaboration in assembly tasks

AU - Monakhov, Dmitrii

AU - Latokartano, Jyrki

AU - Lanz, Minna

AU - Pieters, Roel

AU - Kämäräinen, Joni-Kristian

N1 - Funding Information: This project has received funding from the European Union’s Horizon 2020 research and innovation programme Funding Information: under grant agreement No. 825196. Funding Information: This project has received funding from the European Union s Horizon 2020 research and innovation programme under grant agreement No. 825196. Publisher Copyright: © 2021 IEEE.

PY - 2021

Y1 - 2021

N2 - The manufacturing sector is constantly looking for more efficient ways of production. The Industry 4.0 related technologies such as augmented and mixed reality, connectivity and digitalisation as well as the current trend of robotisation have resulted a number of technical solutions to support the production in factories. The combination of human-robot collaboration and augmented reality shows good promises. The challenges in this case come from the need to reconfigure the physical production layout and how to deliver the digital instructions to the operator. This paper introduces a model for collaborative assembly tasks that uses a mobile user interface based on the depth sensors and a projector. The novelty of this research comes from the adaptivity of the user interface, as it can be freely moved between the tasks around the workstation based on the operator needs and requirements of the tasks. The ability to move projection surface is achieved by detecting the surface position using Aruco markers and computing required transformation of the projector image.

AB - The manufacturing sector is constantly looking for more efficient ways of production. The Industry 4.0 related technologies such as augmented and mixed reality, connectivity and digitalisation as well as the current trend of robotisation have resulted a number of technical solutions to support the production in factories. The combination of human-robot collaboration and augmented reality shows good promises. The challenges in this case come from the need to reconfigure the physical production layout and how to deliver the digital instructions to the operator. This paper introduces a model for collaborative assembly tasks that uses a mobile user interface based on the depth sensors and a projector. The novelty of this research comes from the adaptivity of the user interface, as it can be freely moved between the tasks around the workstation based on the operator needs and requirements of the tasks. The ability to move projection surface is achieved by detecting the surface position using Aruco markers and computing required transformation of the projector image.

U2 - 10.1109/ICAR53236.2021.9659401

DO - 10.1109/ICAR53236.2021.9659401

M3 - Conference contribution

AN - SCOPUS:85124698139

SN - 9781665436854

SP - 812

EP - 817

BT - 2021 20th International Conference on Advanced Robotics (ICAR)

PB - IEEE

T2 - International Conference on Advanced Robotics

Y2 - 6 December 2021 through 10 December 2021

ER -

Mobile and adaptive User interface for human robot collaboration in assembly tasks

Abstract

Conference

Publication forum classification

ASJC Scopus subject areas

Access to Document

Fingerprint

Cite this