Eye-Controlled Region of Interest HEVC Encoding

Joose Sainio; Arttu Ylä-Outinen; Marko Viitanen; Jarno Vanne; Timo D. Hämäläinen

doi:10.1109/ISM.2018.00-12

Eye-Controlled Region of Interest HEVC Encoding

Joose Sainio, Arttu Ylä-Outinen, Marko Viitanen, Jarno Vanne, Timo D. Hämäläinen

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

3 Citations (Scopus)

134 Downloads (Pure)

Abstract

This paper presents a demonstrator setup for real-time HEVC encoding with gaze-based region of interest (ROI) detection. This proof-of-concept system is built on Kvazaar open-source HEVC encoder and Pupil eye tracking glasses. The gaze data is used to extract the ROI from live video and the ROI is encoded with higher quality than non-ROI regions. This demonstration illustrates that performing HEVC encoding with non-uniform quality reduces bit rate by 40-90% and complexity by 10-35% over that of the conventional approaches with negligible to minor deterioration in subjective quality.

Original language	English
Title of host publication	2018 IEEE International Symposium on Multimedia (ISM)
Publisher	IEEE
Number of pages	2
ISBN (Electronic)	978-1-5386-6857-3
DOIs	https://doi.org/10.1109/ISM.2018.00-12
Publication status	Published - Dec 2018
Publication type	A4 Article in conference proceedings
Event	IEEE International Symposium on Multimedia - Taichung, Taiwan, Province of China Duration: 10 Dec 2018 → 12 Dec 2018 Conference number: 20

Conference

Conference	IEEE International Symposium on Multimedia
Abbreviated title	ISM
Country/Territory	Taiwan, Province of China
City	Taichung
Period	10/12/18 → 12/12/18

Keywords

High Efficiency Video Coding (HEVC)
region of interest (ROI)
ROI coding
eye tracking
Kvazaar HEVC encoder

Publication forum classification

Publication forum level 1

Access to Document

10.1109/ISM.2018.00-12

Eye-Controlled Region of Interest HEVC Encoding preprintAccepted author manuscript, 554 KB

http://urn.fi/URN:NBN:fi:tty-201908211986

Cite this

@inproceedings{9a060030b4634c9b9761e884a4a3a999,

title = "Eye-Controlled Region of Interest HEVC Encoding",

abstract = "This paper presents a demonstrator setup for real-time HEVC encoding with gaze-based region of interest (ROI) detection. This proof-of-concept system is built on Kvazaar open-source HEVC encoder and Pupil eye tracking glasses. The gaze data is used to extract the ROI from live video and the ROI is encoded with higher quality than non-ROI regions. This demonstration illustrates that performing HEVC encoding with non-uniform quality reduces bit rate by 40-90% and complexity by 10-35% over that of the conventional approaches with negligible to minor deterioration in subjective quality.",

keywords = "High Efficiency Video Coding (HEVC), region of interest (ROI), ROI coding, eye tracking, Kvazaar HEVC encoder",

author = "Joose Sainio and Arttu Yl{\"a}-Outinen and Marko Viitanen and Jarno Vanne and H{\"a}m{\"a}l{\"a}inen, {Timo D.}",

year = "2018",

month = dec,

doi = "10.1109/ISM.2018.00-12",

language = "English",

booktitle = "2018 IEEE International Symposium on Multimedia (ISM)",

publisher = "IEEE",

note = "IEEE International Symposium on Multimedia, ISM ; Conference date: 10-12-2018 Through 12-12-2018",

}

TY - GEN

T1 - Eye-Controlled Region of Interest HEVC Encoding

AU - Sainio, Joose

AU - Ylä-Outinen, Arttu

AU - Viitanen, Marko

AU - Vanne, Jarno

AU - Hämäläinen, Timo D.

N1 - Conference code: 20

PY - 2018/12

Y1 - 2018/12

N2 - This paper presents a demonstrator setup for real-time HEVC encoding with gaze-based region of interest (ROI) detection. This proof-of-concept system is built on Kvazaar open-source HEVC encoder and Pupil eye tracking glasses. The gaze data is used to extract the ROI from live video and the ROI is encoded with higher quality than non-ROI regions. This demonstration illustrates that performing HEVC encoding with non-uniform quality reduces bit rate by 40-90% and complexity by 10-35% over that of the conventional approaches with negligible to minor deterioration in subjective quality.

AB - This paper presents a demonstrator setup for real-time HEVC encoding with gaze-based region of interest (ROI) detection. This proof-of-concept system is built on Kvazaar open-source HEVC encoder and Pupil eye tracking glasses. The gaze data is used to extract the ROI from live video and the ROI is encoded with higher quality than non-ROI regions. This demonstration illustrates that performing HEVC encoding with non-uniform quality reduces bit rate by 40-90% and complexity by 10-35% over that of the conventional approaches with negligible to minor deterioration in subjective quality.

KW - High Efficiency Video Coding (HEVC)

KW - region of interest (ROI)

KW - ROI coding

KW - eye tracking

KW - Kvazaar HEVC encoder

U2 - 10.1109/ISM.2018.00-12

DO - 10.1109/ISM.2018.00-12

M3 - Conference contribution

BT - 2018 IEEE International Symposium on Multimedia (ISM)

PB - IEEE

T2 - IEEE International Symposium on Multimedia

Y2 - 10 December 2018 through 12 December 2018

ER -

Eye-Controlled Region of Interest HEVC Encoding

Abstract

Conference

Keywords

Publication forum classification

Access to Document

Fingerprint

Cite this