Feasibility Study of Multi-Layer VVC Coding Scheme for Hybrid Machine-Human Consumption

Jaakko Laitinen, Tero Partanen, Alexandre Mercat, Jarno Vanne, Miska Hannuksela, Honglei Zhang, Alireza Aminlou, Francesco Cricri

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

1 Citation (Scopus)
14 Downloads (Pure)

Abstract

The proliferation of machine vision applications necessitates developing more efficient visual data compression schemes for machine consumption. However, numerous automated use cases still require keeping humans in the loop, leading to the need for a machine-optimized video streaming with the option for human supervision. This paper investigates the feasibility of using the multi-layer coding approach of the emerging Versatile Video Coding (VVC) standard to create favorable conditions for hybrid machine-human consumption. We introduce a multi-layer coding scheme, where the base layer (BL) is optimized for machines and the enhancement layer (EL) complements the stream for human vision. Our results demonstrate that the bitrate of the proposed multi-layer stream (BL + EL) is, on average, 11% higher than that of a single-layer VVC. However, the more compact BL yields overall bandwidth savings as long as the EL is required less than 80% of the time.
Original languageEnglish
Title of host publication2024 IEEE International Conference on Multimedia and Expo (ICME)
PublisherIEEE
Pages1-6
Number of pages6
ISBN (Electronic)979-8-3503-9015-5
DOIs
Publication statusPublished - Jul 2024
Publication typeA4 Article in conference proceedings
EventIEEE International Conference on Multimedia and Expo - Niagara Falls, Canada
Duration: 15 Jul 202419 Jul 2024

Publication series

NameIEEE International Conference on Multimedia and Expo
ISSN (Electronic)1945-788X

Conference

ConferenceIEEE International Conference on Multimedia and Expo
Country/TerritoryCanada
CityNiagara Falls
Period15/07/2419/07/24

Keywords

  • Video coding
  • Visualization
  • Machine vision
  • Bit rate
  • Data compression
  • Streaming media
  • Encoding
  • Region-of-interest (ROI)
  • Versatile Video Coding (VVC)
  • Multi-layer video coding
  • Video Coding for Machines (VCM)
  • hybrid machine-human video consumption

Publication forum classification

  • Publication forum level 1

Fingerprint

Dive into the research topics of 'Feasibility Study of Multi-Layer VVC Coding Scheme for Hybrid Machine-Human Consumption'. Together they form a unique fingerprint.

Cite this