TY - GEN
T1 - Open-Source Toolkit for Live End-To-End 4K VVC Intra Coding
AU - Viitanen, Marko
AU - Sainio, Joose
AU - Mercat, Alexandre
AU - Gautier, Guillaume
AU - Vanne, Jarno
AU - Farhat, Ibrahim
AU - Cabarat, Pierre Loup
AU - Hamidouche, Wassim
AU - Menard, Daniel
N1 - Funding Information:
This work was supported in part by the AI for situational Awareness (AISA) project led by Nokia and funded by Business Finland, and the Academy of Finland (decision no. 349216).
Publisher Copyright:
© 2023 Owner/Author(s).
PY - 2023/6/7
Y1 - 2023/6/7
N2 - Versatile Video Coding (VVC/H.266) takes video coding to the next level by doubling the coding efficiency over its predecessors for the same subjective quality, but at the cost of immense coding complexity. Therefore, VVC calls for aggressively optimized codecs to make it feasible for live streaming media applications. This paper introduces the first public end-To-end (E2E) pipeline for live 4K30p VVC intra coding and streaming. The pipeline is made up of three open-source components: 1) uvg266 for VVC encoding; 2) uvgRTP for VVC streaming; and 3) OpenVVC for VVC decoding. The proposed setup is demonstrated with a proof-of-concept prototype that implements the encoder end on AMD ThreadRipper 2990WX and the decoder end on Nvidia Jetson AGX Orin. Our prototype is almost 34 000 times as fast as the corresponding E2E pipeline built around the VTM codec. Respectively, it achieves 3.3 times speedup without any significant coding overhead over the pipeline that utilizes the fastest possible configuration of the well-known VVenC/VVdeC codec. These results indicate that our prototype is currently the only viable open-source solution for live 4K VVC intra coding and streaming.
AB - Versatile Video Coding (VVC/H.266) takes video coding to the next level by doubling the coding efficiency over its predecessors for the same subjective quality, but at the cost of immense coding complexity. Therefore, VVC calls for aggressively optimized codecs to make it feasible for live streaming media applications. This paper introduces the first public end-To-end (E2E) pipeline for live 4K30p VVC intra coding and streaming. The pipeline is made up of three open-source components: 1) uvg266 for VVC encoding; 2) uvgRTP for VVC streaming; and 3) OpenVVC for VVC decoding. The proposed setup is demonstrated with a proof-of-concept prototype that implements the encoder end on AMD ThreadRipper 2990WX and the decoder end on Nvidia Jetson AGX Orin. Our prototype is almost 34 000 times as fast as the corresponding E2E pipeline built around the VTM codec. Respectively, it achieves 3.3 times speedup without any significant coding overhead over the pipeline that utilizes the fastest possible configuration of the well-known VVenC/VVdeC codec. These results indicate that our prototype is currently the only viable open-source solution for live 4K VVC intra coding and streaming.
KW - end-To-end (E2E) streaming
KW - open-source implementation
KW - real-Time coding speed
KW - versatile video coding (VVC)
KW - VVC intra coding
U2 - 10.1145/3587819.3593938
DO - 10.1145/3587819.3593938
M3 - Conference contribution
AN - SCOPUS:85163699625
T3 - MMSys 2023 - Proceedings of the 14th ACM Multimedia Systems Conference
SP - 312
EP - 317
BT - MMSys 2023 - Proceedings of the 14th ACM Multimedia Systems Conference
PB - ACM
T2 - ACM Multimedia Systems Conference
Y2 - 7 June 2023 through 10 June 2023
ER -