Low latency edge rendering scheme for interactive 360 degree virtual reality gaming

    Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

    11 Citations (Scopus)
    60 Downloads (Pure)

    Abstract

    This paper describes the core functionality and a proof-of-concept demonstration setup for remote 360 degree stereo virtual reality (VR) gaming. In this end-to-end scheme, the execution of a VR game is off-loaded from an end user device to a cloud edge server in which the executed game is rendered based on user's field of view (FoV) and control actions. Headset and controller feedback is transmitted over the network to the server from which the rendered views of the game are streamed to a user in real-time as encoded HEVC video frames. This approach saves energy and computation load of the end terminals by making use of the latest advancements in network connection speed and quality. In the showcased demonstration, a VR game is run in Unity on a laptop powered by i7 7820HK processor and GTX 1070 GPU. The 360 degree spherical view of the game is rendered and converted to a rectangular frame using equirectangular projection (ERP). The ERP video is sliced vertically and only the FoV is encoded with Kvazaar HEVC encoder in real time and sent over the network in UDP packets. Another laptop is used for playback with a HTC Vive VR headset. Our system can reach an end-to-end latency of 30 ms and bit rate of 20 Mbps for stereo 1080p30 format.

    Original languageEnglish
    Title of host publicationProceedings - 2018 IEEE 38th International Conference on Distributed Computing Systems, ICDCS 2018
    PublisherIEEE
    Pages1557-1560
    Number of pages4
    ISBN (Electronic)9781538668719
    DOIs
    Publication statusPublished - 19 Jul 2018
    Publication typeA4 Article in a conference publication
    EventInternational Conference on Distributed Computing Systems - Vienna, Austria
    Duration: 2 Jul 20185 Jul 2018

    Publication series

    Name
    ISSN (Electronic)2575-8411

    Conference

    ConferenceInternational Conference on Distributed Computing Systems
    Country/TerritoryAustria
    CityVienna
    Period2/07/185/07/18

    Keywords

    • 360 degree video
    • Edge computing
    • High Efficiency Video Coding (HEVC)
    • Video coding
    • Virtual reality (VR)

    Publication forum classification

    • Publication forum level 2

    ASJC Scopus subject areas

    • Software
    • Hardware and Architecture
    • Computer Networks and Communications

    Fingerprint

    Dive into the research topics of 'Low latency edge rendering scheme for interactive 360 degree virtual reality gaming'. Together they form a unique fingerprint.

    Cite this