Skip to main navigation Skip to search Skip to main content

A Comparative Assessment of Implicit and Explicit Plenoptic Scene Representations

  • Davi R. Freitas
  • , Ricardo L. De Queiroz
  • , Ioan Tabus
  • , Christine Guillemot

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

1 Citation (Scopus)
4 Downloads (Pure)

Abstract

3D scene representation has been a central theme of study for a wide range of applications, and the representation of light behavior is one of the relevant topics when producing realistic models. In this work, we create a framework to assess the representation of non-Lambertian scenes by generating a pipeline to create plenoptic point clouds (PPCs) systematically and evaluating them against implicit solutions, such as Neural Radiance Fields (NeRF)-like models. We compare such approaches according to rendering quality and compression efficiency. On the compression side, we propose an encoding scheme for PPC, leveraging the occlusion masks of the points and the Moving Picture Expert Group's (MPEG) Geometry-Based Solid Content Test Model (GeS-TM). Rendering results over the training views show that the uncompressed PPC outperforms 3D Gaussian Splatting (3DGS) by 1.51 dB, on average, for the 8 scenes of the NeRF Synthetic 360 dataset. In compression efficiency, 3DGS outperforms the compressed PPCs by 0.7 dB in BD-PSNR on average. Our occlusion-aware encoding scheme reduces the size of uncompressed PPCs up to 800 times, outperforming current encoding schemes for PPC by 1.9 dB in BD-PSNR.

Original languageEnglish
Title of host publication2024 IEEE 26th International Workshop on Multimedia Signal Processing, MMSP 2024
PublisherIEEE
Pages1-6
ISBN (Electronic)9798350387254
DOIs
Publication statusPublished - 2024
Publication typeA4 Article in conference proceedings
EventIEEE International Workshop on Multimedia Signal Processing - West Lafayette, United States
Duration: 2 Oct 2024 → 4 Oct 2024

Publication series

NameIEEE International Workshop on Multimedia Signal Processing
ISSN (Electronic)2473-3628

Conference

ConferenceIEEE International Workshop on Multimedia Signal Processing
Country/TerritoryUnited States
CityWest Lafayette
Period2/10/24 → 4/10/24

Funding

This project has received funding from the European Union's Horizon 2020 research and innovation programme under the Marie Sk\u0142odowska-Curie grant agreement No 956770.

FundersFunder number
Horizon 2020
H2020 Marie Skłodowska-Curie Actions956770

    Keywords

    • 3D Gaussian Splatting
    • Compression
    • NeRF
    • Plenoptic Point Clouds

    Publication forum classification

    • Publication forum level 1

    ASJC Scopus subject areas

    • Signal Processing
    • Media Technology
    • Artificial Intelligence
    • Computer Networks and Communications
    • Computer Vision and Pattern Recognition

    Fingerprint

    Dive into the research topics of 'A Comparative Assessment of Implicit and Explicit Plenoptic Scene Representations'. Together they form a unique fingerprint.

    Cite this