Fast: Flow-Assisted Shearlet Transform for Densely-Sampled Light Field Reconstruction

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

2 Citations (Scopus)
8 Downloads (Pure)

Abstract

Shearlet Transform (ST) is one of the most effective methods for Densely-Sampled Light Field (DSLF) reconstruction from a Sparsely-Sampled Light Field (SSLF). However, ST requires a precise disparity estimation of the SSLF. To this end, in this paper a state-of-the-art optical flow method, i.e. PWC-Net, is employed to estimate bidirectional disparity maps between neighboring views in the SSLF. Moreover, to take full advantage of optical flow and ST for DSLF reconstruction, a novel learning-based method, referred to as Flow-Assisted Shearlet Transform (FAST), is proposed in this paper. Specifically, FAST consists of two deep convolutional neural networks, i.e. disparity refinement network and view synthesis network, which fully leverage the disparity information to synthesize novel views via warping and blending and to improve the novel view synthesis performance of ST. Experimental results demonstrate the superiority of the proposed FAST method over the other state-of-the-art DSLF reconstruction methods on nine challenging real-world SSLF sub-datasets with large disparity ranges (up to 26 pixels).
Original languageEnglish
Title of host publication2019 IEEE International Conference on Image Processing (ICIP)
PublisherIEEE
Pages3741-3745
Number of pages5
ISBN (Electronic)978-1-5386-6249-6
ISBN (Print)978-1-5386-6250-2
DOIs
Publication statusPublished - Sept 2019
Publication typeA4 Article in conference proceedings
EventIEEE International Conference on Image Processing -
Duration: 1 Jan 1900 → …

Publication series

NameIEEE International Conference on Image Processing
ISSN (Print)1522-4880
ISSN (Electronic)2381-8549

Conference

ConferenceIEEE International Conference on Image Processing
Period1/01/00 → …

Keywords

  • Image reconstruction
  • Transforms
  • Optical imaging
  • Cameras
  • Adaptive optics
  • Training
  • Light fields
  • Densely-Sampled Light Field Reconstruction
  • Parallax View Generation
  • Novel View Synthesis
  • Shearlet Transform
  • Flow-Assisted Shearlet Transform

Publication forum classification

  • Publication forum level 1

Fingerprint

Dive into the research topics of 'Fast: Flow-Assisted Shearlet Transform for Densely-Sampled Light Field Reconstruction'. Together they form a unique fingerprint.

Cite this