Self-Supervised Light Field Reconstruction Using Shearlet Transform and Cycle Consistency

Research output: Contribution to journalArticleScientificpeer-review

1 Citation (Scopus)
4 Downloads (Pure)


Shearlet Transform (ST) has been instrumental for the Densely-Sampled Light Field (DSLF) reconstruction, as it sparsifies the underlying Epipolar-Plane Images (EPIs). The sought sparsification is implemented through an iterative regularization, which tends to be slow because of the time spent on domain transformations for dozens of iterations. To overcome this limitation, this letter proposes a novel self-supervised DSLF reconstruction method, CycleST, which employs ST and cycle consistency. Specifically, CycleST is composed of an encoder-decoder network and a residual learning strategy that restore the shearlet coefficients of densely-sampled EPIs using EPI-reconstruction and cycle-consistency losses. CycleST is a self-supervised approach that can be trained solely on Sparsely-Sampled Light Fields (SSLFs) with small disparity ranges (⩽ 8 pixels). Experimental results of DSLF reconstruction on SSLFs with large disparity ranges (16-32 pixels) demonstrate the effectiveness and efficiency of the proposed CycleST method. Furthermore, CycleST achieves ∼ 9x speedup over ST, at least.

Original languageEnglish
Pages (from-to)1425-1429
Number of pages5
JournalIEEE Signal Processing Letters
Publication statusPublished - 2020
Publication typeA1 Journal article-refereed


  • cycle consistency
  • Image-based rendering
  • light field reconstruction
  • self-supervision
  • shearlet transform

Publication forum classification

  • Publication forum level 2

ASJC Scopus subject areas

  • Signal Processing
  • Electrical and Electronic Engineering
  • Applied Mathematics


Dive into the research topics of 'Self-Supervised Light Field Reconstruction Using Shearlet Transform and Cycle Consistency'. Together they form a unique fingerprint.

Cite this