Learning Wavefront Coding for Extended Depth of Field Imaging

Ugur Akpinar, Erdem Sahin, Monjurul Meem, Rajesh Menon, Atanas Gotchev

Research output: Contribution to journalArticleScientificpeer-review

52 Downloads (Pure)


Depth of field is an important factor of imaging systems that highly affects the quality of the acquired spatial information. Extended depth of field (EDoF) imaging is a challenging ill-posed problem and has been extensively addressed in the literature. We propose a computational imaging approach for EDoF, where we employ wavefront coding via a diffractive optical element (DOE) and we achieve deblurring through a convolutional neural network. Thanks to the end-to-end differentiable modeling of optical image formation and computational post-processing, we jointly optimize the optical design, i.e., DOE, and the deblurring through standard gradient descent methods. Based on the properties of the underlying refractive lens and the desired EDoF range, we provide an analytical expression for the search space of the DOE, which is instrumental in the convergence of the end-to-end network. We achieve superior EDoF imaging performance compared to the state of the art, where we demonstrate results with minimal artifacts in various scenarios, including deep 3D scenes and broadband imaging.
Original languageEnglish
Pages (from-to)3307-3320
Number of pages14
JournalIEEE Transactions on Image Processing
Publication statusPublished - 24 Feb 2021
Publication typeA1 Journal article-refereed

Publication forum classification

  • Publication forum level 3


Dive into the research topics of 'Learning Wavefront Coding for Extended Depth of Field Imaging'. Together they form a unique fingerprint.

Cite this