Focus model for metric depth estimation in standard plenoptic cameras

Said Pertuz; Edith Pulido-Herrera; Joni-Kristian Kämäräinen

doi:10.1016/j.isprsjprs.2018.06.020

Focus model for metric depth estimation in standard plenoptic cameras

Said Pertuz, Edith Pulido-Herrera, Joni-Kristian Kämäräinen

Research output: Contribution to journal › Article › Scientific › peer-review

20 Citations (Scopus)

Abstract

In recent years, a lot of efforts have been devoted to the problem of depth estimation from lightfield images captured by standard plenoptic cameras. However, most of the metric depth estimation methods in the state-of-the-art leverage pixel disparity only. In this paper, we tackle the problem of focus-based metric depth estimation in standard plenoptic cameras. For this purpose we propose a closed-form model that relates the refocusing parameter with the focus distance of a plenoptic camera in order to allow for metric depth estimation. Based on the proposed model, we develop a calibration procedure that allows finding the parameters of the model. Using measurements of a time-of-flight sensor as ground-truth, experimental validation in a distance range of 0.2–1.6 m shows that focus-based depth estimation is feasible with a root-mean-squared error of less than 5 cm.

Original language	English
Pages (from-to)	38-47
Number of pages	10
Journal	ISPRS Journal of Photogrammetry and Remote Sensing
Volume	144
DOIs	https://doi.org/10.1016/j.isprsjprs.2018.06.020
Publication status	Published - 1 Oct 2018
Publication type	A1 Journal article-refereed

Funding

The authors would like to thank Ionut Schiopu and Olli Suominen of the Centre for Immersive Visual Technologies (CIVIT) at Tampere University of Technology for their advice and help in the selection and use of the most suitable TOF sensor for this work, as well as for granting us access to their facilities for performing some experiments under controlled scenarios. The authors gratefully acknowledge the Vicerrectoría de Investigación y Extensión of Universidad Industrial de Santander for supporting this research registered under the project title Movement Analysis in Compressive Multi-Spectral Video Imaging, (VIE code 2347). E. Pulido-Herrera would like to thank Antonio Nariño University for the financial support (project number 2017224). Appendix A

Keywords

Calibration
Depth estimation
Focus
Lightfield
Plenoptic camera

Publication forum classification

Publication forum level 1

ASJC Scopus subject areas

Atomic and Molecular Physics, and Optics
Engineering (miscellaneous)
Computer Science Applications
Computers in Earth Sciences

Access to Document

10.1016/j.isprsjprs.2018.06.020

Cite this

@article{8728703f63b54256b02d237757752cb4,

title = "Focus model for metric depth estimation in standard plenoptic cameras",

abstract = "In recent years, a lot of efforts have been devoted to the problem of depth estimation from lightfield images captured by standard plenoptic cameras. However, most of the metric depth estimation methods in the state-of-the-art leverage pixel disparity only. In this paper, we tackle the problem of focus-based metric depth estimation in standard plenoptic cameras. For this purpose we propose a closed-form model that relates the refocusing parameter with the focus distance of a plenoptic camera in order to allow for metric depth estimation. Based on the proposed model, we develop a calibration procedure that allows finding the parameters of the model. Using measurements of a time-of-flight sensor as ground-truth, experimental validation in a distance range of 0.2–1.6 m shows that focus-based depth estimation is feasible with a root-mean-squared error of less than 5 cm.",

keywords = "Calibration, Depth estimation, Focus, Lightfield, Plenoptic camera",

author = "Said Pertuz and Edith Pulido-Herrera and Joni-Kristian K{\"a}m{\"a}r{\"a}inen",

year = "2018",

month = oct,

day = "1",

doi = "10.1016/j.isprsjprs.2018.06.020",

language = "English",

volume = "144",

pages = "38--47",

journal = "ISPRS Journal of Photogrammetry and Remote Sensing",

issn = "0924-2716",

publisher = "Elsevier B.V.",

}

TY - JOUR

T1 - Focus model for metric depth estimation in standard plenoptic cameras

AU - Pertuz, Said

AU - Pulido-Herrera, Edith

AU - Kämäräinen, Joni-Kristian

PY - 2018/10/1

Y1 - 2018/10/1

N2 - In recent years, a lot of efforts have been devoted to the problem of depth estimation from lightfield images captured by standard plenoptic cameras. However, most of the metric depth estimation methods in the state-of-the-art leverage pixel disparity only. In this paper, we tackle the problem of focus-based metric depth estimation in standard plenoptic cameras. For this purpose we propose a closed-form model that relates the refocusing parameter with the focus distance of a plenoptic camera in order to allow for metric depth estimation. Based on the proposed model, we develop a calibration procedure that allows finding the parameters of the model. Using measurements of a time-of-flight sensor as ground-truth, experimental validation in a distance range of 0.2–1.6 m shows that focus-based depth estimation is feasible with a root-mean-squared error of less than 5 cm.

AB - In recent years, a lot of efforts have been devoted to the problem of depth estimation from lightfield images captured by standard plenoptic cameras. However, most of the metric depth estimation methods in the state-of-the-art leverage pixel disparity only. In this paper, we tackle the problem of focus-based metric depth estimation in standard plenoptic cameras. For this purpose we propose a closed-form model that relates the refocusing parameter with the focus distance of a plenoptic camera in order to allow for metric depth estimation. Based on the proposed model, we develop a calibration procedure that allows finding the parameters of the model. Using measurements of a time-of-flight sensor as ground-truth, experimental validation in a distance range of 0.2–1.6 m shows that focus-based depth estimation is feasible with a root-mean-squared error of less than 5 cm.

KW - Calibration

KW - Depth estimation

KW - Focus

KW - Lightfield

KW - Plenoptic camera

U2 - 10.1016/j.isprsjprs.2018.06.020

DO - 10.1016/j.isprsjprs.2018.06.020

M3 - Article

AN - SCOPUS:85049523458

SN - 0924-2716

VL - 144

SP - 38

EP - 47

JO - ISPRS Journal of Photogrammetry and Remote Sensing

JF - ISPRS Journal of Photogrammetry and Remote Sensing

ER -

Focus model for metric depth estimation in standard plenoptic cameras

Abstract

Funding

Keywords

Publication forum classification

ASJC Scopus subject areas

Access to Document

Fingerprint

Cite this