Skip to main navigation Skip to search Skip to main content

Guiding Monocular Depth Estimation Using Depth-Attention Volume

  • Lam Huynh*
  • , Phong Nguyen-Ha
  • , Jiri Matas
  • , Esa Rahtu
  • , Janne Heikkilä
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

132 Citations (Scopus)

Abstract

Recovering the scene depth from a single image is an ill-posed problem that requires additional priors, often referred to as monocular depth cues, to disambiguate different 3D interpretations. In recent works, those priors have been learned in an end-to-end manner from large datasets by using deep neural networks. In this paper, we propose guiding depth estimation to favor planar structures that are ubiquitous especially in indoor environments. This is achieved by incorporating a non-local coplanarity constraint to the network with a novel attention mechanism called depth-attention volume (DAV). Experiments on two popular indoor datasets, namely NYU-Depth-v2 and ScanNet, show that our method achieves state-of-the-art depth estimation results while using only a fraction of the number of parameters needed by the competing methods. Code is available at: https://github.com/HuynhLam/DAV.

Original languageEnglish
Title of host publicationComputer Vision – ECCV 2020 - 16th European Conference, 2020, Proceedings
EditorsAndrea Vedaldi, Horst Bischof, Thomas Brox, Jan-Michael Frahm
PublisherSpringer
Pages581-597
Number of pages17
ISBN (Print)9783030585730
DOIs
Publication statusPublished - 2020
Publication typeA4 Article in conference proceedings
EventEuropean Conference on Computer Vision - Glasgow, United Kingdom
Duration: 23 Aug 202028 Aug 2020

Publication series

NameLecture Notes in Computer Science
Volume12371 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceEuropean Conference on Computer Vision
Country/TerritoryUnited Kingdom
CityGlasgow
Period23/08/2028/08/20

Keywords

  • Attention mechanism
  • Depth estimation
  • Monocular depth

Publication forum classification

  • Publication forum level 2

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'Guiding Monocular Depth Estimation Using Depth-Attention Volume'. Together they form a unique fingerprint.

Cite this