Open3DGen: Open-source software for reconstructing textured 3D models from RGB-D images

Teo T. Niemirepo, Marko Viitanen, Jarno Vanne

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

6 Downloads (Pure)

Abstract

This paper presents the first entirely open-source and cross-platform software called Open3DGen for reconstructing photorealistic textured 3D models from RGB-D images. The proposed software pipeline consists of nine main stages: 1) RGB-D acquisition; 2) 2D feature extraction; 3) camera pose estimation; 4) point cloud generation; 5) coarse mesh reconstruction; 6) optional loop closure; 7) fine mesh reconstruction; 8) UV unwrapping; and 9) texture projection. This end-To-end scheme combines multiple state-of-The-Art techniques and provides an easy-To-use software package for real-Time 3D model reconstruction and offline texture mapping. The main innovation lies in various Structure-from-Motion (SfM) techniques that are used with additional depth data to yield high-quality 3D models in real-Time and at low cost. The functionality of Open3DGen has been validated on AMD Ryzen 3900X CPU and Nvidia GTX1080 GPU. This proof-of-concept setup attains an average processing speed of 15 fps for 720p (1280x720) RGBD input without the offline backend. Our solution is shown to provide competitive 3D mesh quality and execution performance with the state-of-The-Art commercial and academic solutions.

Original languageEnglish
Title of host publicationMMSys 2021 - Proceedings of the 2021 Multimedia Systems Conference
PublisherACM
Pages13-22
Number of pages10
ISBN (Electronic)9781450384346
DOIs
Publication statusPublished - 2021
Publication typeA4 Article in a conference publication
EventACM Multimedia Systems Conference - Virtual, Online, Turkey
Duration: 28 Sep 20211 Oct 2021

Conference

ConferenceACM Multimedia Systems Conference
Country/TerritoryTurkey
CityVirtual, Online
Period28/09/211/10/21

Keywords

  • 3D model reconstruction
  • camera pose estimation
  • feature extraction
  • mesh reconstruction
  • point cloud generation
  • RGB-D acquisition
  • texture mapping

Publication forum classification

  • Publication forum level 1

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design

Fingerprint

Dive into the research topics of 'Open3DGen: Open-source software for reconstructing textured 3D models from RGB-D images'. Together they form a unique fingerprint.

Cite this