Depth Assisted Composition of Synthetic and Real 3D Scenes

Santiago Cortes, Olli Suominen, Atanas Gotchev

    Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review


    In media production, previsualization is an important step. It allows the director and the production crew to see an estimate of the final product during the filmmaking process. This work focuses in a previsualization system for composite shots, which involves real and virtual content. The system visualizes a correct perspective view of how the real objects in front of the camera operator look placed in a virtual space. The aim is to simplify the workflow, reduce production time and allow more direct control of the end result. The real scene is shot with a time-of-flight depth camera, whose pose is tracked using a motion capture system. Depth-based segmentation is applied to remove the background and content outside the desired volume, the geometry is aligned with a stream from an RGB color camera and a dynamic point cloud of the remaining real scene contents is created. The virtual objects are then also transformed into the coordinate space of the tracked camera, and the resulting composite view is rendered accordingly. The prototype camera system is implemented as a self-contained unit with local processing, and it runs at 15 fps and produces a 1024x768 image.
    Original languageEnglish
    Title of host publicationProceedings of the IS&T International Symposium on Electronic Imaging
    Publication statusPublished - Feb 2016
    Publication typeA4 Article in a conference publication
    EventIS&T International Symposium on Electronic Imaging -
    Duration: 1 Jan 2000 → …

    Publication series

    ISSN (Electronic)2470-1173


    ConferenceIS&T International Symposium on Electronic Imaging
    Period1/01/00 → …

    Publication forum classification

    • Publication forum level 1


    Dive into the research topics of 'Depth Assisted Composition of Synthetic and Real 3D Scenes'. Together they form a unique fingerprint.

    Cite this