Preserving natural scene lighting by strobe-lit video

    Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

    3 Citations (Scopus)
    58 Downloads (Pure)

    Abstract

    Capturing images in low light intensity, and preserving ambient light in such conditions pose significant problems in terms of achievable image quality. Either the sensitivity of the sensor must be increased, filling the resulting image with noise, or the scene must be lit with artificial light, destroying the aesthetic quality of the image. While the issue has been previously tackled for still imagery using cross-bilateral filtering, the same problem exists in capturing video. We propose a method of illuminating the scene with a strobe light synchronized to every other frame captured by the camera, and merging the information from consecutive frames alternating between high gain and high intensity lighting. The motion between the frames is compensated using motion estimation based on block matching between strobe-illuminated frames. The uniform lighting conditions between every other frame make it possible to utilize conventional motion estimation methods, circumventing the image registration challenges faced in fusing flash/non-flash pairs from non-stationary images. The results of the proposed method are shown to closely resemble those computed using the same filter based on reference images captured at perfect camera alignment. The method can be applied starting from a simple set of three frames to video streams of arbitrary lengths with the only requirements being sufficiently accurate syncing between the imaging device and the lighting unit, and the capability to switch states (sensor gain high/low, illumination on/off) fast enough.

    Original languageEnglish
    Title of host publicationImage Processing: Algorithms and Systems XIII
    PublisherSPIE
    ISBN (Print)9781628414899
    DOIs
    Publication statusPublished - 2015
    Publication typeA4 Article in conference proceedings
    EventIS&T/SPIE Electronic Imaging / Image Processing: Algorithms and Systems -
    Duration: 1 Jan 1900 → …

    Publication series

    NameSPIE Conference Proceedings
    Volume9399

    Conference

    ConferenceIS&T/SPIE Electronic Imaging / Image Processing: Algorithms and Systems
    Period1/01/00 → …

    Keywords

    • Ambient light
    • Bilateral filter
    • Computational photography
    • Image denoising
    • Low-light
    • Motion compensation

    Publication forum classification

    • Publication forum level 1

    ASJC Scopus subject areas

    • Applied Mathematics
    • Computer Science Applications
    • Electrical and Electronic Engineering
    • Electronic, Optical and Magnetic Materials
    • Condensed Matter Physics

    Fingerprint

    Dive into the research topics of 'Preserving natural scene lighting by strobe-lit video'. Together they form a unique fingerprint.

    Cite this